Talent.com
GCP Data Engineer--KUMDC5641878 (Columbia)
GCP Data Engineer--KUMDC5641878 (Columbia)Compunnel Inc. • Columbia, MD, US
GCP Data Engineer KUMDC5641878 (Columbia)

GCP Data Engineer KUMDC5641878 (Columbia)

Compunnel Inc. • Columbia, MD, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.part_time]
[job_card.job_description]

Data Engineer

Location : Lisle IL, or Columbia MD

Hybrid (4 days in office)

JOB FUNCTIONS

Responsibilities

  • Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
  • Design, develop, deploy and support high performance data pipelines both inbound and outbound.
  • Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement CI / CD pipelines to ensure continuous deployment and delivery of our data products.
  • Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
  • Document the design and support strategy of the data pipelines
  • Capture, store and socialize data lineage and operational metadata
  • Troubleshoot and resolve data engineering issues as they arise.
  • Develop REST APIs to expose data to other teams within the company.
  • Mentor and guide junior data engineers.

Required for All Jobs

  • Performs other duties as assigned
  • Complies with all policies and standards

    • QUALIFICATIONS

    Education

  • Required - Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Nice to Have - Masters Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field

    • Work Experience

  • Minimum 6 years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics
  • 2 years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows

    • Knowledge, Skills and Abilities

  • Expert knowledge on SQL and Python programming
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
  • Experience in tuning queries for performance and scalability
  • Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
  • Excellent organizational, prioritization and analytical abilities
  • Have proven experience working in incremental execution through successful launches.
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.
  • Experience working in agile environment.
    • [job_alerts.create_a_job]

    Gcp • Columbia, MD, US

    [internal_linking.related_jobs]
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • Littlestown, Pennsylvania, US
    [filters.remote]
    [job_card.temporary]
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Analytica • Washington, DC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Analytica is seeking a Data Engineer to support a key, long-term federal government client program and software product.The ideal candidate will be comfortable working in an agile, multi-faceted te...[show_more]
    [last_updated.last_updated_30]
    Server

    Server

    Buffalo Wild Wings • Hanover, PA, US
    [job_card.full_time]
    In most jobs, everyone doesn’t spontaneously erupt into applause and start raining down high-fives.At Buffalo Wild Wings, that’s just a Thursday night. This is the place to start the nex...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer - Clearance Required

    Data Engineer - Clearance Required

    LMI Consulting, LLC • Washington, DC, United States
    [job_card.full_time]
    Data Engineer - Clearance Required.Salaried High Fringe / Full-Time.We are seeking a Data Engineer to join our team.The Data Engineer will be responsible for designing, developing, and maintaining en...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    PROVATOHR INC • Crystal City, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    This is a Hybrid position – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impa...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer - Hybrid (DMV)

    Senior Data Engineer - Hybrid (DMV)

    Halvik • Arlington, VA, USA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Halvik is a highly successful WOB business with more than 50 prime contracts and 500+ professionals delivering Digital Services, Advanced Analytics, Artificial Intelligence / Machine Learning, Cyber ...[show_more]
    [last_updated.last_updated_30]
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    Outlier • Columbia, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    ThinkTek LLC • Washington, District of Columbia, United States
    [job_card.full_time]
    ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Redhorse • Arlington, Virginia, United States, 22201
    [job_card.full_time]
    Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.Were looking for thought...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer - B2B Contract

    Senior Data Engineer - B2B Contract

    fusionSpan • Rocville, MD, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Span is a fast-growing company with development centers in the USA, Canada, El-Salvador, Poland, and India.Span's focus is on software development, enterprise CRM implementations, digital strategy,...[show_more]
    [last_updated.last_updated_1_hour] • [new]
    Powerbi Developer

    Powerbi Developer

    TEKsystems • Columbia, MD, United States
    [job_card.full_time]
    Our healthcare client is looking for a Data Analyst to join there Data Group.For this role, 80% of the time will be dedicated to PowerBI experience. The need for data modeling within Power BI, not j...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    CGS • Rockville, Maryland, United States, 20850
    [job_card.full_time]
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    Data Society • DC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, ...[show_more]
    [last_updated.last_updated_variable_days]
    Data Engineer

    Data Engineer

    AITHERAS, LLC • Arlington, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Data Engineer Salary : $95,000 - $120,000 Travel : 3 days onsite, 2 days work-from-home Onsite Location : Arlington, VA Job Description Scope We are seeking a Data Engineer to support our Diversion ...[show_more]
    [last_updated.last_updated_30]
    Senior AI / ML Engineer (SWE-3)

    Senior AI / ML Engineer (SWE-3)

    Leidos • Columbia, MD, US
    [job_card.full_time]
    National Security Sector's (NSS) Cyber & Analytics Business Area (CABA).Our talented team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, A...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Glaucoma Specialist

    Glaucoma Specialist

    HealthEcareers - Client • Westminster, MD, USA
    [job_card.full_time]
    VIP), a leading multi-specialty ophthalmology group, is excited to invite an enthusiastic and skilled .Westminster, Maryland practice, . Become part of our dedicated team, which includes experienced...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Remote Survey Panelist (Hiring Immediately)

    Remote Survey Panelist (Hiring Immediately)

    Maxion Research • Hanover, Pennsylvania, US
    [filters.remote]
    [job_card.part_time]
    Join Our Part-Time Research Studies Today!.Are you eager to earn extra income from the comfort of your home? We are looking for motivated individuals to participate in paid research studies includi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    IntelliTech LLC • Arlington, VA, US
    [job_card.temporary]
    [filters_job_card.quick_apply]
    IntelliTech is seeking experienced Data Engineers to join our team.As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our client's data infrastructure and sy...[show_more]
    [last_updated.last_updated_30]