GCP Data Engineer-- KUMDC5641878Compunnel Inc. • Columbia, MD, United States

GCP Data Engineer KUMDC5641878

Compunnel Inc. • Columbia, MD, United States

[job_card.variable_hours_ago]

[job_preview.job_type]

[job_card.full_time]

[job_card.job_description]

Data Engineer

Location : Lisle IL, or Columbia MD

Hybrid (4 days in office)

JOB FUNCTIONS

Responsibilities

Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
Design, develop, deploy and support high performance data pipelines both inbound and outbound.
Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
Optimize data pipelines for performance, scalability, and reliability.
Implement CI / CD pipelines to ensure continuous deployment and delivery of our data products.
Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
Document the design and support strategy of the data pipelines
Capture, store and socialize data lineage and operational metadata
Troubleshoot and resolve data engineering issues as they arise.
Develop REST APIs to expose data to other teams within the company.
Mentor and guide junior data engineers.

Required for All Jobs

Performs other duties as assigned

Complies with all policies and standards

QUALIFICATIONS

Education

Required - Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field

Nice to Have - Master’s Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field

Work Experience

Minimum 6 years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics

2 years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows

Knowledge, Skills and Abilities

Expert knowledge on SQL and Python programming

Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.

Experience in tuning queries for performance and scalability

Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.

Excellent organizational, prioritization and analytical abilities

Have proven experience working in incremental execution through successful launches.

Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.

Experience working in agile environment.

[job_alerts.create_a_job]

Data Engineer • Columbia, MD, United States

[internal_linking.related_jobs]

Remote Data Engineer : ETL, AWS & BI Dashboards

Zyxware Technologies • Washington, DC, United States

[filters.remote]

[job_card.full_time]

A leading tech company is seeking a Data Engineer / ETL Specialist to design and maintain data architecture.The role involves building ETL pipelines using Python in the AWS environment and creating i...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Blockchain Platform Engineer – Low-Latency Data

Coinbase • Washington, DC, United States

[job_card.full_time]

A financial technology company in Washington, D.The ideal candidate will possess strong skills in distributed systems, contribute to significant projects, and thrive in a fast-paced environment.A p...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

102825.1 - Data Analytics and BI Engineer

Next Phase Solutions and Services, Inc. • Columbia, MD, US

[job_card.full_time]

[filters_job_card.quick_apply]

Data Analytics and Business Intelligence Engineer .You will help design, develop, and maintain secure, scalable data and reporting solutions across a broad suite of analytics platforms and AWS...[show_more]

[last_updated.last_updated_30]

Data Engineer with IRS MBI Clearance

3M Consultancy • Washington, DC, us

[job_card.full_time]

[filters_job_card.quick_apply]

NEED IRS MBI Clearance with IRS GFE.We are seeking an experienced Data Engineer to design, build, and maintain scalable data processing pipelines using modern big data technologies.The ideal candid...[show_more]

[last_updated.last_updated_30]

Data Engineer (Secret clearance required)

Significance Inc • Arlington, Virginia, United States, 22201

[job_card.full_time]

Data Engineer (Secret clearance required).Significance is a woman-owned consulting firm serving the federal government.We are known for building trusted relationships within our teams and with our ...[show_more]

[last_updated.last_updated_30]

Data Engineer

Analytica • Washington, DC, US

[job_card.full_time]

[filters_job_card.quick_apply]

Analytica is seeking a Data Engineer to support a key, long-term federal government client program and software product.The ideal candidate will be comfortable working in an agile, multi-faceted te...[show_more]

[last_updated.last_updated_30]

Data Engineer - Clearance Required

LMI Consulting, LLC • Washington, DC, United States

[job_card.full_time]

Data Engineer - Clearance Required.Salaried High Fringe / Full-Time.We are seeking a Data Engineer to join our team.The Data Engineer will be responsible for designing, developing, and maintaining en...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Analytics Engineer

Estrada Consulting Incorporated • Washington, District of Columbia, United States

[job_card.full_time]

[filters_job_card.quick_apply]

Senior Data Analytics Engineer.Provide engineering expertise to maintain and extend DC PCSB’s data pipelines, warehouse, and infrastructure to support the implementation of Charter Goals and the AS...[show_more]

[last_updated.last_updated_variable_days]

Data Engineer

PROVATOHR INC • Crystal City, VA, US

[job_card.full_time]

[filters_job_card.quick_apply]

This is a Hybrid position – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impa...[show_more]

[last_updated.last_updated_30]

Senior Data Engineer - Hybrid (DMV)

Halvik • Arlington, VA, USA

[job_card.full_time]

[filters_job_card.quick_apply]

Halvik is a highly successful WOB business with more than 50 prime contracts and 500+ professionals delivering Digital Services, Advanced Analytics, Artificial Intelligence / Machine Learning, Cyber ...[show_more]

[last_updated.last_updated_30]

Azure Data Engineer

TechDigital Group • Washington, DC, United States

[job_card.full_time]

In-dept knowledge and hands-on experience in Microsoft Azure data stack i.Azure Data Factory, Azure Synapse, Azure SQL Database, etc. Experience of big data approach, architectural concepts, data so...[show_more]

[last_updated.last_updated_30] • [promoted]

Data Engineer

ThinkTek LLC • Washington, District of Columbia, United States

[job_card.full_time]

ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...[show_more]

[last_updated.last_updated_30] • [promoted]

Data Engineer

Redhorse • Arlington, Virginia, United States, 22201

[job_card.full_time]

Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.Were looking for thought...[show_more]

[last_updated.last_updated_30]

Senior Data Engineer - B2B Contract

fusionSpan • Rocville, MD, US

[job_card.full_time]

[filters_job_card.quick_apply]

Span is a fast-growing company with development centers in the USA, Canada, El-Salvador, Poland, and India.Span's focus is on software development, enterprise CRM implementations, digital strategy,...[show_more]

[last_updated.last_updated_less] • [new]

Lead Consultant, Data Engineer

Lovelytics • Arlington, VA, US

[job_card.full_time]

[filters_job_card.quick_apply]

Lovelytics is a Databricks-focused data and AI consulting firm specializing in artificial intelligence, data, and analytics solutions. Since partnering with Databricks in 2019, Lovelytics has experi...[show_more]

[last_updated.last_updated_30]

4447 - Data Analytics Engineer TS / SCI FSP

Mission Box Solutions - JT Alliance, LLC • Laurel, MD, US

[job_card.full_time]

[filters_job_card.quick_apply]

Our client is seeking a Data Analytics Engineer to support a U.This full-time position involves providing technical expertise to sustain mission-critical software and systems for a larg...[show_more]

[last_updated.last_updated_30]

Data Engineer

Data Society • DC, US

[job_card.full_time]

[filters_job_card.quick_apply]

At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, ...[show_more]

[last_updated.last_updated_variable_days]

Data Engineer

AITHERAS, LLC • Arlington, VA, US

[job_card.full_time]

[filters_job_card.quick_apply]

Data Engineer Salary : $95,000 - $120,000 Travel : 3 days onsite, 2 days work-from-home Onsite Location : Arlington, VA Job Description Scope We are seeking a Data Engineer to support our Diversion ...[show_more]

[last_updated.last_updated_30]