GCP Data Engineer--KUMDC5641878 (Columbia)Compunnel Inc. • Columbia, MD, US
[error_messages.no_longer_accepting]
GCP Data Engineer KUMDC5641878 (Columbia)
Compunnel Inc. • Columbia, MD, US
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.part_time]
[job_card.job_description]Performs other duties as assigned Complies with all policies and standards Required - Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field Nice to Have - Masters Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field Minimum 6 years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics 2 years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows Expert knowledge on SQL and Python programming Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed. Experience in tuning queries for performance and scalability Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar. Excellent organizational, prioritization and analytical abilities Have proven experience working in incremental execution through successful launches. Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment. Experience working in agile environment.
Data Engineer
Location : Lisle IL, or Columbia MD
Hybrid (4 days in office)
JOB FUNCTIONS
Responsibilities
- Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
- Design, develop, deploy and support high performance data pipelines both inbound and outbound.
- Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
- Optimize data pipelines for performance, scalability, and reliability.
- Implement CI / CD pipelines to ensure continuous deployment and delivery of our data products.
- Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
- Document the design and support strategy of the data pipelines
- Capture, store and socialize data lineage and operational metadata
- Troubleshoot and resolve data engineering issues as they arise.
- Develop REST APIs to expose data to other teams within the company.
- Mentor and guide junior data engineers.
Required for All Jobs
QUALIFICATIONS
Education
Work Experience
Knowledge, Skills and Abilities
[job_alerts.create_a_job]
Gcp • Columbia, MD, US
[internal_linking.similar_jobs]
A financial technology company in Washington, D.The ideal candidate will possess strong skills in distributed systems, contribute to significant projects, and thrive in a fast-paced environment.A p...[show_more]
Analytica is seeking a Data Engineer to support a key, long-term federal government client program and software product.The ideal candidate will be comfortable working in an agile, multi-faceted te...[show_more]
Data Engineer - Clearance Required.Salaried High Fringe / Full-Time.We are seeking a Data Engineer to join our team.The Data Engineer will be responsible for designing, developing, and maintaining en...[show_more]
A leading technology firm is seeking an experienced Azure Protection Analyst to design and manage data protection solutions in a hybrid Azure environment.
Candidates should have extensive knowledge ...[show_more]
Join a dynamic team at the pulse of global markets, where we deliver innovative software and service solutions for essential financial reporting and capital markets transactions.At DFIN, we are a v...[show_more]
Expression is seeking an experienced.Generative AI to support the continued growth of their Data Science Department.In this role, you will design and execute high-impact AI solutions for a wide ran...[show_more]
This is a Hybrid position – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impa...[show_more]
Halvik is a highly successful WOB business with more than 50 prime contracts and 500+ professionals delivering Digital Services, Advanced Analytics, Artificial Intelligence / Machine Learning, Cyber ...[show_more]
ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...[show_more]
Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.Were looking for thought...[show_more]
Driven by Innovation and built on Trust, rockITdata is a unique SDVOSB services company that partners with leading commercial healthcare / life sciences organizations on cutting edge innovations - th...[show_more]
All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...[show_more]
Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...[show_more]
Lead Data Engineer - Capital One Software (Remote).Capital One Software is seeking a Lead Data Engineer who is passionate about marrying innovation with emerging technologies.In 2022, we publicly a...[show_more]
At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations.
We partner with our clients to educate, ...[show_more]
Data Engineer Salary : $95,000 - $120,000 Travel : 3 days onsite, 2 days work-from-home Onsite Location : Arlington, VA Job Description Scope We are seeking a Data Engineer to support our Diversion ...[show_more]
A tech solutions provider in Washington is seeking a Software Engineer to design, develop, and manage application development projects.
The role involves integrating third-party components and parti...[show_more]
Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions.They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver...[show_more]
Senior Blockchain Platform Engineer – Low-Latency Data
Coinbase • Washington, DC, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer
Analytica • Washington, DC, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Data Engineer - Clearance Required
LMI Consulting, LLC • Washington, DC, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Azure Data Protection Engineer | CommVault & DR Specialist
SAIC • Washington, DC, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Software Engineer - Full Stack (Remote)
Donnelley Financial, LLC • Rockville, MD, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI Engineer
Hatch It • Washington, DC, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer
PROVATOHR INC • Crystal City, VA, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Senior Data Engineer - Hybrid (DMV)
Halvik • Arlington, VA, USA
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Data Engineer
ThinkTek LLC • Washington, District of Columbia, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer
Redhorse • Arlington, Virginia, United States, 22201
[job_card.full_time]
[last_updated.last_updated_30]
Full Stack Data Engineer
rockITdata • Arlington, VA, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Platform Engineer
Raft • Arlington, VA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer
CGS • Rockville, Maryland, United States, 20850
[job_card.full_time]
[last_updated.last_updated_30]
Lead Data Engineer - Capital One Software (Remote)
Capital One • Washington, DC, United States
[filters.remote]
[job_card.part_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer
Data Society • DC, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days]
Data Engineer
AITHERAS, LLC • Arlington, VA, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Senior Software Engineer — Data Pipelines & Automation
SiloSmashers • Washington, DC, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior / Staff Software Engineer (Generative AI-Big Data / 10030, 10032)
Extreme Networks • Washington, District of Columbia, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]