Talent.com
GCP Data Engineer-- KUMDC5641878
GCP Data Engineer-- KUMDC5641878Compunnel Inc. • Columbia, MD, United States
[error_messages.no_longer_accepting]
GCP Data Engineer KUMDC5641878

GCP Data Engineer KUMDC5641878

Compunnel Inc. • Columbia, MD, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Data Engineer

Location : Lisle IL, or Columbia MD

Hybrid (4 days in office)

JOB FUNCTIONS

Responsibilities

  • Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
  • Design, develop, deploy and support high performance data pipelines both inbound and outbound.
  • Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement CI / CD pipelines to ensure continuous deployment and delivery of our data products.
  • Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
  • Document the design and support strategy of the data pipelines
  • Capture, store and socialize data lineage and operational metadata
  • Troubleshoot and resolve data engineering issues as they arise.
  • Develop REST APIs to expose data to other teams within the company.
  • Mentor and guide junior data engineers.

Required for All Jobs

  • Performs other duties as assigned
  • Complies with all policies and standards

    • QUALIFICATIONS

    Education

  • Required - Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Nice to Have - Master’s Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field

    • Work Experience

  • Minimum 6 years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics
  • 2 years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows

    • Knowledge, Skills and Abilities

  • Expert knowledge on SQL and Python programming
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
  • Experience in tuning queries for performance and scalability
  • Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
  • Excellent organizational, prioritization and analytical abilities
  • Have proven experience working in incremental execution through successful launches.
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.
  • Experience working in agile environment.
    • [job_alerts.create_a_job]

    Data Engineer • Columbia, MD, United States

    [internal_linking.similar_jobs]
    Senior Data Engineer

    Senior Data Engineer

    Resonate • Washington, DC, United States
    [job_card.full_time]
    Resonate is a leading provider of high-quality, AI-powered consumer data, intelligence, and technology, empowering marketers to create a more personalized world that increases customer acquisition ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Graph Data Engineer - Active TS / SCI

    Graph Data Engineer - Active TS / SCI

    Maania Consultancy Services • Washington, District of Columbia, United States
    [job_card.full_time]
    The ideal candidate will have a strong background in data engineering, graph querying languages, and data modeling, with a keen interest in leveraging cutting-edge technologies like vector database...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Integrityone Partners • Arlington, Virginia, United States
    [job_card.full_time]
    Location – Hybrid – 1-2 days per week on-site in Crystal City, VA.As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impact our clients' law enf...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer II

    Data Engineer II

    Coreweave • Washington, District of Columbia, United States
    [job_card.full_time] +1
    CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI.Our technology provides enterprises and leading AI labs with the most performant,...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer II

    Data Engineer II

    Agile Defense • Arlington, VA, United States
    [job_card.full_time]
    Agile Defense is seeking a Data Scientist / Engineer to support the design, development, and operational deployment of scalable, AI-enabled data solutions within the Department of Defense’s CDAO AD...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Data Engineer

    Cloud Data Engineer

    Govx • Washington, District of Columbia, United States
    [filters.remote]
    [job_card.full_time]
    The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    (614) Data Engineer III

    (614) Data Engineer III

    Arlo Solutions • Arlington, VA, United States
    [job_card.full_time]
    Arlo Solutions (Arlo) is an information technology consulting services company that specializes in delivering technology solutions. Our reputation reflects the high quality of the talented Arlo Solu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Zone It Solutions • Washington, District of Columbia, United States
    [job_card.full_time] +1
    We are actively looking for Data Engineer for a permanent position.This exciting opportunity is with a well-established global IT service provider known for its excellence in the industry.Designing...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Planned Parenthood Federation Of America • New York, NY / Washington, DC, New York, United States
    [job_card.full_time]
    With more than 600 health centers across the country, Planned Parenthood organizations serve all patients with care and compassion, with respect, and without judgment, striving to create equitable ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    ThinkTek LLC • Washington, District of Columbia, United States
    [job_card.full_time]
    ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Tech Lead, Data Engineer

    Tech Lead, Data Engineer

    Lovelytics • Arlington, VA, United States
    [job_card.full_time]
    Lovelytics is seeking a Data Engineering Technical Lead (Level 4) Consultant with extensive Databricks experience to join our team and help deliver strategic client engagements.As a Tech Lead, you ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Redhorse • Arlington, Virginia, United States, 22201
    [job_card.full_time]
    Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.Were looking for thought...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    Interclypse • North Laurel, Maryland, United States
    [job_card.full_time]
    Welcome to Interclypse, where innovation meets passion.Every team member is a vital piece of our success story.We are not just a company, but a dynamic community driven by the shared vision of rede...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Zantech-it • Washington, DC, United States
    [job_card.full_time]
    Are you looking for your next challenge? Are you ready to work with a performance-based small company? At Zantech, we are a dynamic Woman Owned Small Business focused on providing complex, mission-...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Str • Arlington, VA, United States
    [job_card.full_time]
    STR’s Intelligence division researches and develops advanced analytics and machine learning-based solutions to solve challenging problems related to national security. Our team consists of passionat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer - Infrastructure Cognizance - Fully Cleared

    Data Engineer - Infrastructure Cognizance - Fully Cleared

    Intelliforce-it Solutions Group • North Laurel, Maryland, United States
    [job_card.full_time]
    Make an Impact Where It Matters Most.At Intelliforce, innovation drives mission clarity.Infrastructure Cognizance team.This new, high-priority project brings together multiple data sources to creat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Genesis Consulting Partners • Washington, District of Columbia, United States
    [job_card.full_time]
    Genesis Consulting has an immediate opportunity for an experienced Data Engineer to join our team and support a Federal Agency project centered around Data Management and Analytics.The ideal candid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Ai Squared • Washington, DC, United States
    [job_card.full_time]
    We are looking for a talented Data Engineer to join our growing AI team.As a Data Engineer, you will design and build the data infrastructure and pipelines that power our AI / ML capabilities.Your wo...[show_more]
    [last_updated.last_updated_30] • [promoted]