Talent.com
Remote SME Data Engineer
Remote SME Data EngineerShuvel • Ashburn, VA, United States
Remote SME Data Engineer

Remote SME Data Engineer

Shuvel • Ashburn, VA, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

Job Description :

Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.

Responsibilities include, but are not limited to :

  • Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL / ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
  • Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
  • Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
  • Assist with the implementation of data migration / pipelines from on-prem to cloud / non-relational storage platforms.
  • Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
  • Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
  • Respond to data queries / analysis requests from various groups within an organization. Create and publish regularly scheduled and / or ad hoc reports as needed.
  • Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
  • Implement best practices for data governance, security, and quality supporting the core business applications.
  • Responsible for data engineering source code control using GitLab.

Basic Qualifications :

  • Experience with relational databases and knowledge of query tools and / or BI tools like Power BI or OBIEE and data analysis tools.
  • Extensive experience with SQL and proficiency in writing complex queries.
  • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
  • Strong experience in automating ETL jobs via UNIX / LINUX shell scripts and CRON jobs.
  • Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
  • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
  • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
  • Hands-on-experience with data lake architectures and technologies in a cloud environment.
  • Experience with Atlassian suite of tools such as Jira and Confluence
  • Knowledge of Continuous Integration & Continuous Development tools (CI / CD)
  • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
  • Must work well in a team environment as well as independently.
  • Excellent verbal / written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
  • Preferred Qualifications :

  • 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL / SQL packages to aggregate transactional data for consumption by data science / machine learning applications.
  • 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
  • Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
  • Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL / ELT tools.
  • Experience with Amazon services such as S3, Redshift, EMR and Scala.
  • Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
  • Experience or familiarity with data science / machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
  • Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
  • [job_alerts.create_a_job]

    Data Engineer Remote • Ashburn, VA, United States

    [internal_linking.related_jobs]
    Data Engineer

    Data Engineer

    Crystal Management | CMIT • Vienna, VA, United States
    [job_card.full_time]
    CMiT is seeking an experienced Data Engineer to help lead the analysis, documentation, and migration of a ~2TB Oracle database environment to PostgreSQL. This role involves mapping complex data depe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    BCMC • Dulles, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Government customer on a large mission critical development and sustainment program to design, integrate, build, deliver, and operate a network operations environment including introducing new cybe...[show_more]
    [last_updated.last_updated_30]
    Lead Data Engineer - Capital One Software (Remote)

    Lead Data Engineer - Capital One Software (Remote)

    Capital One • Pimmit Hills, Virginia, United States
    [filters.remote]
    [job_card.full_time] +1
    Lead Data Engineer - Capital One Software (Remote) Capital One Software is seeking a Lead Data Engineer who is passionate about marrying innovation with emerging technologies.In 2022, we publicly a...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Data Engineer

    Senior Data Engineer

    Intellibus • Reston, VA, United States
    [job_card.full_time]
    With your passion and focus we will accomplish great things together!.Our Platform Engineering Team is working to solve the Multiplicity Problem. We are trusted by some of the most reputable and est...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive Inc • Ashburn, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...[show_more]
    [last_updated.last_updated_30]
    Cloud Data Engineer- Databricks

    Cloud Data Engineer- Databricks

    InfoCepts • McLean, VA, United States
    [job_card.full_time]
    We are seeking a highly skilled Cloud Data Engineer with deep expertise in Databricks and modern cloud platforms such as AWS, Azure, or GCP. This role is ideal for professionals who are passionate a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer (Falls Church)

    Data Engineer (Falls Church)

    The Ash Group • Falls Church, VA, US
    [job_card.part_time] +1
    W2 Contract Only No C2C No 3rd Parties • • •.Data Engineer) for our client (.In this role, you'll be designing, implementing, and optimizing large-scale data systems and ETL pipelines, with a stron...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AWS Data Engineer with Sage maker

    AWS Data Engineer with Sage maker

    iSoftTek Solutions Inc • Reston, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Role : AWS Data Engineer with Sage maker.Location : Reston, VA (Day 1 onsite – 5 days in a week).We are seeking a motivated Senior Data Engineer with strong AWS and data platform experience to desig...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer

    Senior Data Engineer

    Forge Group, LLC • Reston, VA, USA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Forge is a global solutions provider.We are a proud, certified 8a, woman-owned, service-disabled, veteran-owned small business (8a, WOSB, SDVOSB). We are known as international problem fixers who on...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Senior Principal Data Engineer - Pipelines & AI

    Remote Senior Principal Data Engineer - Pipelines & AI

    Northrop Grumman • Falls Church, VA, United States
    [filters.remote]
    [job_card.full_time]
    A leading technology firm is looking for a Senior Principal Software Engineer to join their team.This role involves designing and managing data pipelines, implementing CI / CD practices, and resolvin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer.

    Senior Data Engineer.

    Pyramid Consulting, Inc • McLean, VA, United States
    [job_card.temporary]
    Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Navy Federal Credit Union • Vienna, VA, United States
    [job_card.full_time]
    Design, develop, and optimize data pipelines and systems for the collection, connection, and storage of data.Manage, interpret, and derive insights from data. Implement data processing tasks, ensuri...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Cloud Engineer - SME

    Cloud Engineer - SME

    Pendulum LLC • Chantilly, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    JOB DESCRIPTION Clearance Level : .Top Secret / SCI with Full Scope Polygraph Skill Level(s) : Subject Matter Expert • use software such as Jira, Confluence, SharePoint, or similar to create...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    Leidos Inc • Sterling, VA, United States
    [job_card.full_time]
    At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Leidos Inc • Chantilly, VA, United States
    [job_card.full_time]
    Leidos is seeking a Data Analyst for a 200+ FTE technical development program supporting the Sponsor's Entitlement Programs as well as IdAM / ICAM, Authentication, Authorization, Attributes and Digi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Data Infra Engineer - Hybrid & Growth

    Senior AI Data Infra Engineer - Hybrid & Growth

    Adelphi • Mc Lean, VA, US
    [job_card.full_time]
    A cutting-edge tech firm is seeking a Senior / Principal Software Engineer to develop secure data sharing middleware.The role requires expertise in software development and ML Ops.Ideal candidates wi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    SRE - Big Data

    SRE - Big Data

    Verisign • Reston, VA, United States
    [job_card.full_time]
    Verisign helps enable the security, stability, and resiliency of the internet.We are a trusted provider of internet infrastructure services for the networked world and deliver unmatched performance...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Data Infra Engineer — Hybrid & Growth

    Senior AI Data Infra Engineer — Hybrid & Growth

    Adelphi • Mc Lean, Virginia, United States
    [job_card.full_time]
    A cutting-edge tech firm is seeking a Senior / Principal Software Engineer to develop secure data sharing middleware.The role requires expertise in software development and ML Ops.Ideal candidates wi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]