Talent.com
Remote SME Data Engineer
Remote SME Data EngineerShuvel • Ashburn, VA, United States
Remote SME Data Engineer

Remote SME Data Engineer

Shuvel • Ashburn, VA, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

Job Description :

Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.

Responsibilities include, but are not limited to :

  • Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL / ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
  • Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
  • Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
  • Assist with the implementation of data migration / pipelines from on-prem to cloud / non-relational storage platforms.
  • Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
  • Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
  • Respond to data queries / analysis requests from various groups within an organization. Create and publish regularly scheduled and / or ad hoc reports as needed.
  • Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
  • Implement best practices for data governance, security, and quality supporting the core business applications.
  • Responsible for data engineering source code control using GitLab.

Basic Qualifications :

  • Experience with relational databases and knowledge of query tools and / or BI tools like Power BI or OBIEE and data analysis tools.
  • Extensive experience with SQL and proficiency in writing complex queries.
  • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
  • Strong experience in automating ETL jobs via UNIX / LINUX shell scripts and CRON jobs.
  • Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
  • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
  • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
  • Hands-on-experience with data lake architectures and technologies in a cloud environment.
  • Experience with Atlassian suite of tools such as Jira and Confluence
  • Knowledge of Continuous Integration & Continuous Development tools (CI / CD)
  • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
  • Must work well in a team environment as well as independently.
  • Excellent verbal / written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
  • Preferred Qualifications :

  • 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL / SQL packages to aggregate transactional data for consumption by data science / machine learning applications.
  • 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
  • Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
  • Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL / ELT tools.
  • Experience with Amazon services such as S3, Redshift, EMR and Scala.
  • Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
  • Experience or familiarity with data science / machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
  • Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
  • [job_alerts.create_a_job]

    Remote Data Engineer • Ashburn, VA, United States

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Crystal Management | CMIT • Vienna, VA, United States
    [job_card.full_time]
    CMiT is seeking an experienced Data Engineer to help lead the analysis, documentation, and migration of a ~2TB Oracle database environment to PostgreSQL. This role involves mapping complex data depe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Data Engineer

    Remote Data Engineer

    VirtualVocations • Manassas, Virginia, United States
    [filters.remote]
    [job_card.full_time]
    A company is looking for a Remote Data Engineer.Key Responsibilities Build and support enterprise-class database solutions and large-scale ETL / ELT processes Design and implement SaaS software so...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Manassas, Virginia, United States
    [job_card.full_time]
    A company is looking for an AWS Data Engineer to build, optimize, and maintain scalable data pipelines and lakehouse architectures on AWS. Key Responsibilities Design and implement dimensional and...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AWS Data Engineer (McLean)

    AWS Data Engineer (McLean)

    Mindlance • McLean, VA, US
    [job_card.part_time]
    Design, build, and maintain scalable data pipelines using AWS Glue and Databricks.Develop and optimize ETL / ELT processes using PySpark and Python. Collaborate with data scientists, analysts, and sta...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AWS Data Engineer with Sage maker

    AWS Data Engineer with Sage maker

    Isofttek Solutions Inc • Reston, Virginia, United States
    [job_card.full_time]
    Role : AWS Data Engineer with Sage maker.Location : Reston, VA (Day 1 onsite – 5 days in a week).We are seeking a motivated Senior Data Engineer with strong AWS and data platform experience to desig...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer SME

    Data Engineer SME

    AnaVation • Chantilly, VA, US
    [job_card.full_time]
    Be Challenged and Make a Difference.In a world of technology, people make the difference.We believe if we invest in great people, then great things will happen. At AnaVation, we provide unmatched va...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sensitive-Data Engineer

    Sensitive-Data Engineer

    Equilibrium Technologies • Chantilly, Virginia, United States
    [job_card.full_time]
    Active Top Secret / SCI Clearance with Polygraph.Are you passionate about harnessing data to solve some of the nation’s most critical challenges? Do you thrive on innovation, collaboration, and build...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Engineer - SME

    Cloud Engineer - SME

    Pendulum LLC • Chantilly, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    JOB DESCRIPTION Clearance Level : .Top Secret / SCI with Full Scope Polygraph Skill Level(s) : Subject Matter Expert • use software such as Jira, Confluence, SharePoint, or similar to create...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer

    Senior Data Engineer

    M1 Technology • Chantilly, Virginia, United States
    [job_card.full_time]
    This role requires deep expertise in handling both structured and unstructured data, designing scalable data architectures, and developing reliable ETL solutions. The ideal candidate has significant...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer SME

    Data Engineer SME

    The Swift Group • Dranesville, Virginia, United States
    [job_card.full_time]
    Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training. Founded in 2019, Swift supports Civilian, Defense, and Intelligence Communit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Steerbridge • Oakton, Virginia, United States
    [job_card.full_time]
    SteerBridge Strategies is a CVE-Verified Service-Disabled, Veteran-Owned Small Business (SDVOSB) delivering a broad spectrum of professional services to the U. Backed by decades of hands-on experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer (Databricks Pro Certified)

    Senior Data Engineer (Databricks Pro Certified)

    Infinitive • Ashburn, VA, United States
    [job_card.full_time]
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Leidos • Chantilly, Virginia, USA
    [job_card.full_time]
    Leidos is seeking a Data Analyst for a 200 FTE technical development program supporting the Sponsors Entitlement Programs as well as IdAM / ICAM Authentication Authorization Attributes and Digital P...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Tanium • Reston, Virginia, United States
    [job_card.full_time]
    Tanium is expanding rapidly and is seeking a skilled and motivated Data Engineer with a strong focus on data integrations and ETL pipeline development. This role will play a critical part in designi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Forge Group • Reston, Virginia, USA
    [job_card.full_time]
    Forge is a global solutions provider.We are a proud certified 8a woman-owned service-disabled veteran-owned small business (8a WOSB SDVOSB). We are known as international problem fixers who only pur...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote - Data Engineer

    Remote - Data Engineer

    Resource Informatics Group Inc • McLean, VA, US
    [filters.remote]
    [job_card.full_time]
    Data Engineer - Mclean VA + Remote Position.Data Engineer's mission will be to guide this platform’s development so that it becomes the engine of a healthcare-wide transition to valu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Data Engineer

    Remote Data Engineer

    Shuvel • Oakton, Virginia, United States
    [filters.remote]
    [job_card.full_time]
    Required Skills and Experience : .Google Cloud Platform : Experience with GCP services, particularly Cloud Functions, Cloud SQL, BigQuery, and database management. Python Scripting : Capable of automati...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Data Engineer

    Sr. Data Engineer

    Steerbridge • Oakton, Virginia, United States
    [job_card.full_time]
    SteerBridge Strategies is a CVE-Verified Service-Disabled, Veteran-Owned Small Business (SDVOSB) delivering a broad spectrum of professional services to the U. Backed by decades of hands-on experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]