Talent.com
Databricks Data Engineer
Databricks Data EngineerSquare Peg Technologies • Washington, DC, US
[error_messages.no_longer_accepting]
Databricks Data Engineer

Databricks Data Engineer

Square Peg Technologies • Washington, DC, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

Clearance Required :

Position Requires a Top Secret (TS / SCI) Clearance with a Polygraph.

Location : Northern Virginia

The Mission :

Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems.

Don't know Databricks, no problem! Sign up for our extensive training program to be a part of shaping the future of AI / ML

Basic Qualifications :

  • Proficient with one or more programming languages (Python, SQL, Java)
  • Prepare big data, implement data models and develop database to support the business solutions
  • Understanding of SQL database structures and mapping data structures between different SQL databases
  • Knowledge of API development techniques
  • Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
  • Demonstrated experience with cloud based database services such as Databricks and AWS

Preferred Qualifications

  • Experience with using Apache Spark and Hadoop to conduct large-scale data processing
  • Extensive experience in Extract-Transform-Load (ETL) processes
  • Demonstrated extensive experience with cloud services (AWS strongly preferred)
  • Familiarity with open source data engineering tools and processes
  • Square Peg Technologies Company Information

    Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage.

    At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI / ML, as well as best practices in advanced analytics. With a firm footprint in the Intelligence Community, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.

    [job_alerts.create_a_job]

    Data Engineer • Washington, DC, US

    [internal_linking.similar_jobs]
    Senior Databricks Engineer

    Senior Databricks Engineer

    Strategic Technology Partners, LLC • Washington, DC, United States
    [job_card.full_time]
    Career Opportunities with Strategic Technology Partners.An ACTIVE IRS / TREASURY Clearance is required by the government contract. Strategic Technology Partners LLC (www.Senior Databricks Engineer who...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Remote Data Engineer : ETL, AWS & BI Dashboards

    Remote Data Engineer : ETL, AWS & BI Dashboards

    Zyxware Technologies • Washington, DC, United States
    [filters.remote]
    [job_card.full_time]
    A leading tech company is seeking a Data Engineer / ETL Specialist to design and maintain data architecture.The role involves building ETL pipelines using Python in the AWS environment and creating i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Planned Parenthood Federation of America • Washington, DC, US
    [job_card.full_time]
    Planned Parenthood organizations serve all people with care and compassion, with respect, and without judgment, striving to create equitable access to health care. Through health centers, programs i...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Distinguished Data Engineer- Bank Tech

    Distinguished Data Engineer- Bank Tech

    Capital One • Washington, DC, United States
    [job_card.full_time] +1
    Distinguished Data Engineer- Bank Tech Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe dive...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Data Engineer

    Azure Data Engineer

    TechDigital Group • Washington, DC, United States
    [job_card.full_time]
    In-dept knowledge and hands-on experience in Microsoft Azure data stack i.Azure Data Factory, Azure Synapse, Azure SQL Database, etc. Experience of big data approach, architectural concepts, data so...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Databricks Engineer

    Databricks Engineer

    Mfinite Consulting • Adelphi, MD, US
    [job_card.full_time]
    We are hiring a Databricks Engineer to design, build, and operate a scalable Data & AI platform for our client, with a strong foundation in the Medallion Architecture.This role will orchestrate...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    eTelligent Group LLC • Washington, DC, US
    [job_card.full_time]
    Over the past 15 years, eTel has delivered essential solutions for the federal government by securing and managing data, providing scalable identity access, modernizing legacy systems, and building...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Database Engineer

    Database Engineer

    Hatch IT • Washington, DC, US
    [job_card.full_time]
    Expression Networks is seeking an experienced.National Telecommunications and Information Administration (NTIA) under the ISCOM Division. In this role, you will design, implement, secure, and optimi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Distinguished Data Engineer

    Distinguished Data Engineer

    ExecutivePlacements.com • Washington, DC, United States
    [job_card.full_time]
    Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our abilit...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    ThinkTek LLC • Washington, DC, United States
    [job_card.full_time]
    ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Architect : Azure Databricks & Lakehouse Pipelines

    Data Architect : Azure Databricks & Lakehouse Pipelines

    TechDigital Group • Washington, DC, United States
    [job_card.full_time]
    An established industry player is seeking a skilled Data Engineer proficient in Azure Databricks and Pyspark.This role involves designing and implementing complex data pipelines for lakehouse and d...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Intellectt Inc • Washington, DC, United States
    [job_card.full_time]
    Job Title : Senior Data Engineer.Location : "Northern Virginia / Metro Washington, DC" (Locals Only).The Senior Data Engineer will join a newly established Data Services team within a mission-driven n...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Databricks Engineer | Remote with IRS / Treasury Clearance

    Senior Databricks Engineer | Remote with IRS / Treasury Clearance

    Strategic Technology Partners, LLC • Washington, DC, United States
    [filters.remote]
    [job_card.full_time]
    A government contracting firm is seeking a Senior Databricks Engineer to design and support critical infrastructure for a federal agency. The role involves building scalable data solutions in the cl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cloud Data Engineer (AWS / Neptune)

    Cloud Data Engineer (AWS / Neptune)

    Exequt • Washington, DC, US
    [job_card.full_time]
    AWS Neptune and large-scale data platforms.This role will serve as a senior technical contributor, responsible for managing graph database operations, ETL pipelines, infrastructure-as-code, and clo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Multimodal Data Analytics Engineer

    Multimodal Data Analytics Engineer

    The Johns Hopkins University Applied Physics Laboratory • Laurel, MD, United States
    [job_card.temporary]
    Are you curious how the cyber-physical data produced by humans and devices reveal hidden stories about their activity?.Are you excited by the challenge of turning massive, messy, and highly dispara...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer (Databricks / Apache Spark)

    Senior Data Engineer (Databricks / Apache Spark)

    World Services LLC • Washington, DC, US
    [job_card.full_time]
    Senior Data Engineer (Databricks / Apache Spark).Location : Remote / Hybrid (as permitted by contract) must be proximate to Washington DC Metro area (within 60 miles). Experience Level : Senior (8+ ye...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Collibra Engineer / Data Governance

    Collibra Engineer / Data Governance

    Amdex Corporation • Washington, DC, US
    [job_card.full_time]
    JOB NUMBER : 1627 | LOCATION : Washington, DC / Hybrid CLEARANCE / ACCESS LEVEL : DHS Suitability.We are a seasoned Full-spectrum data solutions firm. We deliver insights, strategies, data analytics, and...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer (Azure / Dynamics 365)

    Senior Data Engineer (Azure / Dynamics 365)

    AHU Technologies Inc • Washington, DC, United States
    [job_card.full_time]
    Client is looking for a resource to provide high-level data engineering administration expertise to support Dynamics 365 / Azure data services, including Dataverse management, Azure Data Factory mana...[show_more]
    [last_updated.last_updated_30] • [promoted]