Talent.com
Diverse Agile Solutions
Sr. IT Big Data DeveloperDiverse Agile Solutions • Washington, Dist. of Columbia, United States
Sr. IT Big Data Developer

Sr. IT Big Data Developer

Diverse Agile Solutions • Washington, Dist. of Columbia, United States
8 days ago
Job type
  • Full-time
Job description
TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)

Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required

About Diverse Agile Solutions

Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.

At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.

Position Overview

Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.

The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.

This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.

The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.

Key Responsibilities
  • Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
  • Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
  • Design conceptual, logical, and physical data models.
  • Build highly scalable data processing frameworks capable of supporting large datasets.
  • Develop data integration solutions for structured and unstructured data sources.
  • Optimize database performance across enterprise environments.
  • Design enterprise data lake and data warehouse solutions.
  • Implement Change Data Capture (CDC) methodologies.
  • Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Support migration of data platforms between on-premises and cloud environments.
  • Perform root cause analysis of data quality and business process issues.
  • Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
  • Develop software solutions supporting enterprise data services.
  • Participate in application testing, deployment, and production support.
  • Build and maintain CI/CD pipelines supporting DataOps initiatives.
  • Document architecture, standards, and technical designs.
  • Recommend improvements to enterprise data strategy and governance.
Required Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
  • Advanced experience developing complex SQL solutions.
  • Extensive experience with relational databases including:

    • PostgreSQL
    • Microsoft SQL Server
    • MySQL
  • Advanced programming experience with:

    • Python
    • R
  • Experience designing scalable enterprise data platforms.
  • Experience building automated ETL/ELT pipelines.
  • Experience developing scalable data processing solutions.
  • Experience with GitLab and/or GitHub source control.
  • Experience working in Linux environments.
  • Strong software engineering background including development, testing, and deployment.
  • Excellent written and verbal communication skills.
  • Strong analytical and troubleshooting abilities.
Preferred Qualifications

Experience with one or more of the following technologies is highly desirable:

Data Engineering

  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions

Cloud Platforms

  • Amazon Web Services (AWS)
  • Microsoft Azure
  • Snowflake

Enterprise Data Technologies

  • Enterprise Data Lakes
  • Data Warehouses
  • CDC (Change Data Capture)
  • DataOps
  • CI/CD Pipelines

Big Data

  • Distributed Computing
  • Large Scale Data Processing
  • High-Volume Data Optimization

Additional Technologies

  • NoSQL Databases
  • Graph Databases
  • Machine Learning
  • Java
  • Scala
  • JavaScript
  • Perl

Domain Experience

  • Time Series Data
  • Forecasting Analytics
  • Economic Research
  • Financial Data
  • Research Organizations
Technical Skills

Programming Languages

  • Python
  • R
  • SQL
  • Java (Preferred)
  • Scala (Preferred)
  • JavaScript (Preferred)
  • Perl (Preferred)

Databases

  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • NoSQL
  • Graph Databases

Cloud

  • AWS
  • Microsoft Azure
  • Snowflake

Data Engineering

  • ETL / ELT
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions
  • Data Lakes
  • Data Warehouses
  • Change Data Capture (CDC)
  • DataOps
  • CI/CD

Tools

  • GitLab
  • GitHub
  • Linux
Why Join Diverse Agile Solutions?

At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.

We offer:

  • Challenging, mission-critical projects
  • Collaborative technical teams
  • Opportunities to work with modern cloud and data technologies
  • Professional growth and career development
  • Competitive compensation
Work Location

On-site

Federal Reserve Board
Washington, DC

Equal Opportunity Employer

Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.

BreezyHR Knockout Questions
  1. Are you a U.S. Citizen?
  2. Are you able to work 100% on-site in Washington, DC?
  3. Do you have at least 7 years of experience in Data Engineering or Data Architecture?
  4. How many years of professional Python experience do you have?
  5. How many years of advanced SQL development experience do you have?
  6. Have you designed enterprise ETL/ELT data pipelines?
  7. Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
  8. Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
  9. Have you designed enterprise data warehouse or data lake solutions?
  10. Do you have experience supporting research, economic, or financial data environments?
  11. Have you worked with PostgreSQL, SQL Server, and MySQL?
  12. What is your earliest available start date?
Create a job alert for this search

Sr. IT Big Data Developer • Washington, Dist. of Columbia, United States

Similar jobs

Sr. Director, Data & AI Portfolio Management

DanaherWashington, DC, United States
Full-time

Director, Data & Ai Portfolio Management.Are you ready to accelerate your potential and make a real difference within life sciences, diagnostics and biotechnology? Within Danaher the work our diagn... Show more

 • Promoted

IT Senior Auditor

SikichAlexandria, VA, United States
Full-time +1

IT Senior Auditor (US Alexandria, VA)Sikich is seeking a highly motivated and detail-oriented auditing professional with strong leadership and information technology skills.This role is contingent ... Show more

 • Promoted

Sr. Business Developer

NewGen Technologies Inc.Arlington, VA, United States
Full-time

NewGen Technologies is an IT Services provider with a 25+ year history specializing in Government Contracting.We're seeking a technology-centric Sr.Business Developer that can secure new business a... Show more

 • Promoted

Remote Audit Senior Manager (Digital Assets/Crypto/Exchange/Treasury/Blockchain)

BDOColumbia, MD, United States
Remote
Full-time

The Assurance Senior Manager is responsible for developing suggestions to improve client internal controls and accounting procedures as well as advising the client on various economic and regulator... Show more

 • Promoted

IT Data Specialist II - eDiscovery

CACiWashington, DC, United States
Full-time

Job ID 327305 Job Title:IT Data Specialist II - eDiscovery Job Category:Service Contract Act Time Type:Full time Minimum Clearance Required to Start:DOJ MBI Employee Type:Regular Percentage of Trav... Show more

 • Promoted

IT Supervisory Senior Auditor (Federal Audit)

Sikich LLPAlexandria, VA, United States
Full-time +1

Team members at Sikich have a lot in common while also being part of a rich and varied group of contributors, creating a distinct and thriving culture.Chief among our commonalities is a desire for ... Show more

 • Promoted

Senior Data Engineer, Snowflake Expert (Hybrid/Remote)

Blue YonderWashington, DC, United States
Remote
Full-time

A leading supply chain technology firm is seeking a Sr Staff Data Engineer with expertise in Snowflake to join their team.This role involves building data ingestion pipelines and designing scalable... Show more

 • Promoted

Federal Civilian BD Director-Data Analytics and AI

KBRColumbia, MD, United States
Full-time

Federal Civilian BD Director-Data Analytics and AI.Around here, we define the future.We are a company of innovators, thinkers, creators, explorers, and dreamers.But we all share one goal: to improv... Show more

 • Promoted

IT Systems Audit Manager

AmyxFort Belvoir, VA, United States
Full-time

Amyx is seeking to hire an IT Systems Audit Manager to join our Defense Logistics Agency program remotely.Applies accounting principles and theories to assist management in making informed decision... Show more

 • Promoted

Senior Power BI Developer

DCS CorpAlexandria, VA, US
Full-time

Description: We are looking for an experienced Power BI Developer to join our team.This is a remote-friendly role based in Eastern time zone.The role involves assessing data sources, developing que... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Mount Airy, Maryland
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

IT Project Manager

Nakupuna CompaniesFort Belvoir, VA, United States
Full-time

Nakupuna Consulting is looking for an IT Project Manager to support a DoW Field Activity reporting to OUSW(R&E) at Ft.The following reflects management's definition of essential functions for this ... Show more

 • Promoted

Remote Data Analyst -- TS Cleared for Big Data & Visualization

Elder Research Inc.Arlington, VA, United States
Remote
Full-time

A leading data analytics firm is seeking an experienced Data Analyst to support U.In this role, you will handle data manipulation, infrastructure for data ingestion, and create visualizations.Candi... Show more

 • Promoted

Senior IT Project Manager

AHU Technologies, Inc.Washington, DC, United States
Full-time

Project Manager is responsible for successful delivery of large and complex programs/projects through all phases of the Project Management Lifecycle, which includes initiation, planning, iterative ... Show more

 • Promoted

Data Governance Lead

ProSidian ConsultingAlexandria, VA, United States
Full-time

ProSidian is a Management And Operations Consulting Services firm that focuses on providing value to clients through tailored solutions based on industry-leading practices.ProSidian provides enterp... Show more

 • Promoted

Sr Project Manager IT

American Pharmacists AssociationWashington, DC, United States
Full-time

Senior Project Manager, Information Technology.The American Pharmacists Association is the largest association representing pharmacists in all practice settings in the United States and is the only... Show more

 • Promoted

Manager, Big Data

Beyond SOFWashington, DC, United States
Full-time

The Big Data Manager is responsible for overseeing the development and implementation of big data solutions to support business operations.Main responsibility and duties include overseeing the deve... Show more

 • Promoted

Senior Data Engineer

Blue Orange DigitalWashington, District of Columbia, United States
Full-time

Blue Orange Digital is a boutique data & AI consultancy that delivers enterprise-grade results.We design and build modern data platforms, analytics, and ML/AI Agent solutions for mid‑market and ent... Show more

Remote Federal Data Engineer - NIST Compliant Analytics

PeratonBethesda, MD, United States
Remote
Full-time

A technology services company is looking for a skilled IT Data Engineer to design and maintain secure data solutions compliant with federal standards.The role requires extensive experience in data ... Show more

 • Promoted

Director IT

GO Car WashLaurel, MD, United States
Full-time

GO Car Wash is one of the fastest growing car wash operators in the United States, with locations in multiple states from coast to coast.At GO Car Wash, we're committed to providing an engaging, re... Show more