Talent.com
pinnacle
Senior Data Engineerpinnacle • Arlington, VA, US
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

pinnacle • Arlington, VA, US
30+ days ago
Job type
  • Full-time
Job description

Job Description


Pinnacle Government Solutions is a minority-owned small business that provides Software, AI/ML, and Cloud Engineering Solutions for our Department of Defense, Intelligence Community, and Federal Civilian agencies. We bring SME-level expertise and over five decades of combined industry knowledge and Talent Acquisition experience. We believe in getting it right for our customers and our country.


We are seeking a Data Engineer that will develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Activities include the following tasks: Movement of structure and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions.


Responsibilities:· Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers · Ensure the pedigree and provenance of the data is maintained such that the access to data is protected · Clean and preprocess data to enable access for advanced analytics · Collaborate with enterprise working groups to advance the state of data standards· Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings · Collaborate with software engineers to update, configure, and maintain data services based on the requirements · Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines · Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms,

Required Skills


10+ years' experience with: · Data lifecycle engineering · Development and maintenance of extract, transform and load (ETL) tools and services · Cloud and on-prem data storage and processing solutions · Python, SQL, Spark and other data engineering programming · COTS and open-source data engineering tools such as ElasticSearch and NiFi · Processing data within the Agile Lifecycle,

Desired Skills


· Experience using AI/LLMs to accelerate the processing and transformation of data,

About pinnacle


Pinnacle Government Solutions is a minority-owned small business that provides Software and Cloud Engineering Solutions for our Department of Defense and Federal Civilian agencies. We bring SME-level expertise and over two decades of industry knowledge and experience. We believe in getting it right for our customers and our country.

Create a job alert for this search

Senior Data Engineer • Arlington, VA, US

Similar jobs

Spark Data Engineer (Remote)

Zachary PiperWashington, DC, United States
Remote
Full-time

Zachary Piper Solutions is seeking an Spark Data Engineer (DoD Secret) to support a variety of federal customer.This role focuses on big data engineering, optimization, and performance tuning using... Show more

 • Promoted

Immediate interview for Azure Data Engineer 100% Remote EST Hours

Saxon GlobalWashington, DC, United States
Remote
Full-time

Azure Data Engineer PositionHello, I am Mohammed Dastagir with Saxon Global Inc wanted to let you know about the job opportunity for Azure Data Engineer position if interested please share your upd... Show more

 • Promoted

Senior Database Engineer -- Remote & Public Trust Ready

Syms Strategic Group, LLCBethesda, MD, United States
Remote
Full-time

A leading consulting firm is seeking an experienced Senior Database Engineer to establish standards for database management and to work with clients translating business requirements into logical m... Show more

 • Promoted

Senior Data Engineer (Remote)

ExperianWashington, DC, United States
Remote
Full-time

Senior Data Engineer (Remote) Experian is a global data and technology company, powering opportunities for people and businesses around the world.We help to redefine lending practices, uncover and ... Show more

 • Promoted

Release Engineer (Remote)

Fei.com, Inc.Columbia, MD, United States
Remote
Full-time

Job DescriptionJob DescriptionAt FEI Systems, we create innovative technology solutions to improve the delivery of health and human services because we know when cumbersome administrative processes... Show more

 • Promoted

Senior Data Engineer, Snowflake Expert (Hybrid/Remote)

Blue YonderWashington, DC, United States
Remote
Full-time

A leading supply chain technology firm is seeking a Sr Staff Data Engineer with expertise in Snowflake to join their team.This role involves building data ingestion pipelines and designing scalable... Show more

 • Promoted

Secret-Cleared Data Engineer

PTF Consulting, LLCWashington D.C., District of Columbia, United States
Full-time +1
Quick Apply

Direct Hire |DC Metro Area | Active Secret Clearance Required.PTF Consulting is supporting direct-hire opportunities for.Junior and Senior Data Engineers.In these roles, you will help organize... Show more

Senior Data Center Design Engineer - Remote Fed Projects

Iron MountainWashington, DC, United States
Remote
Full-time

A global leader in storage solutions is looking for a Senior Project Engineer for Data Center Design.This client-facing role involves managing the design process for federal and special projects va... Show more

 • Promoted

Powerbi Developer

TEKsystemsColumbia, MD, US
Full-time

Our healthcare client is looking for a Data Analyst to join there Data Group.For this role, 80% of the time will be dedicated to PowerBI experience.The need for data modeling within Power BI, not j... Show more

 • Promoted

Sr. Data Analyst (Federal Healthcare SME)

Glint Tech Solutions LLCColumbia, Maryland, USA
Full-time
Quick Apply

Job Title: Senior Data Analyst – Healthcare / CMS Stars.Location: Primarily Remote (2–3 onsite visits/month in Columbia, MD).Our client is seeking a Senior Data Analyst to support enterprise analyt... Show more

Lead Software Engineer | Remote

Stellent IT LLCColumbia, MD, United States
Remote
Full-time

Hi, My name is Avnish Rao and I am a Staffing Specialist at Stellent IT LLC.I am reaching out to you on an exciting job opportunity with one of our clients.Lead Software Engineer Location:Hybrid; 1... Show more

 • Promoted

Senior Enterprise Data Architect - Remote

FivetranWashington, DC, United States
Remote
Full-time

A leading data integration company is seeking a Principal Solution Architect to guide strategic customer engagements.This role involves designing complex data integration frameworks and mentoring t... Show more

 • Promoted

Enterprise Data Architect (Hybrid OR Remote- Jersey City, Raleigh, or Hartford)

Arch Capital Group Ltd.Washington, DC, United States
Remote
Full-time

Enterprise Data Architect (Hybrid OR Remote- Jersey City, Raleigh, or Hartford)1 day ago - Be among the first 25 applicants.Base pay range$122,000 / yr - $149,000 / yrWith a company culture rooted ... Show more

 • Promoted

Senior Geospatial Software Engineer (remote)

Element 84Alexandria, VA, United States
Remote
Full-time

Job DescriptionJob DescriptionCompany DescriptionAbout Element 84Element 84 is a woman-owned small business that works with public, private, and non-profit sector clients to develop geospatial data... Show more

 • Promoted

Distinguished Engineer (Remote Eligible)

Capital oneColumbia, MD, United States
Remote
Full-time +1

Director, Technical Program Management - AI / MLAre you interested in leading technical AI and ML programs that deliver on critical business goals and build large scale products & platforms?Abo... Show more

 • Promoted

Director, Senior Price to Win Analyst

Sparksoft CorporationColumbia, MD, United States
Full-time

Director, Senior Price To Win Analyst.Join us at Sparksoft, where we're not just another tech companywe're a catalyst for change.Our mission isn't just to offer IT solutions; it's to revolutionize ... Show more

 • Promoted

Data Engineer (Remote)

Authority BrandsColumbia, MD, United States
Remote
Full-time

Columbia, MD is a leading provider of home services, building brands that support the success of our franchisees, as well as bettering the lives of the homeowners we serve and the people we employ.... Show more

 • Promoted

Bioinformatics Data Engineer Remote with Impact

Ariadne Genomics IncBethesda, MD, United States
Remote
Full-time

An innovative firm is seeking a Data Engineer to join their team in Bethesda, MD, with the flexibility of remote work.This full-time position involves supporting critical data operations for the Na... Show more

 • Promoted

Senior Engineer, Cloud - Azure Architecture - Remote

Utah StaffingWashington, DC, United States
Remote
Full-time

Sr Engineer, CloudThe Sr Engineer, Cloud assists IT colleagues and partners to develop, migrate and deploy key cloud initiatives in a dynamic environment, while also ensuring stability and function... Show more

 • Promoted

DoW CIO Data Analyst

ACES Group LLCAlexandria, Virginia, United States
Full-time
Quick Apply

Top Secret SCI Clearance Required | 5 Yrs | Immediate Start | U.ACES is seeking a highly skilled Qlik Sense Data Analyst to support the DoW CIO at the Mark Center in Alexandria, VA.This positi... Show more