Talent.com
Inherent Technologies
Senior Data EngineerInherent Technologies • San Jose, CA, United States
Senior Data Engineer

Senior Data Engineer

Inherent Technologies • San Jose, CA, United States
15 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Position: Senior Data Engineer

Location: SAN JOSE, CA***Onsite***

Duration: 1 Year

Responsibilities

  • Lead the end-to-end migration (transformation and load) of high-volume, high-complexity data into a new PostgreSQL-based infrastructure
  • Design, build, and maintain robust ETL/ELT pipelines capable of processing millions of records reliably and efficiently
  • Map and reconcile complex legacy data structures across multiple business entities into a unified target schema
  • Define and implement data validation frameworks to ensure integrity, completeness, and accuracy throughout the migration
  • Optimize pipeline performance, including query tuning, indexing strategy, and batch/incremental load design in PostgreSQL
  • Identify, troubleshoot, and resolve data quality issues, schema mismatches, and pipeline failures
  • Document data mappings, transformation logic, and migration runbooks for engineering and business stakeholders
  • Partner with business and technical stakeholders to align migration scope, timelines, and data requirements
  • Establish monitoring, logging, and alerting to track pipeline health and data quality post-migration
  • Mentor junior data engineers and contribute to engineering best practices and standards

Required Qualifications

  • 5+ years of experience in data engineering, with demonstrated ownership of large-scale data migration projects
  • Strong to expert-level proficiency in Python for building and automating data pipelines
  • Deep hands-on experience with PostgreSQL/Oracle , including schema design, query optimization, and performance tuning
  • Proven experience designing and managing ETL/ELT pipelines at scale (millions of records)
  • Experience mapping and transforming complex, legacy data structures across disparate systems or business entities
  • Strong understanding of data validation, reconciliation, and quality assurance techniques
  • Solid grasp of data modeling principles (normalization, indexing, partitioning)
    Experience with version control (Git) and CI/CD practices for data pipelines

Preferred Qualifications

  • Experience with orchestration tools (e.g., Airflow, Dagster, Prefect)
  • Familiarity with cloud data platforms (AWS, GCP, or Azure)
  • Experience with other relational or NoSQL databases and cross-database migrations
  • Background working in regulated or high-stakes data environments (finance, healthcare, etc.)
  • Experience with containerization (Docker) and infrastructure-as-code
  • Exposure to data quality/testing frameworks (e.g., Great Expectations, dbt tests)

What Success Looks Like

  • A fully migrated, validated dataset in PostgreSQL with zero critical data loss or corruption
  • ETL/ELT pipelines that are documented, repeatable, and optimized for ongoing operation
  • A clear audit trail of data lineage and validation results across all business entities involved
Create a job alert for this search

Senior Data Engineer • San Jose, CA, United States

Similar jobs

Data Engineer II

Pinnacle Technical ResourcesSunnyvale, CA, US
$55.00 hourly
Full-time

Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail-oriented Data Engineer II to join our team.The ideal c... Show more

 • Promoted

Data Engineer

SynergisticITFremont, CA, United States
Full-time

Launch Your Data Career with Proof, Not PromisesAt SynergisticitIf you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop gues... Show more

 • Promoted

Data Engineer - Remote

EXPERISSunnyvale, CA, United States
Remote
Full-time

Data EngineerWe're hiring a Data Engineer to design, build, and operate the data pipelines and platform that power analytics and AI / ML use cases.You'll own batch and streaming ingestion, transfor... Show more

 • Promoted

Data Engineer

InterSourcesFremont, CA, United States
Full-time

Certified Databricks ConsultantLocation:TX/GA/CADuration:Long-termClient:IBM/AT&TSkills:Need certified Databricks consultant with good experience in Spark and PySpark.Experience with Azure, Pyt... Show more

 • Promoted

Senior Engineer: AI Applications SF, NYC, Remote

SwayablePalo Alto, CA, United States
Remote
Full-time

About SwayableSwayable is a fast-growing cloud data product that doubles the impact of advertising by empirically measuring how it changes people's opinions.Our partners include Amazon, Meta, IBM, ... Show more

 • Promoted

Lead Data Engineer

QcellsSanta Clara, CA, US
Full-time

This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational s... Show more

Remote Senior Data Engineer - AI-Powered Pipelines

Altimate.aiSunnyvale, CA, United States
Remote
Full-time

A leading AI-driven data solutions company in California is seeking a Senior Software Engineer to enhance AI capabilities and build scalable data infrastructures.You will design robust data systems... Show more

 • Promoted

Enterprise Solution Architect - Master Data & Governance (Remote / Hybrid - Bay Area Preferred)

Talent ConnectionPleasanton, CA, United States
Remote
Full-time

Job DescriptionJob DescriptionCompany DescriptionEnterprise Solution Architect - Master Data & Governance (Remote / Hybrid - Bay Area Preferred)Our client is a high-growth technology company tr... Show more

 • Promoted

Data Engineer

ShiftCode AnalyticsSan Ramon, CA, United States
Full-time

Data EngineerLocation:San Ramon, CA (100% Onsite)Duration:6-12 MonthsPositions:2Start Date:1/9/23Job Description:Integrate, extract the data using ETL and inject using AWS, build pipeline from AWS ... Show more

 • Promoted

Staff Software Engineer, Data Frameworks

Ridge Line ServicesSan Ramon, CA, United States
Full-time

Staff Software Engineer, Data FrameworksAre you a seasoned engineer passionate about transforming data into a powerful business asset? Do you thrive in environments where you can lead by example, m... Show more

 • Promoted

Data Entry Product Support - No Experience

GLOCPARio del Mar, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Software Principal Engineer- Data Storage

DellCupertino, CA, United States
Full-time

Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world.Working at the cutting edge, we design and develop s... Show more

 • Promoted

Senior Hadoop Architect -- Remote Data Platform Lead

Tredence Inc.San Jose, CA, United States
Remote
Full-time

A consulting firm is seeking a Principal Hadoop Architect to lead the optimization of a large-scale Big Data ecosystem.This role involves defining design standards and ensuring a highly optimized o... Show more

 • Promoted

Senior DevOps Engineer

Scout MotorsFremont, CA, United States
Full-time

Senior DevOps EngineerHere at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history.One that forged the path for future generations of rugged SUVs... Show more

 • Promoted

Data Engineer

Staffing the UniverseSanta Clara, CA, United States
Full-time

Data EngineerLocation:RemoteExperience:4YearsAbout the Role:A Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex ... Show more

 • Promoted

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA, United States
Full-time

Senior Software Engineer - Data InfrastructureApplied Intuition, Inc.Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring... Show more

 • Promoted

Remote Data Engineer

Global Channel ManagementSanta Clara, CA, United States
Remote
Full-time

About the job Remote Data EngineerRemote Data Engineer needs 10 years experienceRemote Data Engineer requires :Must be local top Santa ClaraCloud Platform Expertise (GCP Focus) :Extensive hands-on ... Show more

 • Promoted

Data Engineer (Python, Data Engg, Kafka) | Hybrid

Kaav Inc.Sunnyvale, CA, United States
Full-time

Marketing Technology Team PositionThe Marketing Technology team has the mandate of increasing the rate of customer acquisition, retention, and revenue by optimizing products and inventing new marke... Show more

 • Promoted

Staff Software Engineer, Data (Bay Area / Paris / Remote)

GenesisAISunnyvale, CA, United States
Remote
Full-time

What You'll DoDesign, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scaleOwn core data infrastructure :data ... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Rio del Mar, California
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more