Talent.com
Inherent Technologies
Senior Data EngineerInherent Technologies • San Jose, CA, United States
Senior Data Engineer

Senior Data Engineer

Inherent Technologies • San Jose, CA, United States
1 day ago
Job type
  • Full-time
  • Quick Apply
Job description

Position: Senior Data Engineer

Location: SAN JOSE, CA***Onsite***

Duration: 1 Year

Responsibilities

  • Lead the end-to-end migration (transformation and load) of high-volume, high-complexity data into a new PostgreSQL-based infrastructure
  • Design, build, and maintain robust ETL/ELT pipelines capable of processing millions of records reliably and efficiently
  • Map and reconcile complex legacy data structures across multiple business entities into a unified target schema
  • Define and implement data validation frameworks to ensure integrity, completeness, and accuracy throughout the migration
  • Optimize pipeline performance, including query tuning, indexing strategy, and batch/incremental load design in PostgreSQL
  • Identify, troubleshoot, and resolve data quality issues, schema mismatches, and pipeline failures
  • Document data mappings, transformation logic, and migration runbooks for engineering and business stakeholders
  • Partner with business and technical stakeholders to align migration scope, timelines, and data requirements
  • Establish monitoring, logging, and alerting to track pipeline health and data quality post-migration
  • Mentor junior data engineers and contribute to engineering best practices and standards

Required Qualifications

  • 5+ years of experience in data engineering, with demonstrated ownership of large-scale data migration projects
  • Strong to expert-level proficiency in Python for building and automating data pipelines
  • Deep hands-on experience with PostgreSQL/Oracle , including schema design, query optimization, and performance tuning
  • Proven experience designing and managing ETL/ELT pipelines at scale (millions of records)
  • Experience mapping and transforming complex, legacy data structures across disparate systems or business entities
  • Strong understanding of data validation, reconciliation, and quality assurance techniques
  • Solid grasp of data modeling principles (normalization, indexing, partitioning)
    Experience with version control (Git) and CI/CD practices for data pipelines

Preferred Qualifications

  • Experience with orchestration tools (e.g., Airflow, Dagster, Prefect)
  • Familiarity with cloud data platforms (AWS, GCP, or Azure)
  • Experience with other relational or NoSQL databases and cross-database migrations
  • Background working in regulated or high-stakes data environments (finance, healthcare, etc.)
  • Experience with containerization (Docker) and infrastructure-as-code
  • Exposure to data quality/testing frameworks (e.g., Great Expectations, dbt tests)

What Success Looks Like

  • A fully migrated, validated dataset in PostgreSQL with zero critical data loss or corruption
  • ETL/ELT pipelines that are documented, repeatable, and optimized for ongoing operation
  • A clear audit trail of data lineage and validation results across all business entities involved
Create a job alert for this search

Senior Data Engineer • San Jose, CA, United States

Similar jobs

Data Engineer II

Pinnacle Technical ResourcesSunnyvale, CA, US
$55.00 hourly
Full-time

Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail-oriented Data Engineer II to join our team.The ideal c... Show more

 • Promoted

Data Engineer

SynergisticITFremont, CA, United States
Full-time

Launch Your Data Career with Proof, Not PromisesAt SynergisticitIf you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop gues... Show more

 • Promoted

Data Engineer - Remote

EXPERISSunnyvale, CA, United States
Remote
Full-time

Data EngineerWe're hiring a Data Engineer to design, build, and operate the data pipelines and platform that power analytics and AI / ML use cases.You'll own batch and streaming ingestion, transfor... Show more

 • Promoted

Travel CT Tech - $2975.22 / Week

Medical SolutionsSanta Cruz, CA, US
Full-time

Medical Solutions is seeking an experienced CT Tech for an exciting Travel Allied job in Santa Cruz, CA.Shift: 8 hr PMs Start Date: ASAP Duration: 13 weeks Pay: $2975.A facility in Santa Cruz, CA i... Show more

 • Promoted

Data Engineer

InterSourcesFremont, CA, United States
Full-time

Certified Databricks ConsultantLocation:TX/GA/CADuration:Long-termClient:IBM/AT&TSkills:Need certified Databricks consultant with good experience in Spark and PySpark.Experience with Azure, Pyt... Show more

 • Promoted

Senior Engineer: AI Applications SF, NYC, Remote

SwayablePalo Alto, CA, United States
Remote
Full-time

About SwayableSwayable is a fast-growing cloud data product that doubles the impact of advertising by empirically measuring how it changes people's opinions.Our partners include Amazon, Meta, IBM, ... Show more

 • Promoted

Lead Data Engineer

QcellsSanta Clara, CA, US
Full-time

This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational s... Show more

Remote Senior Data Engineer - AI-Powered Pipelines

Altimate.aiSunnyvale, CA, United States
Remote
Full-time

A leading AI-driven data solutions company in California is seeking a Senior Software Engineer to enhance AI capabilities and build scalable data infrastructures.You will design robust data systems... Show more

 • Promoted

Senior Financial Analyst

Universal AudioScotts Valley, CA, United States
Full-time

Department: Financial Planning and Analysis.Location: Scotts Valley, CA (Hybrid).We are looking for a commercially minded finance professional to serve as the dedicated FP&A partner for our Commerc... Show more

 • Promoted

Data Engineer

ShiftCode AnalyticsSan Ramon, CA, United States
Full-time

Data EngineerLocation:San Ramon, CA (100% Onsite)Duration:6-12 MonthsPositions:2Start Date:1/9/23Job Description:Integrate, extract the data using ETL and inject using AWS, build pipeline from AWS ... Show more

 • Promoted

Staff Software Engineer, Data Frameworks

Ridge Line ServicesSan Ramon, CA, United States
Full-time

Staff Software Engineer, Data FrameworksAre you a seasoned engineer passionate about transforming data into a powerful business asset? Do you thrive in environments where you can lead by example, m... Show more

 • Promoted

Software Principal Engineer- Data Storage

DellCupertino, CA, United States
Full-time

Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world.Working at the cutting edge, we design and develop s... Show more

 • Promoted

Senior Hadoop Architect -- Remote Data Platform Lead

Tredence Inc.San Jose, CA, United States
Remote
Full-time

A consulting firm is seeking a Principal Hadoop Architect to lead the optimization of a large-scale Big Data ecosystem.This role involves defining design standards and ensuring a highly optimized o... Show more

 • Promoted

Senior DevOps Engineer

Scout MotorsFremont, CA, United States
Full-time

Senior DevOps EngineerHere at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history.One that forged the path for future generations of rugged SUVs... Show more

 • Promoted

Data Engineer

Staffing the UniverseSanta Clara, CA, United States
Full-time

Data EngineerLocation:RemoteExperience:4YearsAbout the Role:A Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex ... Show more

 • Promoted

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA, United States
Full-time

Senior Software Engineer - Data InfrastructureApplied Intuition, Inc.Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring... Show more

 • Promoted

Remote Data Engineer

Global Channel ManagementSanta Clara, CA, United States
Remote
Full-time

About the job Remote Data EngineerRemote Data Engineer needs 10 years experienceRemote Data Engineer requires :Must be local top Santa ClaraCloud Platform Expertise (GCP Focus) :Extensive hands-on ... Show more

 • Promoted

Data Engineer (Python, Data Engg, Kafka) | Hybrid

Kaav Inc.Sunnyvale, CA, United States
Full-time

Marketing Technology Team PositionThe Marketing Technology team has the mandate of increasing the rate of customer acquisition, retention, and revenue by optimizing products and inventing new marke... Show more

 • Promoted

Staff Software Engineer, Data (Bay Area / Paris / Remote)

GenesisAISunnyvale, CA, United States
Remote
Full-time

What You'll DoDesign, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scaleOwn core data infrastructure :data ... Show more

 • Promoted

People Operations Lead

Heron PowerScotts Valley, CA, United States
Full-time

Senior People Operations Specialist.Heron Power is a startup building cutting-edge power electronics for the 21st-century grid.We aim to debottleneck the growth of electricity generation and consum... Show more