Foundry Data Engineer

Position : Foundry Data Engineer

Location : Oakland CA(Onsite)

Duration : Fulltime

Job Description

Must Have Technical / Functional Skills

We are seeking a Palantir Foundry Data Engineer to design build and maintain data pipelines and workflows that power advanced analytics and operational insights for the utility industry. This role focuses on leveraging Palantir Foundry to integrate diverse data sources ensure data quality and enable real-time decision-making for grid reliability asset management and regulatory compliance.

Technical Expertise

Hands-on experience with Palantir Foundry development and data integration.

Strong proficiency in Python SQL and Foundry-specific frameworks.

Knowledge of utility data systems (SCADA AMI GIS OMS).

Experience

3 years in data engineering or related roles preferably in utilities or energy sector.

Familiarity with cloud platforms (AWS Azure) and containerization (Docker Kubernetes).

Soft Skills

Strong problem-solving and analytical skills.

Ability to work in cross-functional teams and communicate effectively.

Preferred Qualifications

Experience with real-time data streaming technologies (Kafka Spark).

Knowledge of grid modernization DER integration and renewable forecasting.

Certifications in Palantir Foundry or data engineering.

Roles & Responsibilities

Data Pipeline Development

Build and optimize ETL workflows in Palantir Foundry for ingesting data from SCADA AMI GIS OMS and ERP systems.

Develop scalable pipelines for real-time sensor data and IoT streams.

Implement data transformations and enrichment to support analytics and reporting.

Integration & Automation

Integrate structured and unstructured data sources into Foundry.

Automate data ingestion and validation processes to ensure accuracy and timeliness.

Collaborate with IT and OT teams to bridge operational and enterprise data systems.

Data Quality & Governance

Monitor and maintain data integrity across all pipelines.

Apply data governance standards and ensure compliance with NERC CIP FERC and state regulations.

Implement robust security and access controls within Foundry.

Collaboration & Support

Work closely with data scientists analysts and business teams to deliver reliable datasets for predictive analytics and reporting.

Provide technical support and documentation for Foundry workflows.

Performance Optimization

Optimize workflows for high-volume high-velocity data.

Troubleshoot and resolve pipeline failures and performance bottlenecks.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1