Talent.com
Analyst, Lead Data Engineering
Analyst, Lead Data EngineeringEPCO Corporate • Houston, US
Analyst, Lead Data Engineering

Analyst, Lead Data Engineering

EPCO Corporate • Houston, US
1 day ago
Job type
  • Full-time
Job description

Tap into the professional possibilities of the largest publicly traded energy partnership that features one of the most diversified cash flow streams in the midstream segment of the energy industry. With dynamic career opportunities and a creative and supportive environment, our unique midstream energy organization offers the chance to share and be recognized for your ideas. Join our team and increase your opportunities for success. We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for the midstream oil and gas operations, engineering, and measurements business units. Responsibilities include, but are not limited to :

  • Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse.
  • Design and implement data quality pipelines to ensure data correctness and building trusted datasets.
  • Design and implement a Data Lakehouse solution which accurately reflects business operations.
  • Assist with data platform performance tuning and physical data model support including partitioning and compaction.
  • Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives.
  • Automate and optimize the data lifecycle, find insights from raw data, and applying DevOps principle to data pipelines.
  • Work with business leaders to deliver custom software solutions meeting data needs.
  • Build and support a data platform for data engineering teams to build, deploy and manage applications.

The successful candidate will meet the following qualifications :

  • 5 years of experience as a Data Engineer designing and maintaining data pipeline architectures.
  • 5 years of in-depth programming experience in Python and SQL.
  • 5 years in software development lifecycle experience with software engineering, development, testing, version control, refactoring, and deployment.
  • Experience with common Python Data Engineering packages including pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3.
  • Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake.
  • Experience with data platform architecture responsible for high-level design, strategy and implementation of data infrastructure, including data modelling, designing scalable architectures and ensuring data governance, security and compliance.
  • Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage.
  • Experience with AWS, Snowflake, dbt and Airbyte is preferred.
  • Experience with infrastructure as code, building consistent and repeatable cloud infrastructure.
Create a job alert for this search

Analyst, Lead Data Engineering • Houston, US

Similar jobs

Principal Consultant- Data & Analytics

Turner & TownsendHouston, TX, United States
Full-time

Turner & Townsend is a global professional services company with over 22,000 people in more than 60 countries.Working with our clients across real estate, infrastructure, energy and natural resourc...Show more

 • Promoted

Analyst – Structuring

JLLHouston, TX, PA, United States
Full-time

This job is with JLL, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.JLL empowers you to ...Show more

 • Promoted

Director of Software Engineering - Data and Analytics Services

JPMorgan ChaseHouston, TX, United States
Full-time

If you are a software engineering leader ready to take the reins and drive impact, we've got an opportunity just for you.As a Director of Software Engineering at JPMorganChase within the Corporate ...Show more

 • Promoted

Director, AI-Ready Healthcare Data Integration

Qualified HealthHouston, Texas, United States
Full-time

A health technology company in Houston is seeking a Director of Partner Integration to oversee data relationships with major health systems.This role involves leading a skilled team of Senior Data ...Show more

 • Promoted

Analyst

TradeJobsWorkforce77254 Houston, TX, US
Full-time

ESSENTIAL JOB FUNCTIONS Analyzes global markets for IT Services, servers, storage, backup, IT security, productivity software, remote monitoring services, hyperconvergence and IoT.Studies SMB and m...Show more

 • Promoted

Analyst, Master Data

Venture Global LNGHouston, TX, United States
Full-time

Venture Global LNG ("Venture Global") is a long-term, low-cost provider of American-produced liquefied natural gas, supporting global demand through reliable, capital-efficient infrastructure.Ventu...Show more

 • Promoted

Data Analyst

JobotHouston, TX, United States
Full-time

Step into a high-impact Superintendent role with a leading commercial construction firm where you'll oversee exciting retail and hospitality projects.This Jobot Job is hosted by: Cam Strahm.Are you...Show more

 • Promoted

Lead Data Engineer

The Friedkin GroupHouston, Texas, United States
Full-time

Applicants must be legally authorized to work in the United States at the time of hire and must not require employer sponsorship now or in the future.This position is not eligible for employment vi...Show more

 • Promoted

SAP MDG (Master Data Governance) Lead

TechwaveHouston, TX, United States
Full-time

We have an exciting full-time opportunity for an experienced.SAP MDG (Master Data Governance) Lead.Houston, TX or Raritan, NJ (Hybrid).SAP MDG implementations and governance initiatives.Customer, V...Show more

 • Promoted

Senior Principal Solutions Architect, Data Platform

InvescoHouston, Texas, TX, United States
Full-time +1

This job is with Invesco, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.As one of the wo...Show more

 • Promoted

Sr. Title Analyst

EOG Resources, Inc.Houston, Texas, United States
Full-time

EOG's Land Administration department is seeking an experienced oil and gas title professional to join the team as a Senior Title Analyst (Title Resolution & Owner Communications).This role plays a ...Show more

 • Promoted • New!

Senior Performance Analyst

InvescoHouston, Texas, TX, United States
Full-time +1

This job is with Invesco, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.As one of the wo...Show more

 • Promoted

Director, Data & Analytics Platform Engineering

JPMorgan ChaseHouston, TX, United States
Full-time

A leading financial institution in Houston is seeking a Director of Software Engineering to drive impact across projects and teams.This role requires extensive expertise in software engineering, es...Show more

 • Promoted

Director of Data & Analytics Software Engineering

JPMorgan Chase & Co.Houston, TX, United States
Full-time

A leading financial services firm is seeking a Director of Software Engineering in Houston, Texas.You will lead technical initiatives and drive impactful projects within the Corporate Data and Anal...Show more

 • Promoted

Remote Econometric Data Analyst (Stata SE)

Micro1Pearland, Texas, US
Remote
Full-time

Econometric Data Analyst (Stata SE).AI labs train foundational models and enterprises build AI agents.We provide frontier evaluations and reinforcement learning environments used to improve LLM cap...Show more

 • Promoted

Digital Operations & Dealer Technology Analyst

The Friedkin GroupHouston, Texas, United States
Full-time

All associates are guided by Our Values.Our Values are the unifying foundation of our companies.We strive to ensure that every decision we make and every action we take demonstrates Our Values.We b...Show more

 • Promoted

Director, Loans Lifecycle Platform & Data Engineering

AffirmHouston, TX, United States
Full-time

Affirm is seeking a Director to lead the Loans Lifecycle engineering organization.This role will involve setting a vision for the Loans Platform, overseeing engineering teams, and ensuring complian...Show more

 • Promoted

Upstream Data Analyst

JobotHouston, TX, United States
Full-time

Boutique firm in San Diego and the inland empire servicing business and real estate legal needs! REMOTE!.This Jobot Job is hosted by: Mallory Schreiner.Are you a fit? Easy Apply now by clicking the...Show more