A company is looking for a Staff Data Engineer to build and manage the data ecosystem for internal business analytics.
Key Responsibilities
Design and implement the core architecture for the data ecosystem used for business analytics
Build Azure Data Factory pipelines for high-scale data ingestion from various source systems to the Azure data lake
Set technical standards for the Business Operations engineering team, including CI / CD, version control, and data quality testing
Required Qualifications
10+ years of experience in Data Engineering, focusing on cloud infrastructure and high-volume data movement
Deep expertise in architecting the Azure Data Stack (Azure Data Factory, Azure Data Lake Storage, Databricks)
Proven ability to build scalable ELT / ETL pipelines using Azure Data Factory and Databricks
Expert-level proficiency in Python and Apache Spark for distributed data processing
Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a related technical discipline
Staff Data Engineer • Hayward, California, United States