Job Title: Data Engineer
Job Location: Glendale, CA
Job Type: Full-Time
Job Description:
Databricks experience (primary requirement)
Apache Airflow
Advanced SQL skills
Python
Spark / PySpark
Scala
Experience building and maintaining data pipelines and workflows
Interview Process
Expected to follow the team's recent hiring process for similar data engineering positions.
Typically consists of:
Initial screening/vetting round
Technical interview
Final interview (potentially onsite)
Total process generally spans 2-3 interview rounds.
Key Responsibilities:
Design, write, test, and deploy data pipelines using PySpark, Scala, SQL, Python
Meet with stakeholders to gather requirements and translate them into scalable data platform solutions
Understanding of Databricks platform and developer tooling to diagnose errors, audit platform activity, and automate updates across pipelines, objects, and integrations
Ability to explain Spark architecture and pipeline behavior to stakeholders to diagnose root causes and recommend solutions
Provide solution architecture across AWS, Databricks, Kubernetes, and Airflow (MWAA), including cross-platform integrations
Manage Databricks platform governance, including Unity Catalog, ACLs, lineage, and data discovery and privacy tooling
Build and maintain Kubernetes containers and containerized utilities supporting deployed data platform services
Apply networking knowledge to troubleshoot connectivity and integration errors across platform components
Perform platform administration: provision and remove access, assess resource utilization, monitor platform health and cost, and evaluate stakeholder requests
Collaborate with engineers, architects, and product managers to drive Core Data platform success; participate in agile/scrum ceremonies
Maintain documentation of platform changes, standards, and pipeline configurations to support data quality and governance
Qualifications:
5+ years of data engineering experience developing and operating large-scale data pipelines
Deep hands-on experience with Databricks and Apache Spark (batch and streaming), including pipeline development in PySpark and/or Scala
Strong understanding of Spark architecture-executors, stages, partitioning, shuffle, and performance tuning-with ability to explain tradeoffs to technical and non-technical stakeholders
Proficiency with Databricks platform tooling (API, SDK, CLI) for automation, auditing, governance, and operational troubleshooting
Proficient in SQL with advanced performance tuning capabilities
Hands-on production experience with Airflow (MWAA) for orchestrating data pipelines
Experience managing Databricks platform governance: ACLs, Unity Catalog, lineage, and access provisioning
Proficiency in Python and at least one additional language (Scala, Kotlin, or SQL-driven pipeline tooling)
Experience designing and optimizing scalable ETL/ELT pipelines integrating diverse structured and unstructured data sources
AWS-primary experience (compute, storage, networking, IAM); experience with other cloud providers is transferable
Proficiency with Docker and Kubernetes for building and maintaining containerized data platform services
Working knowledge of networking concepts to diagnose cross-platform integration and connectivity issues
Familiarity with Snowflake and comparable tooling relative to the Databricks ecosystem
Experience designing and implementing CI/CD and DevOps practices (Git-based workflows)
Experience implementing data quality checks, monitoring, and logging for pipeline reliability
Self-starting problem solver with strong analytical and communication skills; willingness to learn new tooling and trends
Familiar with Scrum and Agile methodologies
Experience with Snowflake is a plus
Bachelor's Degree in Computer Science, Information Systems, or a related field, or equivalent work experience, Master's Degree is a plus
Data Engineer • Glendale, CA, United States
Build the Data Backbone That AI Runs On.If you've been learning SQL, dashboards, or basic Python and still feel stuck, you're not imagining itthe hiring market has shifted.Companies don't just want... Show more
My client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harn... Show more
Data Engineer35 years of experience in data engineering.Strong experience with distributed data processing (Spark, AWS Glue, EMR, or equivalent).Hands-on expertise with data modeling, ETL pipelines... Show more
A leading entertainment company is seeking a data architect in Burbank to optimize Snowflake data solutions and integrate HR case management.Candidates should have 5years of experience in data mana... Show more
Synergisticit Career OpportunityAre you passionate about coding or technology and ready to make your mark in tech? For more than 14 years, SynergisticIT has been helping aspiring developers like yo... Show more
SYNERGISTICIT wants every job seeker to be aware that the job market is challenging and to stand out you need to have exceptional skills and technologies which make you stand out from other job see... Show more
Location: Burbank, CA Rate: DOE $/hr.Position Type: Contract Interview Process: Phone Followed by F2F.US Citizen, Green Card and GC EAD.Responsible for the development and maintenance of network co... Show more
Design, implement, and maintain CI/CD pipelines for mobile applications on iOS and Android platforms.Solid technical knowledge about implementing fully automated CI/CD.Solid development skills in a... Show more
Technology is at the heart of Disney's past, present, and future.Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologis... Show more
At Abbott, you can do work that matters, grow, and learn, care for yourself and your family, be your true self, and live a full life.Career development with an international company where you can g... Show more
Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters ... Show more
A leading data platform company in San Francisco is looking for a Software Engineer to design and implement a robust data platform.Your role will directly impact the experiences of millions of user... Show more
On what projects have you designed and developed scalable and reliable backend services, APIs, and microservices using AWS?.Explain your experience designing and managing databases and data storage... Show more
Client with offices in Burbank is seeking a DevOps Engineer for a long term contract (or permanent) position.This team supports all lines of business within the company, and is responsible for tech... Show more
Employment Type: Full-Time, Mid-level.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing soluti... Show more
Oracle Database Engineer - DBA (12c, OEM, EBS).The client builds software and cloud-based technologies used by many of Hollywood's largest film, television, and commercial production companies and ... Show more
This specific role focuses on the technology leadership and management of the build and integration functions of enterprise-wide Messaging and Collaboration services at The Walt Disney Company.Disn... Show more
Civil Engineer Job Duties: Completes construction projects by preparing engineering desi... Show more
Data Engineer/DeveloperDuration:12 months (with possible extension)Location:Los Angeles, CA (REMOTE)Knowledge, Skills, and Abilities:Proficiency in WhereScape RED for data warehouse automation, inc... Show more
Data Scientist Job Duties: Formulates and leads guided, multifaceted analytic studies agains... Show more
