Cloud Data Engineering (Production Support)
St Louis, MO(Hybrid)
Contract
Local consultants will be considerded
Only on w2(USC or GC)
Core Responsibilities
- Production support for Databricks notebooks, Spark streaming apps, and APIs.
- Ownership of Level 1 / Bronze batch ingestion for ~60 data sources.
- Work includes :
- Data ingestion from various relational DBs or AWS → Delta Lake.
- Adding new tables / columns, change management, GDPR / purge processes.
- Product optimization : upgrades, resiliency work, performance improvements.
- Occasional new development for shared-service tools, not business-facing projects.
Required Technical Skills
Python (must have)Spark fundamentals (architecture, DataFrames, Spark SQL)Databricks experienceRelational DB experience (Oracle, SQL Server, Postgres; not a DBA)Understanding of Delta LakeNice-to-Haves :
Spark streamingAPI development experienceAzure experience preferred; AWS acceptableScala not required