Job title: Python Databricks Developer
Location: Plano, TX (Onsite)
Duration: Months
Minimum years of experience required: - Years
Education Qualification required: BE
Detailed JD Given below:
Role Objective
Python FastAPI & Databricks Developer to design, develop, and maintain scalable data and application solutions. The ideal candidate will have strong expertise in Python, FastAPI, Databricks, PySpark, SQL, and cloud-based data engineering, with experience building data pipelines, REST APIs, and analytics solutions in enterprise environments
Key Responsibilities
· Design and develop scalable REST APIs using Python FastAPI.
· Build and optimize ETL/ELT pipelines using Databricks and PySpark.
· Develop data ingestion, transformation, and processing frameworks for structured and unstructured data.
· Create and maintain Delta Lake architectures following Bronze, Silver, and Gold layer standards.
· Integrate APIs with data platforms including Azure Data Lake, Databricks, Snowflake, SQL databases, and cloud services.
· Implement data quality checks, monitoring, logging, and alerting mechanisms.
· Optimize Spark jobs for performance and cost efficiency.
· Collaborate with data scientists to operationalize ML models and data products.
· Participate in code reviews, testing, CI/CD implementation, and production support.
· Ensure adherence to security, governance, and coding standards
Required Skills & Qualifications
Technical Skills
Strong experience with Python (Advanced),FastAPI, REST API Development, Async Programming (async/await).
Hands-on experience in Databricks, PySpark, Spark SQL, Delta Lake, Data Modeling, ETL/ELT Design.
Knowledge in CI/CD automation, deployment pipelines, and DevOps practices.
Strong Expertise in stakeholder management
Qualifications
years of experience in Python and Databricks Skills.
Python/Databricks certifications are preferred.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and collaboration skills in a global delivery environment.