Talent.com
Delan Associates, Inc
Databricks DeveloperDelan Associates, Inc • Louisville, Kentucky, United States
Databricks Developer

Databricks Developer

Delan Associates, Inc • Louisville, Kentucky, United States
22 days ago
Job type
  • Full-time
Job description

We are looking for a highly skilled Databricks Developer with expertise in building and managing modern data platforms using the Databricks Lakehouse architecture. The ideal candidate will have strong experience in PySpark, Python, SQL, Delta Lake, data modeling, data quality frameworks, and enterprise-scale data engineering solutions. The role involves designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and AI/ML initiatives.

Key Responsibilities

Design and implement scalable data solutions using Databricks Lakehouse Architecture.

Develop and maintain data pipelines using PySpark, Python, and SQL.

Build and optimize ETL/ELT workflows for batch and near real-time data processing.

Implement Delta Lake features including ACID transactions, time travel, schema evolution, and data versioning.

Design and maintain enterprise data models to support reporting and analytics requirements.

Ensure data quality through validation, monitoring, reconciliation, and governance controls.

Develop and manage data catalogs, metadata management, and data lineage processes.

Collaborate with business stakeholders, architects, and analytics teams to gather and translate requirements into technical solutions.

Optimize Databricks workloads for performance, scalability, and cost efficiency.

Implement security, access controls, and governance best practices within the Databricks ecosystem.

Support troubleshooting, root cause analysis, and production issue resolution.

Contribute to data platform modernization and cloud migration initiatives.

Required Technical Skills

Databricks

Strong experience with Databricks Architecture and platform administration.

Hands-on expertise in Databricks Lakehouse Architecture.

Deep understanding of Delta Lake concepts and implementation.

Experience with Unity Catalog / Data Catalog and metadata management.

Knowledge of Databricks Workflows, Jobs, Clusters, and Performance Tuning.

Data Engineering

Strong proficiency in PySpark for large-scale data processing.

Advanced Python programming skills.

Expert-level SQL development and query optimization.

Experience in building robust ETL/ELT pipelines.

Strong understanding of data modeling techniques including:

Star Schema

Snowflake Schema

Dimensional Modeling

Data Vault (preferred)

Data Governance & Quality

Experience implementing data quality frameworks and validation checks.

Knowledge of data lineage, metadata management, and governance processes.

Experience with data reconciliation, profiling, and monitoring tools.

Cloud & Platform Experience (Preferred)

Azure Databricks

Azure Data Lake Storage (ADLS)

Azure Data Factory

Azure Synapse Analytics

CI/CD pipelines (Azure DevOps, GitHub Actions)

Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.

4-8 years of experience in Data Engineering and Analytics.

Minimum 3+ years of hands-on experience with Databricks and PySpark.

Experience working in Agile development environments.

Create a job alert for this search

Databricks Developer • Louisville, Kentucky, United States

Similar jobs

Azure Developer - Louisville, KY

StaffingLouisville, KY, United States
Full-time

Only USC GC H1B TN EAD (GC L2).Azure certified solution architect to create Azure solutions.Build a workspace to store or pull activity Logs from Azure and on premise data store.Build Power BI repo... Show more

 • Promoted

DELI/ASST DEPT LEADER

KrogerScottsburg, IN, United States
Full-time

Create an outstanding customer experience through exceptional service.Establish and maintain a safe, clean environment that encourages our customers to return.Achieve sales and profit goals establi... Show more

 • Promoted

Site Manager/ Workplace Services

The Millennium GroupShepherdsville, KY, United States
Full-time

Now is a great time to join our growing company! The Millennium Group (TMG) is an award-winning business process outsourcing firm focused on print, mail, document scanning, reception, and related o... Show more

 • Promoted

Postgres SQL/Heroku Developers

ClifyXLouisville, KY, United States
Full-time

URGENT BACKFILL***SO#_38339571 Postgres SQL/Heroku Developers (SFDC projects preferably in HC domain) Backfill opportunity.Please submit Postgres SQL developer for this role if you are interested i... Show more

 • Promoted

Data Engineer

Staffing the UniverseLouisville, KY, United States
Full-time

Data ArchitectLocation:Louisville Onsite RequiredSkills:Bachelor's or Master's degree in Computer Science, Information Systems, or related field.Proven experience as a Data Architect, Data Engineer... Show more

 • Promoted

General Manager (01366) - 544 Conestoga Pkwy #15

Domino's PizzaShepherdsville, KY, United States
Full-time

Shepherdsville, Kentucky, DTID Kentucky, LLC.General Manager- Our General Managers earned 85K on average last year!.Are you ready to be part of the action and a key person in a successful operation... Show more

 • Promoted

Project Administrator I

UniTek Global ServicesShepherdsville, KY, United States
Full-time

UniTek Global Services is seeking a detail-oriented and experienced Project Administrator I to support our administrative and project operations in our Hutchins Telecom Division located in Shepherd... Show more

 • Promoted

Mobile Medical Assistant

360careScottsburg, IN, United States
Full-time

Assist physicians at assigned long term care facilities with audiology, optometry, podiatry care, and behavioral health.Main duties include maintaining clinical records and charts through electroni... Show more

 • Promoted

Azure Databricks Developer

Syntricate TechnologiesLouisville, KY, United States
Full-time

Experience in building and optimizing complex data pipelines in Azure.Hand on experience on Azure Databricks.Strong working knowledge on Azure components and services such as Storage Account, Azure... Show more

 • Promoted

Survey Taker: Earn up to $25 per survey (Remote)

Earn HausShepherdsville, KY, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Director of Estimating

FORTNAMount Washington, KY, United States
Full-time

Fortna partners with the world's leading brands to transform omnichannel and parcel distribution operations.Known world-wide for enabling companies to keep pace with digital disruption and growth o... Show more

 • Promoted

Azure Developer/ Architect- Louisville, KY

StaffingLouisville, KY, United States
Full-time

Microsoft Certified Azure Developer.Sound experience with cloud implementations.Hands on Experience on development using:.Excellent Communication Skills. Show more

 • Promoted

Surrogates Start at $55K–$75K+ Plus $1,200 Bonus and $11K Pre-Pregnancy Payout

Physician's SurrogacyShepherdsville, KY, US
Full-time +2

Surrogacy Opportunity Starts at 60K-75K+ with a $1,250 Pre-Screening Bonus.Your surrogacy journey could help build the family someone's been dreaming of and whether you're a stay-at-home mom or w... Show more

 • Promoted

Information Technology Professional

US NavyShepherdsville, KY, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

SQL Developer

Syntricate TechnologiesLouisville, KY, United States
Full-time

Louisville, KY onsite Contract.SQL developers are responsible for the design, creation, and maintenance of SQL databases.Their responsibilities include:.Database design: Designing database tables, ... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiMount Washington, KY, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Data Processing Assistant

TradeJobsWorkforceAustin, IN, United States
Full-time

As a Data Processing Assistant, you will be responsible for inputting and maintaining accurate data records, including: input data accurately into company systems.Duties and responsibilities can ch... Show more

 • Promoted

Machine Operator - Day Shift 7am - 7pm

GenpakScottsburg, IN, United States
Full-time

Ability to operate on any one of the six Thermoformers generally unassisted.Able to communicate quality issues, complete required documentation, i.Report machine malfunctions and ensure good qualit... Show more

 • Promoted

Machine Operator

Multi-Color CorporationScottsburg, IN, United States
Full-time

Machine Operators And Printing Assistants/Support.As the global leader of premium labels, MCC helps brands stand out in competitive markets and inspire positive consumer experiences.Backed by over ... Show more

 • Promoted

Area Manager (District Manager)

Pizza HutScottsburg, IN, United States
Full-time

Area Manager (District Manager).S Lake Road, Scottsburg, IN ID#43a64da4-9e5d-4c6c-a88b-abf400f33cf1.That's why people come to Pizza Hut.It's the calling of our Area Managers to make them feel like ... Show more