Database Architect - Databricks

Job Summary :

Client is looking for a Database Architect with expert-level Databricks experience to design and deliver scalable, high-performance cloud data platforms. The role involves architecting enterprise data solutions on AWS and supporting analytics, reporting, and data engineering initiatives within the Capital Markets domain.

Key Responsibilities :

• Architect and design cloud-based data platforms using Databricks on AWS
• Build and optimize scalable data architectures (Lakehouse, Delta Lake, Spark)
• Define data models and data integration standards for enterprise analytics
• Provide architectural guidance to data engineering and analytics teams
• Ensure data performance, reliability, security, and governance
• Collaborate with business and technical stakeholders to align data solutions with business goals

Required Skills :

Domain Expertise : Capital Markets :

Soft Skills :

Skill Area

Description

Years Experience

Databricks (Expert)

Lakehouse, Delta Lake, Spark, tuning

Apache Spark (Batch / Streaming)

PySpark / Scala, streaming, optimization

AWS Data Services

S3, IAM, Glue, Lambda, CloudWatch

Data Modeling & SQL

RDBMS, dimensional modeling, tuning

Python / Scala

Data engineering, ETL pipelines

Security & Governance

IAM, encryption, governance controls

Capital Markets Domain

Trading, risk, reference data, regulatory

Performance & Reliability Engineering

Cluster sizing, policies, cost tuning

CI / CD & DevOps

Git, Databricks repos / CLI, Terraform

Stakeholder Leadership

Mentoring, architecture decisions

Brandon Consulting Associates, Inc. is an EQUAL OPPORTUNITY EMPLOYER and has been in business for 29years.