Talent.com
Databricks Architect
Databricks ArchitectTror AI for everyone • Los Angeles, CA, United States
Databricks Architect

Databricks Architect

Tror AI for everyone • Los Angeles, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Job Title : Databricks Architect

Location : Los Angeles CA (Hybrid)

The Databricks Architect is responsible for designing, implementing, and optimizing scalable data analytics and data engineering solutions on the Databricks Lakehouse Platform. This role requires deep expertise in cloud platforms (Azure / AWS / GCP), distributed data processing, Delta Lake architectures, and modern data engineering practices. The architect will collaborate with cross-functional teams to define data strategies, ensure platform reliability, and enable advanced analytics, ML, and BI use cases.

Key Responsibilities

  • Architecture & Design
  • Design end-to-end Databricks Lakehouse architectures for data ingestion, processing, storage, and consumption.
  • Define and implement Delta Lake patterns, including medallion architecture (Bronze / Silver / Gold).
  • Develop scalable data pipelines using PySpark, Spark SQL, and Databricks workflows.
  • Architect solutions for structured, semi-structured, and unstructured data.
  • Engineering & Implementation
  • Build robust ETL / ELT pipelines with Databricks notebooks, jobs, and workflows.
  • Design and implement high-performance streaming solutions using Structured Streaming.
  • Optimize Spark jobs for cost, performance, and scalability.
  • Implement CI / CD and automation using Databricks Repos, Git, and DevOps pipelines.
  • Cloud & Platform Expertise
  • Architect solutions across Azure / AWS / GCP leveraging native cloud services (e.g., Azure Data Factory, AWS Glue, GCP Dataflow).
  • Ensure security, governance, and compliance through Unity Catalog, RBAC, and encryption.
  • Monitor workloads and optimize cluster configurations for performance and cost.
  • Collaboration & Leadership
  • Work closely with data engineers, data scientists, BI teams, and business stakeholders.
  • Act as a subject matter expert (SME) for Databricks best practices, standards, and patterns.
  • Conduct architectural reviews and guide teams on design decisions.
  • Lead PoCs, evaluate new features, and drive platform adoption.
  • Quality, Governance & Observability
  • Define standards for data quality, lineage, observability, and governance.
  • Implement automated testing frameworks for pipelines and notebooks.
  • Establish performance baselines and monitoring dashboards.

Required Skills & Experience

Technical Skills

  • 7+ years of experience in data engineering / architecture.
  • 3+ years of hands-on experience with Databricks.
  • Strong expertise in Spark, PySpark, SQL, and distributed data processing.
  • Deep understanding of Delta Lake features : ACID transactions, OPTIMIZE, ZORDER, Auto Loader.
  • Experience with workflow orchestration, jobs, and Databricks REST APIs.
  • Hands-on expertise with at least one cloud platform :
  • Azure (preferred) : ADF, ADLS, Key Vault, Event Hub, Azure DevOps
  • AWS : S3, Glue, Lambda, Kinesis
  • GCP : GCS, Dataflow, Pub / Sub
  • Familiarity with CI / CD, Git, DevOps, and Infrastructure-as-Code (Terraform preferred).
  • Soft Skills
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management.
  • Ability to lead design discussions and guide technical teams.
  • Strong documentation and architectural blueprinting skills.

    • Preferred Qualifications

  • Databricks certifications, such as :
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Machine Learning Professional
  • Databricks Lakehouse Fundamentals
  • Experience with MLflow, Feature Store, or MLOps workflows.
  • Experience working in regulated industries (BFSI, healthcare, etc.).
    • [job_alerts.create_a_job]

    Databricks Architect • Los Angeles, CA, United States

    [internal_linking.similar_jobs]
    Architect

    Architect

    Foster + Partners • Los Angeles, CA, United States
    [job_card.full_time]
    We believe the best architecture comes from a synthesis of all the elements that separately comprise and inform the character of a building : the structure that holds it up, the services that allow ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Project Architect

    Project Architect

    Wimberly Allison Tong Goo • Los Angeles, CA, United States
    [job_card.full_time]
    Project Architect / h2pLicensed Architect accountable to the Project Manager and Project Designer for project performance and team communications. The Project Architect is responsible for project deli...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Architect | Aviation

    Architect | Aviation

    Corgan • Culver City, CA, United States
    [job_card.full_time]
    At Corgan we are passionate about great design but the best thing we build is each other.Here, you'll find camaraderie and collaboration as abundantly as curiosity and creativity.Corgan is a welcom...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Project Architect / Designer

    Senior Project Architect / Designer

    PGAL • Los Angeles, CA, United States
    [job_card.full_time]
    PGAL is an international design firm specializing in architecture, interior architecture, engineering and planning for a diverse group of public and private sector clients.Our culture is energetic,...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Architect

    Lead Data Architect

    Capital Group • Los Angeles, California, United States
    [job_card.full_time]
    We want you to feel comfortable doing great work and bringing your best, authentic self to everything you do.We value your talents, traditions, and uniqueness-and we're committed to fostering a str...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Project Architect | Data Centers

    Project Architect | Data Centers

    Corgan • Culver City, CA, United States
    [job_card.full_time]
    At Corgan we are passionate about great design but the best thing we build is each other.Here, you'll find camaraderie and collaboration as abundantly as curiosity and creativity.Corgan is a welcom...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Solutions Architect - Space Computing and Electronics- Remote USA

    Solutions Architect - Space Computing and Electronics- Remote USA

    Curtiss-Wright • Long Beach, CA, United States
    [job_card.full_time]
    Solution Architect Space Systems And Electronics- Remote Usa / h2pWe have a great opportunity for a Solution Architect - Space Systems And Electronics to join our Defense Solutions Division! / ppAs our...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Architect

    Architect

    NAC Architecture • Los Angeles, CA, United States
    [job_card.full_time]
    Architect - Elevate Your Creativity, Shape the Future.Salary : Architect I - $ 80,000 - 93,000, Architect II - $92,000 - 112,000. Are you passionate about pushing the boundaries of architectural desi...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Space Systems Software Architect Digital Twin & Secure Cloud

    Space Systems Software Architect Digital Twin & Secure Cloud

    Modern Technology Solutions Inc • Los Angeles, CA, United States
    [job_card.full_time]
    A national defense technology company seeks a Systems Software Architect in Los Angeles, CA.This full-time position involves designing scalable, secure software architectures for advanced defense c...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Solutions Architect - (Data Engineering)

    Solutions Architect - (Data Engineering)

    CareerBliss • Los Angeles, CA, US
    [job_card.full_time]
    Project Manager (DSA / K-12 Construction) Southern California.This Jobot Job is hosted by : Katie Collins.Are you a fit? Easy Apply now by clicking the "Apply" button and sending us your resume.Salary...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted]
    Data Modernization / Fabric Architect Senior Manager

    Data Modernization / Fabric Architect Senior Manager

    Accenture • Culver City, CA, United States
    [job_card.full_time]
    We are the Accenture Microsoft Business Group (AMBG)-a unified team that brings together Accenture, Avanade, and Microsoft to help organizations transform with the full power of the Microsoft ecosy...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Chief Architect - Full-Stack Weather Platform

    Chief Architect - Full-Stack Weather Platform

    Mantari Industries, Inc. • Long Beach, CA, United States
    [job_card.full_time]
    A technology-focused environmental company in Long Beach, California, is seeking a Head of Software to lead the architecture of an innovative full-stack weather intelligence platform.This role requ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Managed Services - Solution Architect

    Managed Services - Solution Architect

    Los Angeles Staffing • Los Angeles, CA, United States
    [job_card.full_time]
    EY | Building a Better Working World.At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career whereve...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Solutions Architect

    Solutions Architect

    Meta Platforms • Los Angeles, CA, United States
    [job_card.full_time]
    Our team is looking for a high performance Solutions Architect with an entrepreneurial mindset.As a Solutions Architect, you will lead the advertising industry by enabling clients to realize the fu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Intermediate Architect

    Intermediate Architect

    Grimshaw-Architects • Los Angeles, CA, United States
    [job_card.full_time]
    Grimshaw is a global architecture and design studio of ideas and invention, driven by a desire to connect people to each other and the world around us. We recognise the urgency of the challenges tha...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Project Architect

    Project Architect

    NAC Architecture • Los Angeles, CA, United States
    [job_card.full_time]
    Project Architect - Bring Vision to Life, Design with Purpose.Salary : Architect III - $104,000 - $122,300.Must have experience working with LAUSD design standards and DSA plan check requirements an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    MuleSoft Integration Architect - Millennium Space Systems

    MuleSoft Integration Architect - Millennium Space Systems

    Boeing • El Segundo, CA, US
    [job_card.full_time] +1
    At Boeing, we innovate and collaborate to make the world a better place.We’re committed to fostering an environment for every teammate that’s welcoming, respectful and inclusive, with great opportu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Architect

    Architect

    HDR • Los Angeles, CA, United States
    [job_card.full_time] +1
    At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is empowered to bring their authentic selves and n...[show_more]
    [last_updated.last_updated_1_day] • [promoted]