Talent.com
Experienced Databricks Database Engineer
Experienced Databricks Database EngineerBerkshire Hathaway Specialty Insurance • Boston, MA
Experienced Databricks Database Engineer

Experienced Databricks Database Engineer

Berkshire Hathaway Specialty Insurance • Boston, MA
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Opportunity :

BHSI has an exciting opportunity for an experienced Databricks Database Engineer to join their Boston based Technology team. This position will spearhead our data engineering initiatives, focusing on designing, building, and optimizing scalable data solutions using Databricks. The ability to work both independently and within a dynamic team environment is crucial. You will mentor a team of data engineers, collaborate with cross-functional stakeholders, and define best practices to unlock the full potential of our data.

Duties & Responsibilities :

  • Mentor a team of data engineers in implementing Databricks-based solutions.
  • Define and drive the data engineering strategy, ensuring alignment with business goals.
  • Design and develop scalable data pipelines and ETL processes using Databricks.
  • Optimize and tune Spark jobs for performance and efficiency.
  • Recommend best practices for Databricks cluster management and data security.
  • Build and maintain robust data models to support analytics and reporting needs.
  • Integrate Databricks with various data sources (cloud storage, databases, APIs).
  • Implement Delta Lake for reliable, scalable, and performant data lakes.
  • Work closely with data analysts and stakeholders to deliver actionable insights.
  • Act as the technical liaison between the data engineering team and other stakeholders.
  • Stay updated on the latest Databricks and Azure features to drive continuous improvements.
  • Automate repetitive processes and streamline data workflows.

Qualifications, Skills and Experience :

  • Minimum 5 years’ industry experience.
  • Proven experience (3+ years) in data engineering on Databricks, including Spark, and Delta Lake.
  • Proficiency in Python, SQL, in a Microsoft Azure Environment.
  • Hands-on experience with data lakes, data warehouses, and big data technologies.
  • Excellent problem-solving and communication skills with the ability to interface with teammates at all levels.
  • Ability to estimate work and strive to meet agreed timelines.
  • Aptitude for working both individually and as part of a team.
  • Prior insurance industry experience is a strong plus.
  • BHSI Offers :

  • A competitive package and exciting growth opportunities for career-oriented teammates.
  • A dynamic, action oriented, and thoughtful environment centered on always doing the right thing for our customers, teammates, and our other stakeholders.
  • A purposely non-bureaucratic organization that embraces simplicity over complexity and emphasizes individual excellence in a team framework.
  • Benefits that support your life and well-being, which include :
  • Comprehensive Health, Dental and Vision benefits.

    Disability Insurance (both short-term and long-term).

    Life Insurance (for you and your family).

    Accidental Death & Dismemberment Insurance (for you and your family).

    Flexible Spending Accounts.

    Health Reimbursement Account.

    Employee Assistance Program.

    Retirement Savings 401(k) Plan with Company Match.

    Generous holiday and Paid Time Off.

    Tuition Reimbursement.

    Paid Parental Leave.

    The base salary range for this position in Boston, MA is $125,000 – $155,000, along with annual bonus eligibility. Total compensation for a candidate is determined by their relevant skills, location, and experience. We value our teammates – both their capabilities and character – as demonstrated by our amazing culture.

    [job_alerts.create_a_job]

    Experienced Databricks Database Engineer • Boston, MA

    [internal_linking.similar_jobs]
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    Skilzmatrix • Quincy, MA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Only qualified Cloud Data Engineer candidates located in the Quincy, MA area will be considered due to the position requiring an on-site presence • • •< / b&...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Enterprise Data Architect – Hybrid / Remote

    Senior Enterprise Data Architect – Hybrid / Remote

    Constant Contact • Boston, MA, United States
    [filters.remote]
    [job_card.full_time]
    A leading digital marketing solutions provider is seeking an experienced Enterprise Data Architect to lead the design and implementation of a global data platform. This strategic role requires a dee...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Databricks Lead / Architect

    Sr. Databricks Lead / Architect

    OmegaHires • Boston, MA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Databricks Lead / Architect Location : .Boston, MA (5 days onsite) Duration : 12 Months Note : Need some local to Boston area. Key Responsibilities Customer & Stakeholder Engagement Act as the&...[show_more]
    [last_updated.last_updated_variable_days]
    Lead Data Engineer

    Lead Data Engineer

    Ness Digital Engineering • Boston, MA, US
    [job_card.full_time]
    Job Title : Lead Data Engineer / Data Architect.New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week). We are seeking an experienced Lead Data Engineer / Data Architect to spearhe...[show_more]
    [last_updated.last_updated_variable_days]
    Principal Database Engineer (Local Only)

    Principal Database Engineer (Local Only)

    Compunnel Inc. • Boston, MA, United States
    [job_card.full_time]
    Get notified about new Oracle Database Consultant jobs in.Oracle Database Consultant Jobs in United States.Senior DBA / Database Architect (North Carolina). Senior Oracle / PGSQL Database Admin and Au...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Database Engineer

    Senior Database Engineer

    Knack Solutions • Boston, MA, United States
    [job_card.full_time]
    Hybrid - 3 times / month onsite; Any of the offices in : .We areseeking a Senior Database Engineer to assist in implementing software enhancements and providing technical leadership for the team primar...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    VIA • Somerville, MA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    VIA is making an impact, and so can you.At VIA, our mission is to make communities cleaner, safer, and more equitable.We believe that by working across organizational boundaries, we can achieve gre...[show_more]
    [last_updated.last_updated_variable_days]
    Principal Database Engineer

    Principal Database Engineer

    Pyramid Consulting, Inc • Boston, MA, United States
    [job_card.temporary]
    Pyramid Consulting, Inc provided pay range.This range is provided by Pyramid Consulting, Inc.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Bos...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Snowflake & Epic Data Architect — Integration Lead

    Snowflake & Epic Data Architect — Integration Lead

    Compunnel, Inc. • Boston, MA, United States
    [job_card.full_time]
    A data solutions company in Boston is seeking a Data Architect with expertise in Snowflake and DBT.The role involves leading architectural design for data solutions, optimizing data models, and sup...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Oracle Autonomous Database Engineer

    Oracle Autonomous Database Engineer

    Bright Vision Technologies • Boston, MA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Oracle Autonomous Database Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimi...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Backend Engineer, Orders Core (Remote)

    Senior Backend Engineer, Orders Core (Remote)

    ezCater • Boston, MA, United States
    [filters.remote]
    [job_card.full_time]
    A leading food technology company in Boston is looking for a Senior Software Engineer for Orders Core Services.The role can be performed remotely and involves building scalable systems and improvin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Azure Data Architect

    Azure Data Architect

    Trinity Technology Solutions LLC • Boston, MA, United States
    [job_card.full_time] +1
    Technical Recruiter at Trinity IT Solution.In this role, you will be the Lead on designing, implementing, and managing data architecture and cloud-based solutions with Microsoft Azure.Developing an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Data Acquisition

    Senior Software Engineer - Data Acquisition

    WEX, Inc. • Boston, MA, United States
    [job_card.full_time]
    WEX's Data-as-a-Service (DaaS) platform – responsible for ingesting, validating, and orchestrating raw data from dozens of internal systems and third‑party providers. You will work across multiple d...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Governance Engineer - AI-Driven Cloud & Big Data

    Senior Data Governance Engineer - AI-Driven Cloud & Big Data

    CFA Institute • Boston, MA, United States
    [job_card.full_time]
    A global investment management organization is seeking a Senior Software Engineer to enhance and support Data Governance applications. This role involves managing technical architecture and collabor...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Biometrics Data Engineer

    Sr. Biometrics Data Engineer

    Syneos Health / inVentiv Health Commercial LLC • Boston, Massachusetts, United States
    [job_card.full_time]
    Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer - Data Modeling

    Senior Software Engineer - Data Modeling

    Arrowstreet Capital, Limited Partnership • Boston, MA, United States
    [job_card.full_time]
    Senior Software Engineer - Data Modeling.The Senior Software Engineer - Data Modeling will work within Research Systems as part of the Data Models, Forecast Platform team, focusing on the implement...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Akraya Inc • North Reading, Massachusetts, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Primary Skills : SQL (Expert), Data Modelling (Proficient), ETL (Expert), Python (Intermediate), AWS (Basic).Duration : 6 Months with possible extension. Location : North Reading, MA (Local candidates ...[show_more]
    [last_updated.last_updated_30]
    Senior AI & Analytics Data Engineer

    Senior AI & Analytics Data Engineer

    Klaviyo Inc. • Boston, MA, United States
    [job_card.full_time]
    A leading technology company in Boston is seeking a Senior Software Engineer for its AI & Analytics Data Enablement team. In this role, you will design scalable data pipelines, lead engineering proj...[show_more]
    [last_updated.last_updated_30] • [promoted]