Talent.com
Software/ Data Engineer
Software/ Data EngineerLucas Group • Boca Raton, Florida, USA
Software / Data Engineer

Software / Data Engineer

Lucas Group • Boca Raton, Florida, USA
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

We have partnered with our client in their search for a Software Engineer to support and develop our Databricks-based data platform during the development phase. This role focuses on building, improving, and validating reliability patterns early, rather than production firefighting. The ideal candidate is hands-on with Databricks, PySpark, Python, and has working knowledge of Azure cloud services. This role partners closely with Data Engineering teams to ensure solutions are scalable, efficient, and production-ready.

Responsibilities

  • Develop and support Databricks notebooks, jobs, and workflows
  • Write and optimize PySpark and Python code for data processing
  • Assist in designing scalable and reliable data pipelines
  • Apply Spark best practices (partitioning, caching, joins, file sizing)
  • Work with Delta Lake tables and data models
  • Perform data validation and quality checks during development
  • Support cluster configuration and sizing for development workloads
  • Identify performance bottlenecks early and recommend improvements
  • Collaborate with Data Engineers to prepare solutions for future production rollout
  • Document development standards, patterns, and best practices

Skills Required

Databricks & Spark

  • Hands-on experience with Databricks
  • Strong knowledge of PySpark and Spark fundamentals
  • Experience working with Delta Lake
  • Understanding of Spark execution concepts (jobs, stages, tasks)

    • Programming

  • Strong Python development skills
  • Ability to write clean, modular, and reusable code

    • Cloud & Azure (Preferred)

  • Experience working in Microsoft Azure
  • Familiarity with :
  • Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Blob Storage
  • Basic understanding of cloud resource usage and cost awareness

    • Development Practices

  • Experience using Git and version control
  • Familiarity with Databricks Repos or similar workflows
  • Ability to perform basic testing and validation of data pipelines

    • Nice to Have

  • Experience with Spark SQL
  • Exposure to CI / CD pipelines for data platforms
  • Knowledge of infrastructure as code (Terraform, ARM)
  • Familiarity with Azure Monitor or Log Analytics
  • Interest in transitioning development work toward production reliability

    • Education & Work Experience

  • 3+ years of hands-on experience :
  • Bachelor's degree required, (Masters preferred)

    • Title Software Engineer

    Location Remote est

    Client Industry Legal and Professional

    About Korn Ferry

    [job_alerts.create_a_job]

    Software Data Engineer • Boca Raton, Florida, USA

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    VirtualVocations • Boca Raton, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer to build robust data pipelines for internal business analytics.Key Responsibilities Build and maintain Azure Data Factory pipelines to ingest data from mu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer III

    Data Engineer III

    VirtualVocations • Pompano Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems for data products and solutions. Key Responsibilities Design, develop, and maintain data pi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer II

    Data Engineer II

    VirtualVocations • Pompano Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer II to maintain a scalable healthcare data platform and deliver impactful data solutions. Key Responsibilities Maintain a scalable healthcare data platform ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Boca Raton, Florida, United States
    [job_card.full_time]
    A company is looking for a Cloud Data Engineer to modernize analytics and engineer data pipelines and models.Key Responsibilities Complete analysis, design, and development of BI solutions Colla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Maryland Licensed Data Engineer

    Maryland Licensed Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer to design, build, and maintain data infrastructure for a public health organization. Key Responsibilities Design, implement, and maintain Azure Synapse Ana...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer - Maryland

    Senior Data Engineer - Maryland

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer.Key Responsibilities Design and implement Azure Synapse Analytics solutions and operationalize Medallion Architecture Ingest, integrate, and transform da...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Software Engineer (AI)

    Senior Software Engineer (AI)

    VirtualVocations • Pompano Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Software Engineer / Senior Software Engineer (AI).Key Responsibilities Contribute to the design, development, and delivery of high-quality features Develop and maintai...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer with Databricks Focus

    Data Engineer with Databricks Focus

    VirtualVocations • Pompano Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer with a focus on Databricks.Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks technologies Lead the migration and ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Advanced Data Engineer

    Advanced Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Data Engineer - Advanced.Key Responsibilities Perform analysis, design, and development of business intelligence (BI) solutions Develop database solutions using SSIS, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer, AI Gateway

    Software Engineer, AI Gateway

    VirtualVocations • Boca Raton, Florida, United States
    [job_card.full_time]
    A company is looking for a Software Engineer, AI Gateway.Key Responsibilities Develop and enhance the AI Gateway platform, focusing on unified API endpoints and reliability features Write clean,...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Boca Raton, Florida, United States
    [job_card.full_time]
    A company is looking for a Lead Data Engineer specializing in Databricks Migration.Key Responsibilities Design scalable data architectures and models while ensuring data quality and governance L...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineer

    Software Engineer

    VirtualVocations • Pompano Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Software Engineer.Key Responsibilities Develop features for query engines, index structures, and storage layouts Work across PostgreSQL and Mongo compatible systems C...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Sr Data Engineer specializing in Generative AI.Key Responsibilities Design, build, and maintain scalable data pipelines for data ingestion Research and develop high-pe...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Staff Data Engineer to build and manage the data ecosystem for internal business analytics.Key Responsibilities Design and implement the core architecture for the data ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for an Azure Data Engineer to modernize K-12 education data systems.Key Responsibilities Design, build, and maintain Azure Synapse Analytics pipelines for K-12 education data...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Software Engineer

    AI Software Engineer

    VirtualVocations • Boca Raton, Florida, United States
    [job_card.full_time]
    A company is looking for an AI Software Engineer.Key Responsibilities Develop and implement software solutions supporting RPA, AI, and healthcare automation Write clean, testable, and maintainab...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Nebraska Licensed Cloud Data Engineer

    Nebraska Licensed Cloud Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for a Cloud Data Engineer to support the Data Team at the Department of Health and Human Services (DHHS) for the State of Nebraska. Key Responsibilities Complete analysis, des...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Delray Beach, Florida, United States
    [job_card.full_time]
    A company is looking for an AWS Data Engineer.Key Responsibilities Design and implement dimensional and normalized data models optimized for analytical workloads Build and manage modern data lak...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]