Talent.com
Big Data Engineer
Big Data EngineerHAN • Malvern, PA
Big Data Engineer

Big Data Engineer

HAN • Malvern, PA
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description :

  • We are seeking an experienced Machine Learning Engineer to join our AI / ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI / ML solutions, including large language models (LLMs). The ideal candidate will possess a robust background in traditional machine learning, deep learning, and significant experience with large datasets and cloud-based AI services.
  • Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.
  • Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.
  • Collaborate with data science teams to review model-ready datasets and feature documentation, ensuring completeness and accuracy.
  • Perform data discovery and analysis of raw data sources, applying business context to meet model development needs.
  • Comfort with exploratory data exploration and tracking data lineage during inception or root cause analysis.
  • Write and maintain model monitoring scripts, diagnosing issues and coordinating resolutions based on alerts.

Qualifications

  • Around years of relevant work experience.
  • At least years of hands-on experience designing ETL pipelines using AWS services (, Glue, SageMaker).
  • Proficiency in programming languages, particularly Python (including PySpark, PySQL) and familiarity with machine learning libraries and frameworks.
  • Strong understanding of cloud technologies, including AWS and Azure.
  • Experience with API design and development is a plus.
  • Solid understanding of software engineering principles, including design patterns, testing, security, and version control.
  • Familiarity with Feature Store usage, LLMs, GenAI, RAG, Prompt Engineering, and Model Evaluation.
  • [job_alerts.create_a_job]

    Big Data Engineer • Malvern, PA

    [internal_linking.similar_jobs]
    Sr. Biometrics Data Engineer

    Sr. Biometrics Data Engineer

    Syneos Health / inVentiv Health Commercial LLC • Wilmington, Delaware, United States
    [job_card.full_time]
    Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Middleware Staff Engineer

    Middleware Staff Engineer

    TEKsystems • Wilmington, Delaware, United States
    [job_card.full_time]
    The Staff Engineer is a senior individual contributor and technical leader, responsible for leading deep, complex, and / or high-risk technical projects. This role supports the organization by providi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Senior SQL Engineer - AI Trainer

    Remote Senior SQL Engineer - AI Trainer

    SuperAnnotate • Coatesville, Pennsylvania, US
    [filters.remote]
    [job_card.full_time]
    As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...[show_more]
    [last_updated.last_updated_variable_days]
    Data Analyst (REMOTE)

    Data Analyst (REMOTE)

    MBMS Medical Billing and Management Services • Newark, DE, USA
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Growing Medical Billing company looking for a highly motivated, critical thinking individual with effective communication skills. The Data Analyst role is an entry-level position supporting the Clie...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Earn Haus • Limerick, PA, US
    [filters.remote]
    [job_card.full_time] +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Data Governance

    Manager, Data Governance

    AmerisourceBergen Corporation (Cencora) • Wilmington, Delaware, United States
    [job_card.full_time]
    Our team members are at the heart of everything we do.At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Engineer

    Lead Engineer

    Chesapeake Utilities Corporation • Newark, Delaware, United States
    [job_card.full_time]
    Remote Within Service Territory -.DE, PA, OH, GA, NC, VA, MD or FL).The Lead Engineer plays a pivotal role in training and process improvement, developing and leading training programs for the Engi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Investment Analyst - AI Trainer ($50-$60 / hour)

    Remote Investment Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Sanatoga, PA, United States
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Project Engineer

    Project Engineer

    The H&K Group • Douglassville, PA, United States
    [job_card.full_time]
    If you are considering sending an application, make sure to hit the apply button below after reading through the entire description. We are always looking for the best, most qualified people to join...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr IT Operations / Enterprise Data & Analytics - Hybrid

    Sr IT Operations / Enterprise Data & Analytics - Hybrid

    Simple Solutions • Wilmington, DE, us
    [job_card.temporary]
    [filters_job_card.quick_apply]
    Wilmington, DE (Hybrid – Onsite 4 days / week).IT Operations / Enterprise Data & Analytics.SQL Server development, SQL Server administration, ETL using Microsoft Visual Studio, Stored Procedures,...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Engineer

    Senior Engineer

    Constellation Energy • Malvern, PA, United States
    [job_card.full_time]
    As the nation's largest producer of clean, carbon-free energy, Constellation is focused on our purpose : accelerating the transition to a carbon-free future. We have been the leader in clean energy p...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Intern Data Science & Advanced Analytics

    Intern Data Science & Advanced Analytics

    Incyte Corporation • Chadds Ford, Pennsylvania, United States
    [job_card.full_time]
    A global biopharmaceutical company on a mission to Solve On, Incyte follows science to find solutions for patients with unmet medical needs. Through the discovery, development, and commercialization...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Field Engineer I - Eastern Maryland / Delaware

    Field Engineer I - Eastern Maryland / Delaware

    QuidelOrtho • Wilmington, Delaware, United States
    [job_card.full_time]
    QuidelOrtho unites the strengths of Quidel Corporation and Ortho Clinical Diagnostics, creating a world-leading in vitro diagnostics company with award-winning expertise in immunoassay and molecula...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineer (Data / Analytics Engineer)

    Engineer (Data / Analytics Engineer)

    Ansible Government Solutions • Malvern, PA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Overview Ansible Government Solutions, LLC (Ansible) is seeking an experienced Data / Analytics Engineer to support the VHA Veteran Family Member Program (VFMP) Modernization initiative.In this rol...[show_more]
    [last_updated.last_updated_variable_days]
    Shift Leader (P1-1474561-1)

    Shift Leader (P1-1474561-1)

    Panda Restaurant Group • Pottstown, PA, United States
    [job_card.full_time]
    Our Panda Shift Leader associates are important leaders of our team and are responsible for bringing Panda's mission alive in our restaurants by supporting management in creating food with passion,...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineer I

    Engineer I

    Chesapeake Utilities Corporation • Newark, Delaware, United States
    [job_card.full_time]
    Location : Hybrid within Service Territory : OH, PA, DE, MD, VA, NC, SC, GA, FL.Your role in our success will be.The Engineer I oversees the design, development, and management of natural gas pipelin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Akaasa Technologies • Malvern, PA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Ropes Assessment - ASW Glue - Pyspark - Data pipelines - SFTP (Secure File Transfer Protocol Role Summary : The contractor will ...[show_more]
    [last_updated.last_updated_variable_days]
    Technical Business Analyst

    Technical Business Analyst

    Relativity • Wilmington, Delaware, United States
    [job_card.full_time]
    Relativity's Problem Management is seeking a Technical Business Analyst who excels at using data analytics to uncover trends in quality, client workflows, product performance and efficiency.Your in...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]