Talent.com
Big Data Engineer
Big Data EngineerHAN • Malvern, PA
Big Data Engineer

Big Data Engineer

HAN • Malvern, PA
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description :

  • We are seeking an experienced Machine Learning Engineer to join our AI / ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI / ML solutions, including large language models (LLMs). The ideal candidate will possess a robust background in traditional machine learning, deep learning, and significant experience with large datasets and cloud-based AI services.
  • Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.
  • Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.
  • Collaborate with data science teams to review model-ready datasets and feature documentation, ensuring completeness and accuracy.
  • Perform data discovery and analysis of raw data sources, applying business context to meet model development needs.
  • Comfort with exploratory data exploration and tracking data lineage during inception or root cause analysis.
  • Write and maintain model monitoring scripts, diagnosing issues and coordinating resolutions based on alerts.

Qualifications

  • Around years of relevant work experience.
  • At least years of hands-on experience designing ETL pipelines using AWS services (, Glue, SageMaker).
  • Proficiency in programming languages, particularly Python (including PySpark, PySQL) and familiarity with machine learning libraries and frameworks.
  • Strong understanding of cloud technologies, including AWS and Azure.
  • Experience with API design and development is a plus.
  • Solid understanding of software engineering principles, including design patterns, testing, security, and version control.
  • Familiarity with Feature Store usage, LLMs, GenAI, RAG, Prompt Engineering, and Model Evaluation.
  • [job_alerts.create_a_job]

    Big Data Engineer • Malvern, PA

    [internal_linking.similar_jobs]
    Sr. Biometrics Data Engineer

    Sr. Biometrics Data Engineer

    Syneos Health / inVentiv Health Commercial LLC • Wilmington, Delaware, United States
    [job_card.full_time]
    Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AWS Cloud Engineer

    AWS Cloud Engineer

    Orison Solutions • MALVERN, Pennsylvania, USA
    [job_card.full_time]
    AWS Cloud Engineer location : malvern, PA Candidate should complete a Ropes Assessment.[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Area Supervisor

    Area Supervisor

    Ross Stores, Inc • Exton, PA, United States
    [job_card.full_time]
    Our values start with our people, join a team that values you! Bring your talents to Ross, our leading off-price retail chain with over 2,200 stores, and a strong track record of success and growt...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Scientist, Biological Network Analytics

    Principal Scientist, Biological Network Analytics

    Johnson and Johnson • Spring City, PA, United States
    [job_card.full_time]
    At Johnson & Johnson, we believe health is everything.Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments a...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    SHIFT LEADERS STARTING UP TO $15.00

    SHIFT LEADERS STARTING UP TO $15.00

    Dunkin' • Boyertown, PA, United States
    [job_card.full_time]
    Shift Leaders are responsible for delivering great guest experiences and overall responsibilities and operations of the restaurant. Willing to train the right person.Opportunity for advancement in a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager - Data Management

    Senior Manager - Data Management

    Vanguard Group, Inc. • Malvern, PA, United States
    [job_card.full_time]
    As Senior Manager, Technical Product Manager for Personal Investor, you will own the vision and roadmap for technical data products that power operational efficiency, advanced analytics, and AI-rea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Project Engineer

    Project Engineer

    The H&K Group • Douglassville, PA, United States
    [job_card.full_time]
    If you are considering sending an application, make sure to hit the apply button below after reading through the entire description. We are always looking for the best, most qualified people to join...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Enterprise Data Integration Engineer

    Enterprise Data Integration Engineer

    New York Blood Center • Newark, DE, United States
    [job_card.full_time]
    Enterprise Data Integration Engineer.The Enterprise Data Integration Engineer is responsible for designing, developing, and maintaining data integration solutions across enterprise applications and...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    General Manager

    General Manager

    Flynn Pizza Hut • Royersford, PA, United States
    [job_card.full_time]
    Flynn Hut joined the Pizza Hut system in 2021.In 2023, we expanded internationally acquiring Pizza Hut's master franchisee in Australia with 260+ units. Today we are the largest Pizza Hut franchisee...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Intern Data Science & Advanced Analytics

    Intern Data Science & Advanced Analytics

    Incyte Corporation • Chadds Ford, Pennsylvania, United States
    [job_card.full_time]
    A global biopharmaceutical company on a mission to Solve On, Incyte follows science to find solutions for patients with unmet medical needs. Through the discovery, development, and commercialization...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Engineer (Data / Analytics Engineer)

    Engineer (Data / Analytics Engineer)

    Ansible Government Solutions • Malvern, PA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Overview Ansible Government Solutions, LLC (Ansible) is seeking an experienced Data / Analytics Engineer to support the VHA Veteran Family Member Program (VFMP) Modernization initiative.In this rol...[show_more]
    [last_updated.last_updated_variable_days]
    Shift Leader (P1-1474561-1)

    Shift Leader (P1-1474561-1)

    Panda Restaurant Group • Pottstown, PA, United States
    [job_card.full_time]
    Our Panda Shift Leader associates are important leaders of our team and are responsible for bringing Panda's mission alive in our restaurants by supporting management in creating food with passion,...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Akaasa Technologies • Malvern, PA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Ropes Assessment - ASW Glue - Pyspark - Data pipelines - SFTP (Secure File Transfer Protocol Role Summary : The contractor will ...[show_more]
    [last_updated.last_updated_1_day]
    Principal Clinical Data Manager

    Principal Clinical Data Manager

    Ocugen • Malvern, PA, United States
    [job_card.full_time]
    The Principal Clinical Data Manager provides strategic leadership and oversight of clinical data management activities across multiple programs. This role manages a team of data managers, ensuring h...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    GenAI Architect

    GenAI Architect

    Damco Solutions • Malvern, PA, United States
    [job_card.full_time]
    Location : Malvern, PA (1st week onsite).Solution Architecture : Design and implement scalable GenAI solutions across AWS and Azure environments, ensuring security, compliance, and performance.Cloud ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Billing Specialist

    Billing Specialist

    STV • Douglassville, PA, United States
    [job_card.full_time]
    STV is seeking a Billing Specialist for our Project Accounting group.This position is designated as hybrid (3 days / week in office) and will be located in our Douglassville, PA office.The Billing Sp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Customer Insights Contributor

    Customer Insights Contributor

    Reel Edge • Halfway House, PA, US
    [job_card.full_time] +1
    We are a gambling technology company looking for individuals to join our focus group on an.You will earn $800 to $1,200 for about 20 hours of participation, with opportunities for continued.This is...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Earn Haus • Pottstown, PA, US
    [filters.remote]
    [job_card.full_time] +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]