Talent.com
Senior Bigdata Engineer
Senior Bigdata EngineerIris Software Inc. • Whippany, NJ, United States
Senior Bigdata Engineer

Senior Bigdata Engineer

Iris Software Inc. • Whippany, NJ, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

Greetings!

We are looking for a Big Data Engineer to design, build, and maintain scalable data solutions. This role focuses on developing reliable data pipelines and platforms that support analytics, reporting, and data-driven decision making. The ideal candidate has strong hands-on experience with Python and SQL and is comfortable working with large, complex datasets.

Position : Sr. Big Data Engineer

Location : Whippany NJ (Hybrid)

Contract : Long term contract

Client : One of the largest financial clients.

Responsibilities

  • Design, develop, and maintain large-scale data pipelines and data platforms
  • Build efficient ETL and ELT processes using Python and SQL
  • Optimize data models, queries, and workflows for performance and reliability
  • Work with structured and unstructured data from multiple sources
  • Collaborate with data scientists, analysts, and software engineers to support analytics and machine learning use cases
  • Ensure data quality, consistency, and availability across systems
  • Monitor and troubleshoot data pipelines in production environments
  • Document data processes, models, and best practices

Required Qualifications

  • Strong experience in Python for data processing and pipeline development
  • Advanced SQL skills, including query optimization and complex data transformations
  • Experience working with big data technologies such as Spark, Hadoop, or similar frameworks
  • Solid understanding of data modeling, warehousing, and lakehouse concepts
  • Experience with cloud data platforms (AWS, Azure, or Google Cloud)
  • Familiarity with version control systems such as Git

    • Preferred Qualifications

  • Experience with workflow orchestration tools such as Airflow or similar
  • Knowledge of streaming technologies such as Kafka or equivalent
  • Experience with containerization and deployment tools (Docker, Kubernetes)
  • Exposure to data governance, security, and compliance best practices

    • Best Regards,

    [job_alerts.create_a_job]

    Senior Engineer • Whippany, NJ, United States

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Spectraforce Technologies • Newark, NJ, United States
    [job_card.full_time]
    Location : Hybrid - Newark, NJ (2-3 days per week onsite).Duration : 6 months (with possible extension).Prepares data for analytical or operational uses. Builds data pipelines to pull information from...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Big Data Developer (Whippany)

    Big Data Developer (Whippany)

    Iris Software Inc. • Whippany, NJ, US
    [job_card.part_time]
    Our Client one of the leading Bank is looking to hire for the following role.Please share resume if interested.Location - Whippany NJ ( 3 days hybrid). Design, develop, and maintain scalable Big Dat...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Medical Scribe

    Medical Scribe

    Advanced Orthopaedic Associates Of • Wayne, NJ, US
    [job_card.full_time]
    In this role, you will gather and document information about patients for their doctors visits.Responsibilities include printing lab reports, completing summaries of treatment sessions, charting do...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Enterprise Data Architect

    Enterprise Data Architect

    Wakefern Food Corp. • Edison, NJ, US
    [job_card.full_time]
    The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Distinguished Data Engineer- Bank Tech

    Distinguished Data Engineer- Bank Tech

    Capital One • Newark, NJ, US
    [job_card.full_time] +1
    Distinguished Data Engineer- Bank Tech.Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe dive...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Sales Engineer

    Senior Sales Engineer

    LightPath • Parsippany, NJ, United States
    [job_card.full_time]
    Lightpath is one of the largest competitive local exchange carriers in the tri-state area.Weown and operate our infrastructure "from the ground up" by deploying over 20,000 route miles connecting 1...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Center Mechanical Engineer

    Senior Data Center Mechanical Engineer

    CoreWeave • Livingston, NJ, US
    [job_card.permanent]
    CoreWeave is The Essential Cloud for AI™.Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Relativity • Newark, NJ, United States
    [job_card.full_time]
    The Senior Software Engineer - aiR for Review designs, builds, and operates the next generation of generative AI-driven, cloud-native web applications that are transforming our business and industr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data & Analytics Architect (Hybrid)

    Data & Analytics Architect (Hybrid)

    Selective Insurance • Millburn, NJ, United States
    [job_card.temporary]
    At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Microsoft Fabric Data Engineer / Architect

    Senior Microsoft Fabric Data Engineer / Architect

    Purple Drive • Newark, NJ, New Jersey, USA
    [job_card.full_time]
    Role Name - Senior Microsoft Fabric Data Engineer / Architect EXPERIENCE_RANGE_IN_REQUIRED_SKILLS_ Azure, Microsoft Fabric, Pyspark, SQL, Data Modelling [show_more]
    [last_updated.last_updated_variable_days]
    databricks architect

    databricks architect

    E-Solutions • Iselin, New Jersey, United States
    [job_card.full_time]
    We are seeking highly skilled Databrick Architect with strong expertise in MDM SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optim...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior BI & Analytics Manager

    Senior BI & Analytics Manager

    Zelis Healthcare, LLC • Morristown, NJ, United States
    [job_card.full_time]
    Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineer - Data Platforms

    Senior Engineer - Data Platforms

    CoreWeave • Livingston, NJ, US
    [job_card.permanent]
    CoreWeave is The Essential Cloud for AI™.Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer / Manager (Only W2)

    Data Engineer / Manager (Only W2)

    Nexify Infosystems • Edison, New Jersey, United States
    [job_card.full_time]
    Solution Architect - Data Engineer.Strong client-facing skills, with the ability to lead technical conversations, manage expectations, and handle escalations calmly. Hands-on technologist capable of...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Scientist - AI Engineer

    Data Scientist - AI Engineer

    Dun & Bradstreet • Florham Park, NJ, United States
    [job_card.full_time]
    Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow.Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Global Data Operations VP : Scale Data, Govern & Automate

    Global Data Operations VP : Scale Data, Govern & Automate

    Dun & Bradstreet • Florham Park, NJ, United States
    [job_card.full_time]
    A leading data analytics company is seeking a Senior Vice President, Global Data Operations.This role is vital for defining and executing the operational strategy across the data lifecycle, ensurin...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Coordinator

    Data Coordinator

    START Center for Cancer Research • East Brunswick, NJ, US
    [job_card.full_time]
    The START Center for Cancer Research (“START”) is the world’s largest early phase site network, fully dedicated to oncology clinical research. Throughout our history, START has pro...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Data Engineer

    Python Data Engineer

    TEKVANA INC. • Iselin, NJ, US
    [job_card.full_time]
    Job Title : Data Engineer (Python, Spark, Cloud).Location : Iselin NJ or Charlette NC.Work Authorization : US Citizens only. Python and Big Data skills to design, develop, and maintain scalable data pip...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]