Talent.com
Senior Bigdata Engineer
Senior Bigdata EngineerIris Software Inc. • Whippany, NJ, United States
Senior Bigdata Engineer

Senior Bigdata Engineer

Iris Software Inc. • Whippany, NJ, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

Greetings!

We are looking for a Big Data Engineer to design, build, and maintain scalable data solutions. This role focuses on developing reliable data pipelines and platforms that support analytics, reporting, and data-driven decision making. The ideal candidate has strong hands-on experience with Python and SQL and is comfortable working with large, complex datasets.

Position : Sr. Big Data Engineer

Location : Whippany NJ (Hybrid)

Contract : Long term contract

Client : One of the largest financial clients.

Responsibilities

  • Design, develop, and maintain large-scale data pipelines and data platforms
  • Build efficient ETL and ELT processes using Python and SQL
  • Optimize data models, queries, and workflows for performance and reliability
  • Work with structured and unstructured data from multiple sources
  • Collaborate with data scientists, analysts, and software engineers to support analytics and machine learning use cases
  • Ensure data quality, consistency, and availability across systems
  • Monitor and troubleshoot data pipelines in production environments
  • Document data processes, models, and best practices

Required Qualifications

  • Strong experience in Python for data processing and pipeline development
  • Advanced SQL skills, including query optimization and complex data transformations
  • Experience working with big data technologies such as Spark, Hadoop, or similar frameworks
  • Solid understanding of data modeling, warehousing, and lakehouse concepts
  • Experience with cloud data platforms (AWS, Azure, or Google Cloud)
  • Familiarity with version control systems such as Git

    • Preferred Qualifications

  • Experience with workflow orchestration tools such as Airflow or similar
  • Knowledge of streaming technologies such as Kafka or equivalent
  • Experience with containerization and deployment tools (Docker, Kubernetes)
  • Exposure to data governance, security, and compliance best practices

    • Best Regards,

    [job_alerts.create_a_job]

    Senior Engineer • Whippany, NJ, United States

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Spectraforce Technologies • Newark, NJ, United States
    [job_card.full_time]
    Location : Hybrid - Newark, NJ (2-3 days per week onsite).Duration : 6 months (with possible extension).Prepares data for analytical or operational uses. Builds data pipelines to pull information from...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Data Science 1 of 2

    Director, Data Science 1 of 2

    Novartis Group Companies • East Hanover, NJ, United States
    [job_card.full_time]
    This position will be located at the East Hanover, NJ location and will not have the ability to be located remotely.The Insights and Decision Science (IDS) team is dedicated to enabling improved de...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Big Data Developer (Whippany)

    Big Data Developer (Whippany)

    Iris Software Inc. • Whippany, NJ, US
    [job_card.part_time]
    Our Client one of the leading Bank is looking to hire for the following role.Please share resume if interested.Location - Whippany NJ ( 3 days hybrid). Design, develop, and maintain scalable Big Dat...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    databricks architect

    databricks architect

    E-Solutions • Iselin, NJ, United States
    [job_card.full_time]
    We are seeking highly skilled Databrick Architect with strong expertise in MDM SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optim...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Enterprise Data Architect

    Enterprise Data Architect

    Wakefern Food Corp. • Edison, NJ, US
    [job_card.full_time]
    The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Relativity • Newark, NJ, United States
    [job_card.full_time]
    The Senior Software Engineer - aiR for Review designs, builds, and operates the next generation of generative AI-driven, cloud-native web applications that are transforming our business and industr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Distinguished Data Engineer- Bank Tech

    Distinguished Data Engineer- Bank Tech

    Capital One • Newark, NJ, US
    [job_card.full_time] +1
    Distinguished Data Engineer- Bank Tech.Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe dive...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Data Center Mechanical Engineer

    Senior Data Center Mechanical Engineer

    CoreWeave • Livingston, NJ, US
    [job_card.permanent]
    CoreWeave is The Essential Cloud for AI™.Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Sales Engineer

    Senior Sales Engineer

    LightPath • Parsippany, NJ, United States
    [job_card.full_time]
    Lightpath is one of the largest competitive local exchange carriers in the tri-state area.Weown and operate our infrastructure "from the ground up" by deploying over 20,000 route miles connecting 1...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data & Analytics Architect (Hybrid)

    Data & Analytics Architect (Hybrid)

    Selective Insurance • Millburn, NJ, United States
    [job_card.temporary]
    At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Microsoft Fabric Data Engineer / Architect

    Senior Microsoft Fabric Data Engineer / Architect

    Purple Drive • Newark, NJ, New Jersey, USA
    [job_card.full_time]
    Role Name - Senior Microsoft Fabric Data Engineer / Architect EXPERIENCE_RANGE_IN_REQUIRED_SKILLS_ Azure, Microsoft Fabric, Pyspark, SQL, Data Modelling [show_more]
    [last_updated.last_updated_variable_days]
    Senior BI & Analytics Manager

    Senior BI & Analytics Manager

    Zelis Healthcare, LLC • Morristown, NJ, United States
    [job_card.full_time]
    Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python and lead Data Engineer

    Python and lead Data Engineer

    IT Solutions INC • Woodbridge, NJ, US
    [job_card.full_time]
    Software Engineer 3 Python and Data lead.Location : Woodbridge Township New Jersey-.W2 Candidates (USC,GC,GC EAD,H4 EAD)- with minimum validity of 12 months. Skills : Python, bash , various ETL frame, ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer / Manager (Only W2)

    Data Engineer / Manager (Only W2)

    Nexify Infosystems • Edison, New Jersey, United States
    [job_card.full_time]
    Solution Architect - Data Engineer.Strong client-facing skills, with the ability to lead technical conversations, manage expectations, and handle escalations calmly. Hands-on technologist capable of...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Scientist - AI Engineer

    Data Scientist - AI Engineer

    Dun & Bradstreet • Florham Park, NJ, United States
    [job_card.full_time]
    Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow.Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior SQL Performance Engineer (T-SQL)

    Senior SQL Performance Engineer (T-SQL)

    Beacon Hill • Morristown, NJ, US
    [job_card.full_time]
    Responsible for data performance enhancements to the production server environment.Have an interest in data and business logic. Ability to provide insights into software solutions and identify failu...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Global Data Operations VP : Scale Data, Govern & Automate

    Global Data Operations VP : Scale Data, Govern & Automate

    Dun & Bradstreet • Florham Park, NJ, United States
    [job_card.full_time]
    A leading data analytics company is seeking a Senior Vice President, Global Data Operations.This role is vital for defining and executing the operational strategy across the data lifecycle, ensurin...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Python Data Engineer

    Python Data Engineer

    TEKVANA INC. • Iselin, NJ, US
    [job_card.full_time]
    Job Title : Data Engineer (Python, Spark, Cloud).Location : Iselin NJ or Charlette NC.Work Authorization : US Citizens only. Python and Big Data skills to design, develop, and maintain scalable data pip...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]