Talent.com
Sr Big Data Developer / Lead
Sr Big Data Developer / LeadTSR • Jersey City, NJ
Sr Big Data Developer / Lead

Sr Big Data Developer / Lead

TSR • Jersey City, NJ
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

Summary

  • Markets Data team is building the next generation Data fabric to solve for Business, Analytics and growing regulatory needs. Vast amounts of data assets have been accumulated through the years. Data fabric built on emerging technologies will facilitate the data being inspected, cleansed, transformed for support decision-making.
  • This job involves being part of a dynamic team and contributing towards software development of core components within the next generation Big Data Platform. The ideal candidate will have an eye for building and optimizing data systems and will work closely with our systems architects, data scientists, and analysts to help direct the flow of data within the pipeline and ensure consistency of data delivery and utilization across multiple projects.
  • Candidate has the opportunity to be a major contributor to the Markets Data Strategy and contribute towards the goal of increasing revenue using key metrics for decision making. The candidate will work with bright and innovative individuals both on the business and technology side and the successful candidate can make a significant difference to the business performance.
  • Work with overall analytics team and build regulatory reporting using Java, Apache Spark, Kafka, Hive / Impala, Elastic Search, and related Big Data Technologies.
  • Experience working in Spring Boot, Microservices based architecture framework.
  • Responsible for systems analysis, Design, Coding, Unit Testing and other SDLC activities.
  • Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates.
  • Directly impacts the business by ensuring the quality of work provided by self and others; works closely with other teams as partner.
  • Work proactively, independently and with global teams to address project requirements, and articulate issues / challenges with enough lead time to address project delivery risks.
  • Providing expertise in technical analysis and solving technical issues during project delivery.
  • Code reviews, test case reviews and ensure code developed meets the requirements.
  • Demonstrate ownership and initiative taking.
  • Some support, troubleshooting, bug-fixing of existing and new applications is expected.

Required Skills :

  • Hands on development experience in Java / Spark / SQL
  • Java or Scala
  • Cloudera Hadoop and Spark Development
  • Apache Kafka
  • HBase / Hive / Impala
  • RDBMS experience
  • Service oriented architecture, and data standards like JSON, Avro, Parquet
  • Agile / Scrum methodology experience
  • Experience in SCMs like GIT; and tools like JIRA
  • Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities
  • Strong communication skills, should be able to communicate effectively with business and other stakeholders
  • Demonstrate ownership and initiative taking
  • GemFire is a plus
  • Elastic Search is a plus
  • Streaming experience is a plus
  • Exposure to Cloud Services (AWS, Google Cloud) is a plus
  • Education :

    Graduate degree in Computer Science, Information Systems, or equivalent quantitative field

    [job_alerts.create_a_job]

    Big Data Developer • Jersey City, NJ

    [internal_linking.related_jobs]
    Sr. Data Analyst

    Sr. Data Analyst

    Argonaut Management Services, Inc • New York, NY, United States
    [job_card.full_time]
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Sr. Data Engineer

    Sr. Data Engineer

    Equinox • New York, New York, United States
    [job_card.full_time]
    Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow th...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    January • New York, New York, United States
    [job_card.full_time] +1
    At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Sales Manager (26675)

    Sr. Sales Manager (26675)

    Supermicro • New York, NY, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Data Scientist

    Sr. Data Scientist

    Semgrep • New York, New York, United States
    [job_card.full_time]
    Semgrep is on a mission to make it expensive to exploit software.As the team behind the most popular SAST, we built the Semgrep AppSec Platform to deliver industry-leading code, dependency, and sec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Scientist

    Senior Data Scientist

    Patreon • New York, NY, United States
    [job_card.full_time]
    Patreon is a media and community platform where over 300,000 creators give their biggest fans access to exclusive work and experiences. We offer creators a variety of ways to engage with their commu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Data Scientist

    Lead Data Scientist

    AmTrust Financial • New York, NY, United States
    [job_card.full_time]
    Do you enjoy solving difficult problems? Are you resourceful? Do you enjoy working with data? If so, AmTrust is looking to add a talented experienced Data Scientist to their growing Data Science...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer and BI Developer - Contract to Hire

    Senior Data Engineer and BI Developer - Contract to Hire

    Uszoom • Village of Montebello, New York, United States
    [job_card.full_time]
    Senior Data Engineer and BI Developer - Contract to Hire.Postal1, the leading provider of Digital Mailbox technology worldwide, is looking for an intelligent and ambitious.Senior Data Engineer and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Scientist

    Lead Data Scientist

    AirOps • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    Today thousands of leading brands and agencies use.We’re building the platform and profession that will empower a million marketers to become modern leaders — not spectators — as AI reshapes how br...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior / Lead Data Analyst

    Senior / Lead Data Analyst

    Medal, Highlight, & Ai Research • New York, New York, United States
    [job_card.full_time]
    At Medal, we’re redefining the way gamers connect, share, and relive their greatest in-game moments.Our platform makes it easy to clip, edit, and share gaming content—whether you're capturing a leg...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Marketaxess • New York, New York, United States
    [job_card.full_time]
    MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Analytics

    Lead Data Analytics

    Altice USA • Long Island City, NY, United States
    [job_card.full_time]
    Driven by the power of Optimum, Optimum Media is our innovative multiscreen advertising sales and media consultancy business servicing small to medium business as well as national, political, media...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Yonkers, New York, United States
    [job_card.full_time]
    A company is looking for a Lead Data Engineer to own and develop its data engineering function.Key Responsibilities Design, build, and scale data infrastructure pipelines and warehousing Collabo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Digital Optimization

    Senior Data Engineer, Digital Optimization

    Uja Careers • New York, New York, United States
    [job_card.full_time]
    UJA-Federation of NY is seeking a technical, data-savvy.Senior Data Engineer, Digital Optimization.This is a unique opportunity to shape the future of donor intelligence and use advanced technology...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Product Platform

    Senior Data Engineer, Product Platform

    Match Group • New York, New York, United States
    [job_card.full_time]
    Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Valon Tech • New York, NY, United States
    [job_card.full_time]
    Valon is building the AI-native operating system for regulated finance, starting with mortgage servicing.We're a Series C company backed by a16z, transforming industries that others have written of...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Rain • New York, New York, United States
    [job_card.full_time]
    At Rain, we’re rebuilding the global financial pipes money flows through.Our infrastructure makes stablecoins usable in the real world by powering credit card transactions, cross-border payments, B...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]