Markets Data team is building the next generation Data fabric to solve for Business, Analytics and growing regulatory needs. Vast amounts of data assets have been accumulated through the years. Data fabric built on emerging technologies will facilitate the data being inspected, cleansed, transformed for support decision-making.
This job involves being part of a dynamic team and contributing towards software development of core components within the next generation Big Data Platform. The ideal candidate will have an eye for building and optimizing data systems and will work closely with our systems architects, data scientists, and analysts to help direct the flow of data within the pipeline and ensure consistency of data delivery and utilization across multiple projects.
Candidate has the opportunity to be a major contributor to the Markets Data Strategy and contribute towards the goal of increasing revenue using key metrics for decision making. The candidate will work with bright and innovative individuals both on the business and technology side and the successful candidate can make a significant difference to the business performance.
Work with overall analytics team and build regulatory reporting using Java, Apache Spark, Kafka, Hive / Impala, Elastic Search, and related Big Data Technologies.
Experience working in Spring Boot, Microservices based architecture framework.
Responsible for systems analysis, Design, Coding, Unit Testing and other SDLC activities.
Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates.
Directly impacts the business by ensuring the quality of work provided by self and others; works closely with other teams as partner.
Work proactively, independently and with global teams to address project requirements, and articulate issues / challenges with enough lead time to address project delivery risks.
Providing expertise in technical analysis and solving technical issues during project delivery.
Code reviews, test case reviews and ensure code developed meets the requirements.
Demonstrate ownership and initiative taking.
Some support, troubleshooting, bug-fixing of existing and new applications is expected.
Required Skills :
Hands on development experience in Java / Spark / SQL
Java or Scala
Cloudera Hadoop and Spark Development
Apache Kafka
HBase / Hive / Impala
RDBMS experience
Service oriented architecture, and data standards like JSON, Avro, Parquet
Agile / Scrum methodology experience
Experience in SCMs like GIT; and tools like JIRA
Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities
Strong communication skills, should be able to communicate effectively with business and other stakeholders
Demonstrate ownership and initiative taking
GemFire is a plus
Elastic Search is a plus
Streaming experience is a plus
Exposure to Cloud Services (AWS, Google Cloud) is a plus
Education :
Graduate degree in Computer Science, Information Systems, or equivalent quantitative field
[job_alerts.create_a_job]
Big Data Developer • Jersey City, NJ
[internal_linking.related_jobs]
Sr. Data Analyst
Argonaut Management Services, Inc • New York, NY, United States
[job_card.full_time]
Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc.
Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...[show_more]
Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands.
We restlessly seek what is next for maximizing life - and boldly grow th...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
January • New York, New York, United States
[job_card.full_time] +1
At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]
[last_updated.last_updated_30] • [promoted]
Sr. Sales Manager (26675)
Supermicro • New York, NY, United States
[job_card.full_time]
Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
[last_updated.last_updated_30] • [promoted]
Sr. Data Scientist
Semgrep • New York, New York, United States
[job_card.full_time]
Semgrep is on a mission to make it expensive to exploit software.As the team behind the most popular SAST, we built the Semgrep AppSec Platform to deliver industry-leading code, dependency, and sec...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Scientist
Patreon • New York, NY, United States
[job_card.full_time]
Patreon is a media and community platform where over 300,000 creators give their biggest fans access to exclusive work and experiences.
We offer creators a variety of ways to engage with their commu...[show_more]
[last_updated.last_updated_30] • [promoted]
Lead Data Scientist
AmTrust Financial • New York, NY, United States
[job_card.full_time]
Do you enjoy solving difficult problems? Are you resourceful? Do you enjoy working with data? If so, AmTrust is looking to add a talented experienced Data Scientist to their growing Data Science...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer and BI Developer - Contract to Hire
Uszoom • Village of Montebello, New York, United States
[job_card.full_time]
Senior Data Engineer and BI Developer - Contract to Hire.Postal1, the leading provider of Digital Mailbox technology worldwide, is looking for an intelligent and ambitious.Senior Data Engineer and ...[show_more]
Today thousands of leading brands and agencies use.We’re building the platform and profession that will empower a million marketers to become modern leaders — not spectators — as AI reshapes how br...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior / Lead Data Analyst
Medal, Highlight, & Ai Research • New York, New York, United States
[job_card.full_time]
At Medal, we’re redefining the way gamers connect, share, and relive their greatest in-game moments.Our platform makes it easy to clip, edit, and share gaming content—whether you're capturing a leg...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
Marketaxess • New York, New York, United States
[job_card.full_time]
MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]
Driven by the power of Optimum, Optimum Media is our innovative multiscreen advertising sales and media consultancy business servicing small to medium business as well as national, political, media...[show_more]
[last_updated.last_updated_30] • [promoted]
Lead Data Engineer
VirtualVocations • Yonkers, New York, United States
[job_card.full_time]
A company is looking for a Lead Data Engineer to own and develop its data engineering function.Key Responsibilities Design, build, and scale data infrastructure pipelines and warehousing Collabo...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer, Digital Optimization
Uja Careers • New York, New York, United States
[job_card.full_time]
UJA-Federation of NY is seeking a technical, data-savvy.Senior Data Engineer, Digital Optimization.This is a unique opportunity to shape the future of donor intelligence and use advanced technology...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer, Product Platform
Match Group • New York, New York, United States
[job_card.full_time]
Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever.
At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
Plum Inc • New York, New York, United States
[filters.remote]
[job_card.full_time]
PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
Valon Tech • New York, NY, United States
[job_card.full_time]
Valon is building the AI-native operating system for regulated finance, starting with mortgage servicing.We're a Series C company backed by a16z, transforming industries that others have written of...[show_more]
At Rain, we’re rebuilding the global financial pipes money flows through.Our infrastructure makes stablecoins usable in the real world by powering credit card transactions, cross-border payments, B...[show_more]