Talent.com
Market Data Engineer
Market Data EngineerBoerboel • New York City, New York, USA
Market Data Engineer

Market Data Engineer

Boerboel • New York City, New York, USA
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

We are seeking highly motivated and talented people to join the Boerboel team. As a member of the team you will be working with passionate and curious colleagues who thrive on solving complex problems. Boerboel is an office-first firm. While we offer flexibility to our employees remote work is not available at this time.

About us :

Boerboel Trading is an electronic trading firm active across a wide range of asset classes and regions with offices in NYC Chicago London and Malta. We engage in rigorous quantitative analysis to deploy systematic trading strategies over multiple time horizons. Trading and research employees of the firm are graduates from a wide spectrum of quantitative disciplines such as engineering computer science mathematics and physics. Our employees apply their scientific methodologies to the analysis of extensive financial data sets.

Summary :

As a Market Data Engineer you will be a core part of our new SRE team working closely with our research development and infrastructure teams to manage capture normalization post-processing and distribution of petabytes of historical market data from exchanges around the world.

Objectives :

  • Manage very large scale time sensitive market data capture and normalization pipelines
  • Maintain and improve our internal formats formats and common downstream research data
  • Ensure reliability of packet capture process and vendor data downloads
  • Implement robust data validation and monitoring of both historical and ongoing data
  • Provide production support troubleshooting and timely resolution of issues

Qualifications :

  • Experience building and maintaining extremely large-scale data pipelines
  • Proficient in Python and Bash scripting familiarity with light C debugging
  • Knowledge of computer networking fundamentals and packet captures
  • Understanding of high performance filesystems and columnar storage formats
  • Previous experience with binary market data specifications (ITCH MDP3 etc)
  • This position is eligible to be based in New York NY or London compliance with applicable U.S. pay transparency laws the anticipated base range for this role is $100000 - $200000 annually in New York NY. Pay (base and bonus) may vary depending on job-related skills and experience. A discretionary performance bonus may be provided as part of the total compensation package.

    Eligible employees can participate in our benefits package which include health insurance retirement savings plan PTO etc. Offerings may differ depending on location.

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 100000 - 200000

    [job_alerts.create_a_job]

    Market Data Engineer • New York City, New York, USA

    [internal_linking.related_jobs]
    Data Engineer

    Data Engineer

    Open Roles • New York, New York, United States
    [job_card.full_time]
    Trillium is a leading proprietary trading firm active in US Equities, US Options, Canadian Equities, and OTC Equities.With trading technology built, tested, and optimized in-house, our engineers an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analytics Data Engineer

    Analytics Data Engineer

    Anthropic • New York, New York, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Data Engineer

    AI Data Engineer

    Ladders • New York, New York, United States
    [job_card.full_time]
    At Ladders, we’re redefining how professionals find better, more rewarding careers.With over a million job listings and a mission to make the job search smarter, faster, and more effective, we leve...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    MetroPlus Health Plan • New York, NY, United States
    [job_card.full_time] +1
    Water Street, 7th Floor, New York, NY 10004 .New Yorkers by uniting communities through care.We believe that Health care is a right, not a privilege. If you have compassion and a collaborative sp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer - NYC

    Data Engineer - NYC

    Aircall • New York, NY, United States
    [job_card.full_time]
    Aircall is a place where voices are valued.Backed by over $220 million of investment since 2015, we create technology that fuels accessible, transparent and collaborative communication to empower o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Iex Group • New York, NY, United States
    [job_card.full_time]
    Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business model and unique architecture designed to protect investors. Today, IEX applies its propr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer III

    Data Engineer III

    Match Group • New York, New York, United States
    [job_card.full_time]
    Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Customer Data Engineer

    Customer Data Engineer

    Optimove • New York, New York, United States
    [job_card.full_time]
    Optimove is a global marketing tech company, recognized as a Leader by Forrester and a Challenger by Gartner.We work with some of the world's most exciting brands, such as Sephora, Staples, and Ent...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Prizeout • New York, New York, United States
    [job_card.full_time]
    Prizeout is a fast-growing fintech transforming how people interact with their money by turning everyday transactions into rewarding, value-driven moments. We sit at the intersection of payments, re...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Kasheesh • New York, New York, United States
    [job_card.full_time]
    Kasheesh is the first and only product that lets consumers split their payments across multiple credit, debit, and gift cards. Kasheesh is on an exciting mission to drive unparalleled flexibility fo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer Clips / ML Data

    Data Engineer Clips / ML Data

    Medal • New York, New York, United States
    [job_card.full_time]
    At Medal, we’re redefining how people capture and share gameplay experiences.Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights.W...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Platform

    Data Engineer, Platform

    Basis Research Institute • New York, NY, United States
    [job_card.full_time]
    AI research organization with two mutually reinforcing goals.This means to establish the mathematical principles of what it means to reason, to learn, to make decisions, to understand, and to expla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Applecart • New York, New York, United States
    [job_card.full_time]
    The most important decisions are made by the hardest people to reach and influence.Historically, C-suite leaders have lacked the tools to reach the stakeholders that matter most to their business.T...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    10a Labs • New York, New York, United States
    [job_card.full_time]
    Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Marketaxess • New York, New York, United States
    [job_card.full_time]
    MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Coast • New York, New York, United States
    [job_card.full_time]
    Coast is re-imagining the trillion-dollar U.B2B card payments infrastructure, with a focus on the country’s 500,000 commercial fleets, 40 million commercial vehicles, and many million commercial dr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Endex • New York, New York, United States
    [job_card.full_time]
    Over the next few years, every financial institution will have teams of AI analysts working alongside their sharpest minds. At Endex, we're on a mission to bridge the present to the inevitable by bu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Point72 • New York, New York, United States
    [job_card.full_time]
    A CAREER WITH POINT72’S TECHNOLOGY TEAM.As Point72 reimagines the future of investing, our Technology team is constantly improving our company’s IT infrastructure, positioning us at the forefront o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]