Talent.com
Big Data ETL Developer
Big Data ETL DeveloperInfoTech Solutions • New York, NY, United States
[error_messages.no_longer_accepting]
Big Data ETL Developer

Big Data ETL Developer

InfoTech Solutions • New York, NY, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About the Company

The firm is a recognized market innovator with the technology and tools that accurately authenticate the quality of digital media and drive ad performance for the worlds largest brands. They provide media transparency and accountability to deliver the highest level of impression quality for maximum advertising performance.

Position Overview

As a Big Data ETL Developer you will be designing and implementing systems that crunch and process billions of records a day and make them available in the companys analytics platform, helping our clients to make smarter decisions that continuously improve their ad-impression quality.

You will develop ETL processes on both home-grown and 3rd party frameworks.

Responsibilities

  • Developing ETL processes that process billions of records a day efficiently
  • Delivering insightful data to clients, partners and internal users in various ways by implementing robust, scalable data delivery applications and APIs.
  • Collaborating and participating in project meetings.
  • Analyzing data to test the correctness and effectiveness of ETL processes.

Position Requirements

  • At least 3 years hands-on development experience of ETLs
  • At least 2 years working in a DWH environment schema design is an advantage
  • Hands-on development experience in python
  • Experience in one or more of the following technologies : Hadoop, Spark, Kafka, Parquet, Hive, Pig.
  • Advanced SQL query writing abilities and data understanding
  • Excellent communication skills and a team player
  • Experience with GoodData CloudConnect is a plus
  • Experience with Vertica or other columnar data stores is a plus
  • Hands on experience with Spark Streaming or other live stream processing technology a plus
  • #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Etl Developer • New York, NY, United States

    [internal_linking.related_jobs]
    Data Engineer

    Data Engineer

    Open Roles • New York, New York, United States
    [job_card.full_time]
    Trillium is a leading proprietary trading firm active in US Equities, US Options, Canadian Equities, and OTC Equities.With trading technology built, tested, and optimized in-house, our engineers an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    January • New York, New York, United States
    [job_card.full_time] +1
    At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer and BI Developer - Contract to Hire

    Senior Data Engineer and BI Developer - Contract to Hire

    Uszoom • Village of Montebello, New York, United States
    [job_card.full_time]
    Senior Data Engineer and BI Developer - Contract to Hire.Postal1, the leading provider of Digital Mailbox technology worldwide, is looking for an intelligent and ambitious.Senior Data Engineer and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Prizeout • New York, New York, United States
    [job_card.full_time]
    Prizeout is a fast-growing fintech transforming how people interact with their money by turning everyday transactions into rewarding, value-driven moments. We sit at the intersection of payments, re...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    [job_card.full_time]
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Big Data Developer

    Big Data Developer

    InfoCepts • Jersey City, NJ, United States
    [job_card.full_time]
    Designing Hive / HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing. Implementing Spark processing based ETL...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Developer

    Senior Data Developer

    Centiva Capital • New York, NY, United States
    [job_card.full_time]
    Please send resumes to Tech-Recruiting@centivacapital.Develop and maintain scalable Python-based ETL pipelines for ingesting and transforming market data from multiple sources.Build and manage clou...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior / Lead Data Analyst

    Senior / Lead Data Analyst

    Medal, Highlight, & Ai Research • New York, New York, United States
    [job_card.full_time]
    At Medal, we’re redefining the way gamers connect, share, and relive their greatest in-game moments.Our platform makes it easy to clip, edit, and share gaming content—whether you're capturing a leg...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Marketaxess • New York, New York, United States
    [job_card.full_time]
    MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Solutions Engineer

    Data Solutions Engineer

    Motherduck • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    Don’t let the quirky name fool you! We’re on a mission to radically transform the data analyst user experience.We empower and delight analysts using a novel cloud architecture built on top of DuckD...[show_more]
    [last_updated.last_updated_30] • [promoted]
    ETL Developer

    ETL Developer

    Morph Enterprise • New York City, New York, USA
    [job_card.full_time]
    Duration : 18 Months extension possible based on needs and performance.Client seeks an experienced consultant that can : . Extract geographic and non-geographic data from Oracle and SQL Server database...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer, Digital Optimization

    Senior Data Engineer, Digital Optimization

    Uja Careers • New York, New York, United States
    [job_card.full_time]
    UJA-Federation of NY is seeking a technical, data-savvy.Senior Data Engineer, Digital Optimization.This is a unique opportunity to shape the future of donor intelligence and use advanced technology...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Informatica ETL Data Engineer (Python / AWS)

    Informatica ETL Data Engineer (Python / AWS)

    Epathusa • New York City, NY, United States
    [job_card.full_time]
    Seeking Senior Informatica ETL Engineers who are Data Architects and Engineers who can lead enterprise data projects as well as : . Be the experts in leading projects and teams in the Data space, usin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    GCP Data Engineer

    GCP Data Engineer

    Zone It Solutions • New York, New York, United States
    [job_card.full_time]
    We are seeking a talented GCP Data Engineer based in California City.You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Pl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Point72 • New York, New York, United States
    [job_card.full_time]
    A CAREER WITH POINT72’S TECHNOLOGY TEAM.As Point72 reimagines the future of investing, our Technology team is constantly improving our company’s IT infrastructure, positioning us at the forefront o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Analyst (Hybrid)

    Senior Data Analyst (Hybrid)

    Empassion • New York, New York, United States
    [job_card.full_time]
    Empassion is a Management Services Organization (MSO) focused on improving the quality of care and costs on an often neglected “Advanced illness / end of life” patient population, representing 4 per...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Rain • New York, New York, United States
    [job_card.full_time]
    At Rain, we’re rebuilding the global financial pipes money flows through.Our infrastructure makes stablecoins usable in the real world by powering credit card transactions, cross-border payments, B...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]