Talent.com
Lead Data Engineer
Lead Data EngineerNess Digital Engineering • New York, NY, US
Lead Data Engineer

Lead Data Engineer

Ness Digital Engineering • New York, NY, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Description

Job Title : Lead Data Engineer / Data Architect

Location : New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week)

About the Role :

We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains.

Key Responsibilities :

  • Lead the data architecture and engineering strategy , ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions .
  • Performance Optimization : Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance : Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication : Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation : Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution : Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.

Required Qualifications :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in data engineering with a strong focus on Data Architecture , Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL / ELT tools.
  • AWS Technologies (Glue, EMR)
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).
  • Why Join Us :

    At Ness, you will work with diverse, talented professionals who are dedicated to making an impact through technology. We encourage applicants of all backgrounds to apply—even if you don’t meet every requirement, we’d love to connect with you if this role excites you. We’re committed to creating an inclusive workplace that celebrates each team member’s unique talents.

    With flexible remote options, diverse projects, and access to development resources, joining Ness means building a career that’s meaningful and impactful.

    Ready to Start Your Journey?

    [job_alerts.create_a_job]

    Lead Data Engineer • New York, NY, US

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Open Roles • New York, New York, United States
    [job_card.full_time]
    Trillium is a leading proprietary trading firm active in US Equities, US Options, Canadian Equities, and OTC Equities.With trading technology built, tested, and optimized in-house, our engineers an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analytics Data Engineer

    Analytics Data Engineer

    Anthropic • New York, New York, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    January • New York, New York, United States
    [job_card.full_time] +1
    At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Data Engineer

    AI Data Engineer

    Ladders • New York, New York, United States
    [job_card.full_time]
    At Ladders, we’re redefining how professionals find better, more rewarding careers.With over a million job listings and a mission to make the job search smarter, faster, and more effective, we leve...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Software Engineer - Data Engineer

    Lead Software Engineer - Data Engineer

    J.P. Morgan • Jersey City, New York, US
    [job_card.full_time]
    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Sector's Fi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    MetroPlus Health Plan • New York, NY, United States
    [job_card.full_time] +1
    Water Street, 7th Floor, New York, NY 10004 .New Yorkers by uniting communities through care.We believe that Health care is a right, not a privilege. If you have compassion and a collaborative sp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer III

    Data Engineer III

    Match Group • New York, New York, United States
    [job_card.full_time]
    Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Iex Group • New York, NY, United States
    [job_card.full_time]
    Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business model and unique architecture designed to protect investors. Today, IEX applies its propr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer Clips / ML Data

    Data Engineer Clips / ML Data

    Medal • New York, New York, United States
    [job_card.full_time]
    At Medal, we’re redefining how people capture and share gameplay experiences.Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights.W...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Platform

    Data Engineer, Platform

    Basis Research Institute • New York, NY, United States
    [job_card.full_time]
    AI research organization with two mutually reinforcing goals.This means to establish the mathematical principles of what it means to reason, to learn, to make decisions, to understand, and to expla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Kasheesh • New York, New York, United States
    [job_card.full_time]
    Kasheesh is the first and only product that lets consumers split their payments across multiple credit, debit, and gift cards. Kasheesh is on an exciting mission to drive unparalleled flexibility fo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    10a Labs • New York, New York, United States
    [job_card.full_time]
    Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Marketaxess • New York, New York, United States
    [job_card.full_time]
    MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Coast • New York, New York, United States
    [job_card.full_time]
    Coast is re-imagining the trillion-dollar U.B2B card payments infrastructure, with a focus on the country’s 500,000 commercial fleets, 40 million commercial vehicles, and many million commercial dr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Endex • New York, New York, United States
    [job_card.full_time]
    Over the next few years, every financial institution will have teams of AI analysts working alongside their sharpest minds. At Endex, we're on a mission to bridge the present to the inevitable by bu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Fanduel • New York, New York, United States
    [job_card.full_time]
    Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Point72 • New York, New York, United States
    [job_card.full_time]
    A CAREER WITH POINT72’S TECHNOLOGY TEAM.As Point72 reimagines the future of investing, our Technology team is constantly improving our company’s IT infrastructure, positioning us at the forefront o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]