Talent.com
Lead Data Engineer
Lead Data EngineerNess Digital Engineering • New York, NY, US
Lead Data Engineer

Lead Data Engineer

Ness Digital Engineering • New York, NY, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Description

Job Title : Lead Data Engineer / Data Architect

Location : New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week)

About the Role :

We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains.

Key Responsibilities :

  • Lead the data architecture and engineering strategy , ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions .
  • Performance Optimization : Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance : Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication : Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation : Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution : Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.

Required Qualifications :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in data engineering with a strong focus on Data Architecture , Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL / ELT tools.
  • AWS Technologies (Glue, EMR)
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).
  • Why Join Us :

    At Ness, you will work with diverse, talented professionals who are dedicated to making an impact through technology. We encourage applicants of all backgrounds to apply—even if you don’t meet every requirement, we’d love to connect with you if this role excites you. We’re committed to creating an inclusive workplace that celebrates each team member’s unique talents.

    With flexible remote options, diverse projects, and access to development resources, joining Ness means building a career that’s meaningful and impactful.

    Ready to Start Your Journey?

    [job_alerts.create_a_job]

    Lead Data Engineer • New York, NY, US

    [internal_linking.related_jobs]
    Data Engineer

    Data Engineer

    Artisan • New York, NY, United States
    [job_card.full_time]
    You’ll be responsible for building reliable data pipelines, integrating external APIs, maintaining clean and structured data models, and enabling the product and ML teams to iterate quickly.You sho...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data and Analytics Engineer

    Data and Analytics Engineer

    Resonance • New York, NY, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Resonance is transforming the fashion industry by building a more sustainable and valuable ecosystem for designers, brands, manufacturers, consumers, and the planet. Our AI-powered operating system,...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    MetroPlus Health Plan • New York, NY, United States
    [job_card.full_time] +1
    Water Street, 7th Floor, New York, NY 10004 .New Yorkers by uniting communities through care.We believe that Health care is a right, not a privilege. If you have compassion and a collaborative sp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Momento USA • New York, NY, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Job Title : Senior Azure Data Engineer with Databricks Expertise Location : NJ / NYC Only Experience 12-15 Years< / b&g...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    [job_card.full_time]
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Azure Data Engineer (Weehawken)

    Azure Data Engineer (Weehawken)

    Programmers.io • Weehawken, NJ, US
    [job_card.full_time] +1
    Job Title : Azure Data Engineer.Location : Weehawken, NJ ( 5 days WFO).Expert level skills writing and optimizing complex SQL. Experience with complex data modelling, ETL design, and using large datab...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Market Data Engineer (New York)

    Market Data Engineer (New York)

    Harrington Starr • New York, NY, US
    [job_card.part_time]
    Market Data Engineer New York | Cutting-Edge Trading Environment.Im partnered with a leading technology-driven trading team in. This role is central to managing the capture, normalization, and dist...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer - Matillion ETL

    Data Engineer - Matillion ETL

    Noblesoft Technologies • Secaucus, NJ, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Job Title : Data Engineer - Matillion ETL Location : Secaucus, NJ(Remote) Mandatory - Snowflake, Matillion, ETL Job Description...[show_more]
    [last_updated.last_updated_variable_days]
    Data Engineer

    Data Engineer

    Mastech Digital • Jersey City, NJ, United States
    [job_card.full_time]
    NYSE : MHH) is a minority-owned, publicly traded IT staffing and digital transformation services company.Headquartered in Pittsburgh, PA, and established in 1986, we serve clients nationwide through...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    The Judge Group • Jersey City, NJ, United States
    [job_card.full_time]
    Location : Jersey City / ONSITE / NO C2C / NO C2H / NO THIRD PARTIES / ONLY W2 / .ONLY LOCALS TO NJ / NY - NO RELOCATION CANDIDATES. Must Haves : Python, PySpark, AWS – ECS, Glue, Lambda, S3.Nice to Haves : Java, S...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Tiger Analytics • Jersey City, NJ, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several F...[show_more]
    [last_updated.last_updated_30]
    Lead Data Analytics

    Lead Data Analytics

    Altice USA • Long Island City, NY, United States
    [job_card.full_time]
    Driven by the power of Optimum, Optimum Media is our innovative multiscreen advertising sales and media consultancy business servicing small to medium business as well as national, political, media...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    Fusemachines • New York, NY, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizin...[show_more]
    [last_updated.last_updated_variable_days]
    Data Engineer

    Data Engineer

    Blue Orange Digital • New York, New York, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Blue Orange Digital is a data and AI consulting firm that helps companies turn complex data into real business outcomes.We partner with organizations across industries to design and deploy scalable...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    VSG Business Solutions LLC • New York City, NY, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Strong understanding of data modeling principles including Dimensional modeling, data normalization principles.Good understanding of SQL Engines and able to conduct advanced performance tuning.Abil...[show_more]
    [last_updated.last_updated_variable_days]
    Analytics Data Engineer : Scale Data Pipelines & Dashboards

    Analytics Data Engineer : Scale Data Pipelines & Dashboards

    anthropic • New York, NY, United States
    [job_card.full_time]
    A leading AI research company is seeking an Analytics Engineer to join their Data Science & Analytics team in New York.The ideal candidate will have at least 5 years of relevant experience and stro...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Precision Technologies Corp • New York City, NY, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Role Name : Data Engineer Location : New York City, NY - Need locals [show_more]
    [last_updated.last_updated_1_day]
    Data Engineer - Hadoop

    Data Engineer - Hadoop

    GTN Technical Staffing • New York, New York, United States
    [job_card.permanent]
    Data Engineer – Hadoop Administrator.Location : Chicago, IL / New York, NY / Phoenix, AZ (Hybrid).Data Science R&D compute cluster. ML Ops organization, providing hands-on operational support for the...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]