Senior Azure Data EngineerMomento USA • New York City, New York, USA

Senior Azure Data Engineer

Momento USA • New York City, New York, USA

[job_card.variable_days_ago]

[job_preview.job_type]

[job_card.full_time]

[job_card.job_description]

Job Title : Senior Azure Data Engineer with Databricks Expertise

Location : NJ / NYC Only

Experience 12-15 Years

Position : Hybrid 3 Days

Job Summary :

We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design implement and optimize large-scale data pipeline ensuring scalability reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.

Key Responsibilities :

Data Pipeline Development :

Build and maintain scalable ETL / ELT pipelines using Databricks.

Leverage PySpark / Spark and SQL to transform and process large datasets.

Integrate data from multiple sources including Azure Blob Storage ADLS and other relational / non-relational systems.

Collaboration & Analysis :

Work Closely with multiple teams to prepare data for dashboard and BI Tools.

Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.

Performance & Optimization :

Optimize Databricks workloads for cost efficiency and performance.

Monitor and troubleshoot data pipelines to ensure reliability and accuracy.

Governance & Security :

Implement and manage data security access controls and governance standards using Unity Catalog.

Ensure compliance with organizational and regulatory data policies.

Deployment :

Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs notebooks and configurations across environments.

Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.

Technical Skills :

Strong expertise in Databricks (Delta Lake Unity Catalog Lakehouse Architecture Table Triggers Delta Live Pipelines Databricks Runtime etc.)

Proficiency in Azure Cloud Services.

Solid Understanding of Spark and PySpark for big data processing.

Experience in relational databases.

Knowledge on Databricks Asset Bundles and GitLab.

Preferred Experience :

Familiarity with Databricks Runtimes and advanced configurations.

Knowledge of streaming frameworks like Spark Streaming.

Experience in developing real-time data solutions.

Certifications :

Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)

Note : Momento USA is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation gender identity national origin age protected veteran status or disability status.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

[job_alerts.create_a_job]

Senior Data Engineer • New York City, New York, USA

[internal_linking.related_jobs]

Senior Data Engineer

January • New York, New York, United States

[job_card.full_time] +1

At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]

[last_updated.last_updated_30] • [promoted]

Sr. Data Engineer

Equinox • New York, New York, United States

[job_card.full_time]

Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow th...[show_more]

[last_updated.last_updated_30] • [promoted]

Analytics Data Engineer

Anthropic • New York, New York, United States

[job_card.full_time]

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer | Growth and Transformation

Red Ventures • New York, New York, United States

[job_card.full_time]

This role is not open to visa sponsorship or transfer of visa sponsorship including those on OPT and STEM-EXT OPT, nor is it available to work corp-to-corp. Red Ventures operates dozens of digital f...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer

VirtualVocations • Astoria, New York, United States

[job_card.full_time]

A company is looking for a Senior Data Engineer to join their Enterprise Analytics team.Key Responsibilities Build and maintain a modern Data Lake house Design and manage scalable data pipelines...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Analyst / Analytics Engineer

Public • New York, New York, United States

[job_card.full_time]

Public is the long-term investing platform.Investors use AI and a vast variety of asset classes, from stocks and bonds to crypto and options, to build portfolios for the long haul.Launched in 2019,...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer

Marketaxess • New York, New York, United States

[job_card.full_time]

MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace.Why does this ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Cloud Data Engineer

Govx • New York, New York, United States

[filters.remote]

[job_card.full_time]

The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Data Engineer

10a Labs • New York, New York, United States

[job_card.full_time]

Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer

Plum Inc • New York, New York, United States

[filters.remote]

[job_card.full_time]

PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer, Digital Optimization

Uja Careers • New York, New York, United States

[job_card.full_time]

UJA-Federation of NY is seeking a technical, data-savvy.Senior Data Engineer, Digital Optimization.This is a unique opportunity to shape the future of donor intelligence and use advanced technology...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer, Product Platform

Match Group • New York, New York, United States

[job_card.full_time]

Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer, Data Infrastructure

Zocdoc • New York, New York, United States

[job_card.full_time]

Healthcare should work for patients, but it doesn’t.In their time of need, they call down outdated insurance directories. Then wait weeks for the privilege of a visit.Then wait in a room solely desi...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior Data Engineer

Valon Tech • New York, NY, United States

[job_card.full_time]

Valon is building the AI-native operating system for regulated finance, starting with mortgage servicing.We're a Series C company backed by a16z, transforming industries that others have written of...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Data Engineer

Resortpass • New York, NY, United States

[job_card.full_time]

ResortPass is completely redefining what it means to be a guest at a hotel.By offering day access to luxury hotel experiences, including breathtaking pools, private beaches, deluxe spas, and more, ...[show_more]

[last_updated.last_updated_30] • [promoted]

Data Engineer

Fanduel • New York, New York, United States

[job_card.full_time]

Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...[show_more]

[last_updated.last_updated_30] • [promoted]

GCP Data Engineer

Zone It Solutions • New York, New York, United States

[job_card.full_time]

We are seeking a talented GCP Data Engineer based in California City.You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Pl...[show_more]

[last_updated.last_updated_30] • [promoted]

Cloud Data Platform Engineer

Chubb • Jersey City, NJ, US

[job_card.full_time] +1

Chubb is looking for a Azure Platform Engineering Professional with a Bachelor’s Degree to join our Global Data Platform team. This is a permanent full-time position and a compelling opportunity to ...[show_more]

[last_updated.last_updated_30] • [promoted]