Engineering Manager StreamingDatabricks • Bellevue, Washington, USA
Engineering Manager Streaming
Databricks • Bellevue, Washington, USA
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]5 years experience working in a related system including big-data ecosystem Apache Spark or database internal A passion for database systems storage systems distributed systems language design or performance optimization Can ensure the team builds high quality and reliable infrastructure services. Experience being responsible for testing quality and SLAs of a product. Previous experience building and leading teams in a complex technical domain such as on distributed data systems or database internals Ability to attract hire and coach engineers who meet the Databricks hiring standards. Can up level existing team via hiring top-notch senior talent growing leaders and helping struggling members. Can gain trust of the team and guide their careers. Experience managing distributed teams preferred Comfortable working cross functionally with product management and directly with customers; ability to deeply understand product and customer personas
P-1110
At Databricks we are passionate about enabling data teams to solve the worlds toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the worlds best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
We are the Spark Structured Streaming team responsible for building Stream Processing capabilities into Spark and Databricks Intelligence Platform. Stream processing is in its infancy and we are here to build not just state of the art Stream Processing technology but best in class managed offering for customers to run their Stream Processing workloads.
Were seeking a dedicated Engineering Leader to spearhead Spark Structured Streaming development initiatives encompassing both open source and Databricks-specific components. Your primary mission will be to make Spark Structured Streaming state of the art Stream Processing engine by adding advanced features such as sophisticated state management new operators and at the same time making the engine performance both from latency and throughput point of view by reimagining engine architecture.
The key responsibilities include :
- Leading a talented engineering team in Spark Structured Streaming team developing and promoting the engine in OSS and the Databricks Data Intelligence Platform
- Overseeing sustained recruitment of top-tier talent and upskilling talent on the team
- Implementing robust processes to efficiently execute product vision strategy and roadmap in alignment with organizational goals and priorities
- Build software that is not just high quality but easy to operate.
- Make company wide impact by driving Stream Processing adoption across the Databricks product portfolio
- Manage technical debt including long term technical architecture decisions and balance product roadmap
What we look for :
Required Experience :
Manager
Key Skills
Hospitality Experience,Go,Management Experience,React,Redux,Node.js,AWS,Mechanical Engineering,Team Management,Leadership Experience,Mentoring,Distributed Systems
Employment Type : Full Time
Experience : years
Vacancy : 1
[job_alerts.create_a_job]
Engineering Manager • Bellevue, Washington, USA
[internal_linking.related_jobs]
At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...[show_more]
A leading entertainment company in Seattle is looking for a Principal Software Engineer to design and develop advanced streaming media solutions.
This role involves working on layered architecture f...[show_more]
For over 20 years, Smartsheet has helped people and teams achieve-well, anything.From seamless work management to smart, scalable solutions, we've always worked with flow.We're building tools that ...[show_more]
At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers.
All team members receive a competitive base salary and compensation pack...[show_more]
We believe the camera presents the greatest opportunity to improve the way people live and communicate.Snap contributes to human progress by empowering people to express themselves, live in the mom...[show_more]
The Relativity engineering department builds and maintains scalable, secure, and performant solutions that empower legal and compliance teams globally.
Our mission spans multiple domains, including ...[show_more]
Technical Delivery Manager / Hybrid - Must be Local to Greater Seattle, WA / (9 Month Contract With Potential to Extend) •.
This role will require working onsite in Seattle, WA 3-4 days per week •.To ...[show_more]
Panaseer is a unique business that is changing the face of enterprise security.As a scale-up at the intersection of data science and big data technology, our Continuous Controls Monitoring platform...[show_more]
Ready to be pushed beyond what you think youre capable of?.At Coinbase, our mission is to increase economic freedom in the world.
Its a massive, ambitious opportunity that demands the best of us, ev...[show_more]
A leading technology company is seeking an Engineering Manager for their HomeKit team in Seattle.This role involves driving software development while managing a diverse engineering team.Ideal cand...[show_more]
Highspot is pioneering the category that is fundamentally changing the way companies increase sales productivity.On a mission to transform the way millions of people work with sales enablement, Hig...[show_more]
Manager, Engineering | Platform.ExtraHop is reinventing Network Detection and Response (NDR) to help enterprises and organizations stay ahead of emerging threats with unmatched network visibility, ...[show_more]
Why join us .Brex is the AI-powered spend platform.We help companies spend with confidence with integrated corporate cards, banking, and global payments, plus intuitive soft...[show_more]
We believe the camera presents the greatest opportunity to improve the way people live and communicate.Snap contributes to human progress by empowering people to express themselves, live in the mom...[show_more]
Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed ...[show_more]
Games for Love is a 501 (c)(3) non-profit organization that works to ease suffering, save lives, and create sustainable futures for children.
We believe in the concept of "distraction therapy" and b...[show_more]
Software Engineering Manager - ServiceNow.We make the impossible, possible.The Walt Disney Company (TWDC) is a world‑class entertainment and technological leader.
Walt’s passion was to continuously ...[show_more]
Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime.
At Pinterest, we're on a mission to br...[show_more]
Senior Engineering Manager, Cluster Management - Data Platform
Cloudera • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Senior Streaming Platform Architect
Disneyland Hong Kong • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Sr. Manager, Engineering - Solution Experiences (Remote Eligible)
Smartsheet • Bellevue, Washington, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Manager, Software Development
T-Mobile USA, Inc. • Bellevue, WA, United States
[job_card.full_time] +2
[last_updated.last_updated_30] • [promoted]
Manager, Cross Platform Software Engineering
Snap Inc. • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Manager, Engineering - Cloud Infrastructure
Relativity • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted]
Technical Delivery Manager (Hybrid - Must Be Local To Greater Seattle, WA)
TEKsystems • Seattle, WA, United States
[job_card.temporary]
[last_updated.last_updated_variable_days] • [promoted]
Engineering Manager | Data Integrations
Panaseer • Seattle, WA, US
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
Senior Engineering Manager - Platform
Coinbase • Seattle, WA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Lead HomeKit Platform Engineering Manager
Apple Inc. • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Sr. Engineering Manager, App Platform & Developer Experience
Highspot • Seattle, WA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Sr. Manager, Engineering | Platform
ExtraHop • Seattle, WA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Engineering Manager, Fraud
Brex • Seattle, WA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Manager, Cross Platform Software Engineering
Minimal • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Engineering Manager - Cloud Platform
Armada Systems • Bellevue, Washington, United States, 98005
[job_card.full_time]
[last_updated.last_updated_30]
Esports Streamer
Games For Love • Lynnwood, WA, United States
[job_card.part_time]
[last_updated.last_updated_variable_days] • [promoted]
Manager, Software Engineering
Disney • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Engineering Manager II, Ads ML Training Infrastructure
Pinterest • Seattle, Washington, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]