Senior Data Engineer (San Francisco)Sigmaways Inc • San Francisco, CA, United States
Senior Data Engineer (San Francisco)
Sigmaways Inc • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Bachelors degree in Computer Science, Information Systems, or related field (or equivalent experience). At least 3 years of experience with Python and PySpark, including Jupyter notebooks and unit testing. At least 2 years of experience with Databricks, Collibra, and Starburst. Proven work with relational and NoSQL databases, including STAR and dimensional modeling approaches. Hands-on experience with modern data stacks : object stores (S3), Spark, Airflow, lakehouse architectures, and cloud warehouses (Snowflake, Redshift). Strong background in ETL and big data engineering (on-prem and cloud). Work within enterprise cloud platforms (CFS2, Cloud Foundational Services 2 / EDS) for governance and compliance. Experience building end-to-end pipelines for structured, semi-structured, and unstructured data using Spark.
If youre hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you.
As a Senior Data Engineer, you will design, build, and maintain scalable data pipelines that transform raw information into actionable insights. The ideal candidate will have strong experience across modern data platforms, cloud environments, and big data technologies, with a focus on building secure, repeatable, and high-performing solutions.
Responsibilities :
- Design, develop, and maintain secure, scalable data pipelines to ingest, transform, and deliver curated data into the Common Data Platform (CDP).
- Participate in Agile rituals and contribute to delivery within the Scaled Agile Framework (SAFe).
- Ensure quality and reliability of data products through automation, monitoring, and proactive issue resolution.
- Deploy alerting and auto-remediation for pipelines and data stores to maximize system availability.
- Apply a security first and automation-driven approach to all data engineering practices.
- Collaborate with cross-functional teams (data scientists, analysts, product managers, and business stakeholders) to align infrastructure with evolving data needs.
- Stay current on industry trends and emerging tools, recommending improvements to strengthen efficiency and scalability.
Qualifications :
[job_alerts.create_a_job]
Data Engineer • San Francisco, CA, United States
[internal_linking.related_jobs]
Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...[show_more]
We are actively searching for a Data Infrastructure Engineer to join our team on a permanent basis.In this founding engineer role you will focus on building next-generation data infrastructure for ...[show_more]
Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
A leading analytics platform in San Francisco is seeking a Senior Software Engineer in Data Engineering.The role involves building data pipelines and collaborating with cross-functional teams to en...[show_more]
AI Incubator - Senior Data Engineer.At Sprinter Health, our mission is reimagining how people access care by bringing it directly to their homes.
Nearly 30% of patients in the U.For many, the ER bec...[show_more]
A leading digital platform is seeking a senior software engineer to enhance its data platform in San Francisco.In this hybrid role, you will collaborate across teams, tackle data challenges, and de...[show_more]
Founded in 2020 by a team of leaders from Braintree, PayPal, and Lending Club, Highnote is an embedded finance company that sets the standard in modern card platform management.As an all-in-one car...[show_more]
Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...[show_more]
A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure.
This role involves cross-functional coll...[show_more]
A leading customer relationship management company in San Francisco is looking for an experienced software engineer with a strong data engineering background.
The role involves designing high-throug...[show_more]
PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...[show_more]
A financial services company in San Francisco seeks a Distinguished Data Engineer to lead innovation in data architecture and management.
The role involves building critical data solutions, mentorin...[show_more]
Fluency is enabling the autonomous Enterprise.You're needed to help pioneer a new software category that will change how enterprises work.
Welcome to the data layer of the future.Fluency is looking ...[show_more]
Youll work closely with engineering, analytics, and product teams to ensure data is accurate, accessible, and efficiently processed across the organization.
Design, develop, and maintain scalable da...[show_more]
Ellipsis Health is creating cutting-edge AI / ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the d...[show_more]
A leading AI productivity company is seeking a Senior Engineer for its Data Platform team in San Francisco.You will architect and develop systems for handling billions of daily events, ensuring sec...[show_more]
We envision a world where novel drugs and therapies reach patients in months, not years, accelerating breakthroughs that save lives.
Mithrl is building the worlds first commercially available AI Co-...[show_more]
A leading real estate technology company in San Francisco is seeking a Senior Data Engineer to build high-performance, scalable data solutions.
The ideal candidate has over 5 years of experience in ...[show_more]
Data Engineer (San Francisco)
Midjourney • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Platform Engineer / AI Workloads (San Francisco)
The Crypto Recruiters • San Francisco, CA, United States
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer, Data Lake & Governance
Gridware • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer, Growth Platform & Pipelines
Mixpanel • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Incubator - Senior Data Engineer
Sprinter Health • Menlo Park, California, United States, 94025
[job_card.full_time]
[last_updated.last_updated_variable_days]
Senior Data Platform Engineer - Hybrid SF
FATMAP • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Software Engineer, Data Platform San Francisco
Highnote Health Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Lead Data Engineer (San Francisco)
Mentor Talent Acquisition • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI & Data Platform Engineer (Onsite)
Icon Ventures • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data & ML Platform Engineer
Salesforce, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer
PG Forsta • Emeryville, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer, Card Data Platform
Capital One • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer (San Francisco)
Fluency • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer (San Francisco)
Odiin. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Platform Engineer
Ellipsis Health • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Platform Engineer : Scale BillionEvent Pipelines
Superhuman Labs, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer - Scientific Data Ingestion (San Francisco)
Mithrl • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer : Real-Time Big Data Pipelines
Anywhere Real Estate • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]