Senior Data Engineer (San Francisco)Sigmaways Inc • San Francisco, CA, United States
Senior Data Engineer (San Francisco)
Sigmaways Inc • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Bachelors degree in Computer Science, Information Systems, or related field (or equivalent experience). At least 3 years of experience with Python and PySpark, including Jupyter notebooks and unit testing. At least 2 years of experience with Databricks, Collibra, and Starburst. Proven work with relational and NoSQL databases, including STAR and dimensional modeling approaches. Hands-on experience with modern data stacks : object stores (S3), Spark, Airflow, lakehouse architectures, and cloud warehouses (Snowflake, Redshift). Strong background in ETL and big data engineering (on-prem and cloud). Work within enterprise cloud platforms (CFS2, Cloud Foundational Services 2 / EDS) for governance and compliance. Experience building end-to-end pipelines for structured, semi-structured, and unstructured data using Spark.
If youre hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you.
As a Senior Data Engineer, you will design, build, and maintain scalable data pipelines that transform raw information into actionable insights. The ideal candidate will have strong experience across modern data platforms, cloud environments, and big data technologies, with a focus on building secure, repeatable, and high-performing solutions.
Responsibilities :
- Design, develop, and maintain secure, scalable data pipelines to ingest, transform, and deliver curated data into the Common Data Platform (CDP).
- Participate in Agile rituals and contribute to delivery within the Scaled Agile Framework (SAFe).
- Ensure quality and reliability of data products through automation, monitoring, and proactive issue resolution.
- Deploy alerting and auto-remediation for pipelines and data stores to maximize system availability.
- Apply a security first and automation-driven approach to all data engineering practices.
- Collaborate with cross-functional teams (data scientists, analysts, product managers, and business stakeholders) to align infrastructure with evolving data needs.
- Stay current on industry trends and emerging tools, recommending improvements to strengthen efficiency and scalability.
Qualifications :
[job_alerts.create_a_job]
Data Engineer • San Francisco, CA, United States
[internal_linking.similar_jobs]
Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
F;$153,686 / year - $193,388 / year .F;Full-time (Hybrid work schedule).Permanent Exempt : This is an Exempt position excluded by the Charter from the competitive Civil Service examination process,...[show_more]
A leading financial services company is seeking a Senior Distinguished Data Engineer to drive the technical strategy for consumption platforms.
The role requires deep expertise in AWS, Lakehouse arc...[show_more]
A leading analytics platform in San Francisco is seeking a Senior Software Engineer in Data Engineering.The role involves building data pipelines and collaborating with cross-functional teams to en...[show_more]
A data services company based in the heart of San Francisco, are looking for a.They are a team of passionate engineers and data experts that are working on a variety of different project, primarily...[show_more]
Member of Technical Staff - AI Data Engineer.A high-growth, AI-native startup coming out of stealth is hiring AI Data Engineers to build the systems that power production-grade AI.The company has r...[show_more]
Our mission is to detect cancer early, when it can be cured.We are working to change the trajectory of cancer mortality and bring stakeholders together to adopt innovative, safe, and effective tech...[show_more]
Color Health is revolutionizing cancer care with the nation's first Virtual Cancer Clinic, delivering high-quality, physician-led multidisciplinary care across all 50 states.Our innovative, guideli...[show_more]
A leading technology company based in San Francisco is seeking an experienced Data Engineer to build scalable data infrastructure and drive impactful projects.
The role requires 6+ years of data and...[show_more]
We exist to accelerate innovation.We do this by giving more people the opportunity to participate in the venture economy by building the financial infrastructure that makes it possible for more peo...[show_more]
Want to help us help others Were hiring!.GoFundMe is the worlds most powerful community for good dedicated to helping people help each other.
By uniting individuals and nonprofits in one place GoFun...[show_more]
Ohalo is seeking an experienced.This role involves building and maintaining data pipelines to support our machine learning engineering activities and managing data related to plant phenotypes and g...[show_more]
A leading online hospitality service in San Francisco is seeking a Senior Software Engineer, specializing in Data Engineering.
This role involves developing data strategies, building efficient data ...[show_more]
Nextdoor (NYSE : NXDR) is the essential neighborhood network.Neighbors, public agencies, and businesses use Nextdoor to connect around local information that matters in more than 340,000 neighborhoo...[show_more]
We're thrilled to embark on the search for a seasoned.Senior / Lead Data Solution Engineer.This pivotal role offers an exciting opportunity to shape the future of technology within our organization.A...[show_more]
PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...[show_more]
A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure.
This role involves cross-functional coll...[show_more]
Finix is a full-stack acquirer processor, empowering businesses of all sizes with flexible, modern payment solutions.Processing billions of dollars annually, Finix enables SaaS, marketplace, and e-...[show_more]
Senior Data Engineer, Data Lake & Governance
Gridware • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer (1043)
City and County of San Francisco • San Francisco, CA, US
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Senior Data Platform Engineer – Cloud, Lakehouse & Scale
Capital One • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer, Growth Platform & Pipelines
Mixpanel • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
X4 Engineering • San Mateo, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
AI Data Engineer (San Francisco Bay Area)
HartleyCo • San Francisco Bay Area, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Staff Data Engineer (Durham, NC) #4433
GRAIL • Menlo Park, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Analytics Engineer
Color Health • Burlingame, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Platform Engineer
Rippling • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer
AngelList • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
GoFundMe • San Francisco, California, USA
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Platform Data Engineer South San Francisco
Ohalo Genetics, Inc • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer, Data Pipelines & Analytics
airbnb, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted]
Senior Analytics Engineer
Nextdoor • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior / Lead Data Solution Engineer
Meltwater • Redwood City, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Data Engineer
PG Forsta • Emeryville, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior AI & Data Platform Engineer (Onsite)
Icon Ventures • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer
Finix • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]