Talent.com
Senior Data Engineer (San Francisco)
Senior Data Engineer (San Francisco)Sigmaways Inc • San Francisco, CA, United States
Senior Data Engineer (San Francisco)

Senior Data Engineer (San Francisco)

Sigmaways Inc • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

If youre hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you.

As a Senior Data Engineer, you will design, build, and maintain scalable data pipelines that transform raw information into actionable insights. The ideal candidate will have strong experience across modern data platforms, cloud environments, and big data technologies, with a focus on building secure, repeatable, and high-performing solutions.

Responsibilities :

  • Design, develop, and maintain secure, scalable data pipelines to ingest, transform, and deliver curated data into the Common Data Platform (CDP).
  • Participate in Agile rituals and contribute to delivery within the Scaled Agile Framework (SAFe).
  • Ensure quality and reliability of data products through automation, monitoring, and proactive issue resolution.
  • Deploy alerting and auto-remediation for pipelines and data stores to maximize system availability.
  • Apply a security first and automation-driven approach to all data engineering practices.
  • Collaborate with cross-functional teams (data scientists, analysts, product managers, and business stakeholders) to align infrastructure with evolving data needs.
  • Stay current on industry trends and emerging tools, recommending improvements to strengthen efficiency and scalability.

Qualifications :

  • Bachelors degree in Computer Science, Information Systems, or related field (or equivalent experience).
  • At least 3 years of experience with Python and PySpark, including Jupyter notebooks and unit testing.
  • At least 2 years of experience with Databricks, Collibra, and Starburst.
  • Proven work with relational and NoSQL databases, including STAR and dimensional modeling approaches.
  • Hands-on experience with modern data stacks : object stores (S3), Spark, Airflow, lakehouse architectures, and cloud warehouses (Snowflake, Redshift).
  • Strong background in ETL and big data engineering (on-prem and cloud).
  • Work within enterprise cloud platforms (CFS2, Cloud Foundational Services 2 / EDS) for governance and compliance.
  • Experience building end-to-end pipelines for structured, semi-structured, and unstructured data using Spark.
  • [job_alerts.create_a_job]

    Data Engineer • San Francisco, CA, United States

    [internal_linking.related_jobs]
    Data Engineer (San Francisco)

    Data Engineer (San Francisco)

    Odiin. • San Francisco, CA, US
    [job_card.part_time]
    Youll work closely with engineering, analytics, and product teams to ensure data is accurate, accessible, and efficiently processed across the organization. Design, develop, and maintain scalable da...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer (San Francisco)

    Data Engineer (San Francisco)

    Midjourney • San Francisco, CA, United States
    [job_card.full_time]
    Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Baselayer • San Francisco, California, United States
    [job_card.full_time]
    Trusted by 2,200+ financial institutions, Baselayer is the intelligent business identity platform that helps verify any business, automate KYB, and monitor real-time risk.Baselayer’s B2B risk solut...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Alembic • San Francisco, California, United States
    [job_card.full_time]
    Alembic is where top engineers are solving marketing's hardest problem : proving what actually works.If you're looking for frontier technical challenges at an applied science company, this is the pl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Gallup • San Francisco, California, United States
    [job_card.full_time]
    Engineer data systems that change how people live and work.As a senior data engineer at Gallup, you’ll play a key role in designing, developing and optimizing the data systems that underpin our fla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    2025037 Senior Data Engineer

    2025037 Senior Data Engineer

    John Deere • San Francisco, California, United States
    [job_card.full_time]
    There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Data Lake & Governance

    Senior Data Engineer, Data Lake & Governance

    Gridware • San Francisco, CA, United States
    [job_card.full_time]
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Platform Engineer - Hybrid SF

    Senior Data Platform Engineer - Hybrid SF

    FATMAP • San Francisco, California, United States
    [job_card.full_time]
    A leading digital platform is seeking a senior software engineer to enhance its data platform in San Francisco.In this hybrid role, you will collaborate across teams, tackle data challenges, and de...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer (San Francisco)

    Lead Data Engineer (San Francisco)

    Mentor Talent Acquisition • San Francisco, CA, United States
    [job_card.full_time]
    Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Xscion • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting valu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Data Engineer (San Francisco Bay Area)

    AI Data Engineer (San Francisco Bay Area)

    HartleyCo • San Francisco Bay Area, US
    [job_card.part_time]
    Member of Technical Staff - AI Data Engineer.A high-growth, AI-native startup coming out of stealth is hiring AI Data Engineers to build the systems that power production-grade AI.The company has r...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer - Scientific Data Ingestion (San Francisco)

    Data Engineer - Scientific Data Ingestion (San Francisco)

    Mithrl • San Francisco, CA, US
    [job_card.part_time]
    We envision a world where novel drugs and therapies reach patients in months, not years, accelerating breakthroughs that save lives. Mithrl is building the worlds first commercially available AI Co-...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    PG Forsta • Emeryville, CA, United States
    [job_card.full_time]
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Together Ai • San Francisco, California, United States
    [job_card.full_time]
    Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems.A...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer (San Francisco)

    Data Engineer (San Francisco)

    Fluency • San Francisco, CA, United States
    [job_card.full_time]
    Fluency is enabling the autonomous Enterprise.You're needed to help pioneer a new software category that will change how enterprises work. Welcome to the data layer of the future.Fluency is looking ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Montiel Insight Search • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    Visa Sponsorship : Not available.An emerging AI infrastructure company backed by $15M in funding is looking for its first senior data professional to architect the systems driving their customer ins...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Checkr • San Francisco, California, United States
    [job_card.full_time]
    Checkr is building the data platform to power safe and fair decisions.Established in 2014, Checkr’s innovative technology and robust data platform help customers assess risk and ensure safety and c...[show_more]
    [last_updated.last_updated_30] • [promoted]