Talent.com
Staff Data Engineer
Staff Data EngineerPayJoy • San Francisco, CA, United States
Staff Data Engineer

Staff Data Engineer

PayJoy • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Staff Data Engineer

PayJoy is a mission-first credit provider dedicated to helping under-served customers in emerging markets to achieve financial stability and success. Our patented technology for secured credit provides an on-ramp for new customers to enter the credit system. Through PayJoy's point-of-sale financing and credit cards, customers gain access to a modern quality of life. PayJoy's credit also allows our customers to seize opportunities as micro-entrepreneurs, and provide safety acts as insurance for tough times. Through our cutting-edge machine learning, data science, and anti-fraud AI, we have served over 18 million customers as of 2025 while achieving solid profitability for sustainable growth.

The Staff Data Engineer is responsible for ensuring that the organization has reliable, accessible, and well-organized data by designing and maintaining systems that process information in real time and in batches, defining a data strategy aligned with business goals, ensuring data quality and security, optimizing database performance, automating processes to increase efficiency, overseeing monitoring and rapid issue resolution, and providing leadership and guidance to other teams to ensure best practices in data usage and management.

Responsibilities

  • Architect and build data pipelines : Build, optimize, and maintain reliable, scalable, and efficient data pipelines for both batch and real-time data processing.
  • Data Strategy : Develop and maintain a data strategy aligned with business objectives, ensuring data infrastructure supports current and future needs.
  • Streaming Expertise : Lead the development of real-time ingestion pipelines using Kafka / Kinesis, and design data models optimized for streaming workloads.
  • Data Quality & Governance : Implement data quality checks, schema evolution, lineage tracking, and compliance using tools like Unity Catalog and Delta Lake etc.
  • Tool & Technology Selection : Evaluate and implement the latest data engineering tools and technologies that will best serve our needs, balancing innovation with practicality.
  • Automation and CI / CD : Drive automation of pipeline deployments, testing and monitoring using Terraform, CircleCi or similar tools.
  • Performance Tuning : Regularly review, refine, and optimize SQL queries across different systems to maintain peak performance. Identify and address bottlenecks, query performance issues, and resource utilization. Setup best practices and work with developers on education of what they should be doing in the software development lifecycle to ensure optimal performance.
  • Database Administration : Manage and maintain production AWS RDS MySQL, Aurora and postgres databases. Perform routine database operations, including backups, restores, and disaster recovery planning. Monitor database health, diagnose and resolve issues in a timely manner.
  • Knowledge and Training : Serve as the primary point of contact for database performance and usage related knowledge, providing guidance, training, and expertise to other teams and stakeholders.
  • Monitoring & Troubleshooting : Implement monitoring solutions to ensure high availability and troubleshoot data pipeline issues in real-time.
  • Documentation : Maintain comprehensive documentation of systems, pipelines, and processes for easy onboarding and collaboration.
  • Mentorship & Leadership : Mentor other engineers, review PRs, and establish best practices in data engineering.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • 12+ years of experience in data engineering, with at least 3+ years working in Databricks.
  • Deep hands-on experience with Apache Spark (PySpark / SQL), Delta Lake, and Structured Streaming.
  • Technical Expertise : Deep understanding of data engineering concepts, including ETL / ELT processes, data warehousing, big data technologies, and cloud platforms (e.g., AWS, Azure, GCP).
  • Strong proficiency in Python, SQL, and data modeling for both OLTP and OLAP systems.
  • Architectural Knowledge : Strong experience in designing and implementing data architectures, including real-time data processing, data lakes, and data warehouses.
  • Tool Proficiency : Hands-on experience with data engineering tools such as Apache Spark, Kafka, Databricks, Airflow, and modern data orchestration frameworks.
  • Innovation Mindset : A track record of implementing innovative solutions and reimagining data engineering practices.
  • Experience with Databricks Workflows, Delta Live Tables (DLT), and Unity Catalog.
  • Familiarity with stream processing patterns (exactly-once semantics, watermarking, checkpointing)
  • Benefits

  • 100% company-funded health, dental, and vision insurance for employee and immediate family
  • Company-funded employee life and disability insurance
  • 3% employer 401k contribution
  • Company holidays; 20 days vacations; flexible sick leave
  • Headphone, home office equipment and wellness perks.
  • $2,000 USD annual Co-working Travel perk
  • $2,000 USD annual Professional Development perk
  • Commuter benefit
  • $270,932 - $304,288 a year

    PayJoy is proud to be an Equal Employment Opportunity employer and we welcome and encourage people of all backgrounds. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

    Finance for the next billion

  • Ownership
  • Break Through Walls
  • Live Communication
  • Transparency & Directness
  • Focus on Scale
  • Work-Life Balance
  • Embrace Diversity
  • Speed
  • Active Listening
  • [job_alerts.create_a_job]

    Staff Data Engineer • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Staff Data Engineer, Ads

    Staff Data Engineer, Ads

    Discord • San Francisco, CA, United States
    [job_card.full_time]
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Software Engineer – Foundational Data Systems for AI

    Staff Software Engineer – Foundational Data Systems for AI

    Granica • San Francisco, CA, United States
    [job_card.full_time]
    Staff Software Engineer – Foundational Data Systems for AI.Granica is an AI research and systems company building the infrastructure for a new kind of intelligence : one that is structured, efficien...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Engineer

    Staff Engineer

    daydream • San Francisco, CA, United States
    [job_card.full_time]
    At daydream, we’re building the future of growth marketing.Our mission is simple : companies should pay for outcomes, not tools. To make that real, we’ve built a vertically integrated software and se...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Staff Software Engineer | Data Acquisition

    Sr. Staff Software Engineer | Data Acquisition

    WEX, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    This is a remote position; however, the candidate must reside within 30 miles of one of the following locations : Portland, ME. Boston, MA; Chicago, IL; San Francisco Bay Area, CA; and Seattle / WA.As...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Cloud Engineer

    Staff Cloud Engineer

    Altana AI • San Francisco, CA, United States
    [job_card.full_time]
    AI can be a powerful tool for good in the world – at Altana we apply AI to the world’s largest organized body of supply chain data to power a more resilient, more secure, and more sustainable model...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Software Engineer, TLM, Eval Data Platform

    Staff Software Engineer, TLM, Eval Data Platform

    Waymo • San Francisco, CA, United States
    [job_card.full_time]
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Engineer

    Staff Engineer

    ERRG • San Francisco, CA, United States
    [job_card.full_time]
    At ERRG, we believe that each of our فض projects are significant and the most critical ingredient for success is our people. Our people provide the talent, experience, and passion that lies at the h...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Staff Data Engineer – Ads Platform

    Senior Staff Data Engineer – Ads Platform

    Blizzard Entertainment • San Francisco, CA, United States
    [job_card.full_time]
    A leading gaming company in San Francisco is seeking a Senior Staff Software Engineer (Data) to develop cutting-edge mobile advertising technologies. This role involves designing data pipelines, col...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Data Engineer

    Staff Data Engineer

    Recruiting From Scratch • San Francisco, CA, United States
    [job_card.full_time]
    Recruiting from Scratch is a talent firm that focuses on placing the best candidate for our clients.Our team is 100% remote and we work with teams across North America, South America, and Europe to...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Software Engineer - Data Platform

    Staff Software Engineer - Data Platform

    Hive • San Francisco, CA, United States
    [job_card.full_time]
    Every day, we process data from millions of KM from 10s of thousands of high resolution sensors deployed around the world. A symphony of different Sensor Fusion, ML, AI, and 3D Sensing processes are...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Data Engineer, Remote-First Energy AI Platform

    Staff Data Engineer, Remote-First Energy AI Platform

    Equilibrium Energy • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading clean energy startup in San Francisco is looking for a Staff / Sr Staff Software Engineer specializing in Data Engineering. You'll shape long-term data architecture and lead impactful data i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Engineer

    Staff Engineer

    daydream, inc. • San Francisco, CA, United States
    [job_card.full_time]
    At daydream, we’re building the future of growth marketing.Our mission is simple : companies should pay for outcomes, not tools. To make that real, we’ve built a vertically integrated software and se...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Machine Learning Data Engineer

    Staff Machine Learning Data Engineer

    Backflip AI • San Francisco, CA, United States
    [job_card.full_time]
    Staff Machine Learning Data Engineer.Join to apply for the Staff Machine Learning Data Engineer role at Backflip AI.Mechanical design, the work done in CAD, is the rate‑limiter for progress in the ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Engineer, AI-First Revenue Platform

    Staff Engineer, AI-First Revenue Platform

    Hiring Hub • San Francisco, CA, United States
    [job_card.full_time]
    A forward-looking tech company is seeking a Staff Engineer for its AI-first revenue platform.The role focuses on building a context and orchestration layer to enhance decision-making through data i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Data Engineer

    Staff Data Engineer

    Imprint • San Francisco, CA, United States
    [job_card.full_time]
    Imprint is reimagining co-branded credit cards & financial products to be smarter, more rewarding, and truly brand-first. We partner with companies like Rakuten, Booking.H-E-B, Fetch, and Brooks Bro...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Engineer, Identity

    Staff Engineer, Identity

    Postman • San Francisco, CA, United States
    [job_card.full_time]
    Postman is the world’s leading API platform, used by more than 45 million+ developers and 500,000 organizations, including 98% of the Fortune 500. Postman is helping developers and professionals acr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Software Engineer, Data

    Staff Software Engineer, Data

    Sift Stack, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    At Sift, we’re redefining how modern machines are built, tested, and operated.Our platform gives engineers real-time observability over high-frequency telemetry—eliminating bottlenecks and enabling...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff AI Platform Engineer

    Staff AI Platform Engineer

    BetterCloud • San Francisco, CA, United States
    [job_card.full_time]
    The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making.With market intelligence and search built on proven AI, AlphaSense delivers insights that matt...[show_more]
    [last_updated.last_updated_30] • [promoted]