Talent.com
Senior Data Engineer
Senior Data EngineerxScion Solutions • San Francisco, CA, United States
Senior Data Engineer

Senior Data Engineer

xScion Solutions • San Francisco, CA, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Data Engineer

As an employee, you Turn Change Into Value - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location : Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will :

  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack
  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions
  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines
  • Develop and maintain scripts to automate batch jobs
  • Support and maintain existing applications, troubleshooting and resolving technical issues
  • Follow appropriate technical best practices and internal processes while complying with various information security controls
  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.

To Be Successful, You Need :

  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields
  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.
  • 7+ years of software development experience related to data engineering
  • Hands-on experience in Java, Python, or Scala with the ability to understand / write complex SQL queries
  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
  • Experience deploying software solutions to the cloud platform through CI / CD in a DevOps model
  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive
  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code
  • Experience working with Hadoop-based Big Data architecture and solutions.
  • Experience working in an Agile development environment using Agile tools like Jira or Rally.
  • Proficiency with UNIX commands and shell scripts.
  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.
  • Nice to have experience with RDBMS and data warehouses
  • Nice to have experience with Machine Learning technologies and data visualization tools
  • Why xScion?

  • We have an amazing culture We were named a Best Places to Work in Virginia 8 times, including 2025.
  • We are poised for rapid growth We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.
  • We believe in your continuous development We invest in our teams' development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.
  • We want you to make an impact in whatever you do Our people are given the opportunity to provide impactful change to our clients and team.
  • We believe in equality - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone's uniqueness makes us stronger.
  • Great Benefits : Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.
  • At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients' processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

    All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

    [job_alerts.create_a_job]

    Senior Data Engineer • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior Data Engineer, Analytics

    Senior Data Engineer, Analytics

    Discord • San Francisco, CA, United States
    [job_card.full_time]
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Azure Data Engineer — Data Lakes, Pipelines & Analytics

    Senior Azure Data Engineer — Data Lakes, Pipelines & Analytics

    Capgemini • San Francisco, CA, United States
    [job_card.full_time]
    A leading consulting firm in the United States is seeking a Software Engineer with extensive experience in Azure technologies. You will be responsible for technical delivery ownership, leading teams...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Platform Engineer - Real-Time Pipelines

    Senior Data Platform Engineer - Real-Time Pipelines

    Grammarly, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A tech company is seeking a Senior Engineer to join the Data Platform team in San Francisco.The role focuses on building a robust data platform, leading the development of scalable systems, and col...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Platform Engineer – Real-Time Big Data

    Senior Data Platform Engineer – Real-Time Big Data

    Poshmark, Inc. • Redwood City, CA, United States
    [job_card.full_time]
    A leading fashion resale marketplace is seeking a Sr.Software Engineer for Data Engineering in Redwood City, California.This role focuses on building a scalable big data platform to support real-ti...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Data Lake & Governance

    Senior Data Engineer, Data Lake & Governance

    Gridware • San Francisco, CA, United States
    [job_card.full_time]
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Analytics Platform Lead

    Senior Data Engineer, Analytics Platform Lead

    Meta • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology firm in San Francisco seeks a Data Engineering technical leader to drive data foundation initiatives. You will collaborate with Software Engineers and Data Scientists to optimiz...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer : Build Scalable Pipelines for Finance

    Senior Data Engineer : Build Scalable Pipelines for Finance

    Robinhood • Menlo Park, CA, United States
    [job_card.full_time]
    A financial technology company is seeking a Senior Data Engineer in Menlo Park, CA.You'll build and maintain data pipelines that drive decision-making within the company. Ideal candidates have 5+ ye...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Senior Data Engineer - Scalable Pipelines & Lakehouse

    Remote Senior Data Engineer - Scalable Pipelines & Lakehouse

    Recruiting From Scratch • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    An established industry player is seeking a talented Data Engineer to join their innovative team.In this role, you will be pivotal in building scalable and reliable data pipelines, optimizing stora...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Platform Data & AI Engineer

    Senior Platform Data & AI Engineer

    C3.ai, Inc. • Redwood City, CA, United States
    [job_card.full_time]
    A leading enterprise AI company in Redwood City, CA is seeking Senior Software Engineers to design and maintain a scalable AI / ML platform. Candidates should have strong coding skills in Java, C++, o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer

    Sr. Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer

    Capital One • San Francisco, CA, United States
    [job_card.full_time] +1
    Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our abilit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Principal Data Engineer - GTM Data Leader

    Senior Principal Data Engineer - GTM Data Leader

    Autodesk, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A global leader in software solutions is seeking a Senior Principal Data Engineer in San Francisco, CA.You will lead data engineering initiatives, transforming data into actionable insights in an i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer — Real-Time Big Data Pipelines

    Senior Data Engineer — Real-Time Big Data Pipelines

    Poshmark • Redwood City, CA, United States
    [job_card.full_time]
    A leading fashion resale marketplace is hiring a Sr.Software Engineer, Data Engineering to enhance their big data platform. The candidate will build scalable, fault-tolerant data processing systems ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Platform Engineer & Tech Leader

    Senior Data Platform Engineer & Tech Leader

    Early Warning Services LLC • San Francisco, CA, United States
    [job_card.full_time]
    A leading fintech company in San Francisco is seeking a Senior Technical Leader to manage data engineering solutions.This role involves defining data strategy, mentoring engineers, and driving arch...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Enterprise Data Platform Engineer

    Senior Enterprise Data Platform Engineer

    Monograph • San Francisco, CA, United States
    [job_card.full_time]
    A leading company focused on building data infrastructure is seeking a Data Platform professional to support enterprise customers and enhance their knowledge management systems.This role involves d...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Platform Engineer : Scale BillionEvent Pipelines

    Senior Data Platform Engineer : Scale BillionEvent Pipelines

    Superhuman Labs, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI productivity company is seeking a Senior Engineer for its Data Platform team in San Francisco.You will architect and develop systems for handling billions of daily events, ensuring sec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Platform Engineer — AI-Driven Systems

    Senior Data Platform Engineer — AI-Driven Systems

    Scale AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI technology firm in San Francisco is seeking an experienced Software Engineer to lead the design and development of core data platforms and systems. You will be responsible for collabora...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI & Data Platform Engineer

    Senior AI & Data Platform Engineer

    Icon Ventures • San Francisco, CA, United States
    [job_card.full_time]
    At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, includin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Platform Engineer — Scalable AWS Data Pipelines

    Senior Data Platform Engineer — Scalable AWS Data Pipelines

    Hayden AI Technologies, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A technology firm focused on computer vision seeks a Senior Software Engineer in San Francisco, California.This role involves developing and maintaining robust data systems using AWS technologies.C...[show_more]
    [last_updated.last_updated_30] • [promoted]