Talent.com
Senior Data Engineer
Senior Data EngineerXscion • San Francisco, California, United States
Senior Data Engineer

Senior Data Engineer

Xscion • San Francisco, California, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location : Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will :

  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack
  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions
  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines
  • Develop and maintain scripts to automate batch jobs
  • Support and maintain existing applications, troubleshooting and resolving technical issues
  • Follow appropriate technical best practices and internal processes while complying with various information security controls
  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.

To Be Successful, You Need :

  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields
  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.
  • 7+ years of software development experience related to data engineering
  • Hands-on experience in Java, Python, or Scala with the ability to understand / write complex SQL queries
  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
  • Experience deploying software solutions to the cloud platform through CI / CD in a DevOps model
  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive
  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code
  • Experience working with Hadoop-based Big Data architecture and solutions.
  • Experience working in an Agile development environment using Agile tools like Jira or Rally.
  • Proficiency with UNIX commands and shell scripts.
  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.
  • Nice to have experience with RDBMS and data warehouses
  • Nice to have experience with Machine Learning technologies and data visualization tools
  • Why xScion?

  • We have an amazing culture – We were named a   Best Places to Work in Virginia 8 times, including 2025.
  • We are poised for rapid growth – We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.
  • We believe in your continuous development – We invest in our teams’ development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.
  • We want you to make an impact in whatever you do – Our people are given the opportunity to provide impactful change to our clients and team.
  • We believe in equality   - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone’s uniqueness makes us stronger.
  • Great Benefits : Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.
  • We’re Transforming RegTech Organizations :

    At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients’ processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

    All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

    You will be added to our talent community when you apply to this job. You may opt out at any time.

    Want to Learn More about xScion?

    Check us out on www.xscion.com  or socially at  LinkedIn ,  Twitter  and  Glassdoor .

    [job_alerts.create_a_job]

    Senior Data Engineer • San Francisco, California, United States

    [internal_linking.related_jobs]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Gallup • San Francisco, California, United States
    [job_card.full_time]
    Engineer data systems that change how people live and work.As a senior data engineer at Gallup, you’ll play a key role in designing, developing and optimizing the data systems that underpin our fla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Sigmaways Inc • Alameda, CA, United States
    [job_card.full_time]
    If you’re hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you. As a Senior Data Engineer, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Alembic • San Francisco, California, United States
    [job_card.full_time]
    Alembic is where top engineers are solving marketing's hardest problem : proving what actually works.If you're looking for frontier technical challenges at an applied science company, this is the pl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer Snowflake

    Senior Data Engineer Snowflake

    Match Point Solutions • Oakland, California, USA
    [job_card.full_time]
    MatchPoint Solutions is a fast-growing young energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber Robinhood Netfl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    2025037 Senior Data Engineer

    2025037 Senior Data Engineer

    John Deere • San Francisco, California, United States
    [job_card.full_time]
    There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer, Data Lake & Governance

    Senior Data Engineer, Data Lake & Governance

    Gridware • San Francisco, CA, United States
    [job_card.full_time]
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer, Analytics

    Senior Data Engineer, Analytics

    Scribe • San Francisco, California, United States
    [job_card.full_time]
    We're looking for a data engineer with deep experience in analytics engineering and BI development to build the data infrastructure that powers decision-making across Scribe's 5M+ users and Fortune...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer (1043)

    Senior Data Engineer (1043)

    City and County of San Francisco • San Francisco, California, USA
    [job_card.full_time]
    DataSF is seeking a Senior Data Engineer with 3 years of experience to join our growing team.Reporting to the Principal Data Engineer you will be instrumental in designing building and maintaining ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    EDO • San Francisco, California, USA
    [job_card.full_time]
    EDO is the TV outcomes company.Our leading measurement platform connects convergent TV airings to the ad-driven consumer behaviors most predictive of future sales. EDO empowers the advertising indus...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Chartmetric • San Mateo, California, United States
    [job_card.full_time]
    Build and optimize ETL pipelines processing data for 10M+ artists, 100M+ tracks, 15M+ playlists, and comprehensive music industry metrics. Design scalable data ingestion systems to integrate emergin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Together Ai • San Francisco, California, United States
    [job_card.full_time]
    Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems.A...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    PG Forsta • Emeryville, CA, United States
    [job_card.full_time]
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Tendo • San Francisco, California, United States
    [job_card.full_time]
    As a Senior Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related da...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI & Data Platform Engineer

    Senior AI & Data Platform Engineer

    Quizlet • San Francisco, California, USA
    [job_card.full_time]
    At Quizlet our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B learning platform serves tens of millions of students every month including t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Checkr • San Francisco, California, United States
    [job_card.full_time]
    Checkr is building the data platform to power safe and fair decisions.Established in 2014, Checkr’s innovative technology and robust data platform help customers assess risk and ensure safety and c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Montiel Insight Search • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    Visa Sponsorship : Not available.An emerging AI infrastructure company backed by $15M in funding is looking for its first senior data professional to architect the systems driving their customer ins...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Lead Data Engineer - R01557349

    Senior Lead Data Engineer - R01557349

    Brillio • San Francisco, California, United States
    [job_card.full_time]
    Architect, construct, test and maintain ELT pipelines using Hadoop and Spark SQL.Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL. Manage and optimize the infrastruc...[show_more]
    [last_updated.last_updated_30] • [promoted]