Senior Software Engineer (Big Data)

Overview

What You’ll Achieve :

Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark.

Optimize and fine-tune Spark jobs for performance, including resource utilization, shuffling, partitioning, and caching, to ensure maximum efficiency in large-scale big data environments.

Design and implement scalable, fault-tolerant data pipelines with end-to-end monitoring, alerting, and logging.

Leverage AWS cloud services (2+ years preferred) to build and manage data pipelines and distributed processing workloads.

Develop and optimize SQL queries across relational and data warehouse systems (RDBMS / Data Warehouse).

Apply design patterns and best practices for efficient data modeling, partitioning, and distributed system performance.

Use Git (or equivalent) for source control and maintain strong unit and integration testing practices.

Collaborate with Product Owners, partners, and multi-functional teams to translate business requirements into technical solutions.

Demonstrate strong analytical skills with the ability to extract actionable insights from large datasets and support data-driven decision-making.

Mentor junior engineers, conduct code reviews, and contribute to establishing engineering best practices and standards.

Who You Are :

5+ years of software development experience in a scalable, distributed, or multi-node environment.

Proficient in programming with Scala, Python, or Java; comfortable building data-driven solutions at scale.

Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies.

Demonstrated experience with cloud platforms (AWS, preferred) and an interest in cloud migration projects.

Eager to deepen your expertise with the Databricks platform.

Exposure to modern data tools and frameworks such as Kubernetes, Docker, and Airflow.

Strong problem-solving skills with the ability to own problems end-to-end and deliver results.

Consultative mentality — comfortable taking initiative, building relationships, communicating broadly, and tackling challenges head-on.

Collaborative teammate with an eagerness to learn from peers and mentors while contributing to a culture of growth.

Motivated to grow your career within a dynamic, innovative company.

What you’ll bring :

BA / BS in Computer Science or related field.

At least 5 years of experience as a big data software developer.

Experience in Machine Learning, including model development, feature engineering, or integrating ML workflows into data pipelines.

Experience with Databricks, including Notebooks, Delta Lake, Jobs, Pipelines, and Unity Catalog, preferred.

Proficiency with the ELK stack (Elasticsearch, Logstash, Kibana) for real-time search, log analysis, and visualization, preferred.

AWS, Databricks, or Spark certification a plus.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision, 1 Voice. ()

Base Salary : $80,250 - $133,750

Actual compensation within the range will be dependent upon, but not limited to the individual’s skills, experience, qualifications, location and application employment laws. The salary pay range is subject to change and may be modified at any time.

The application deadline for this job posting is 1 / 6 / 2026.

Additional Information

When You Join Us, We’ll Create Something EPIC Together

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Epsilon has a core set of 5 values that define our culture and guide us to create value for our clients, our people and consumers. We are seeking candidates that align with our company values, demonstrate them and make them meaningful in their day-to-day work :

Act with integrity. We are transparent and have the courage to do the right thing.

Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.

Innovate with purpose. We shape the market with big ideas that drive big outcomes.

Respect all voices. We embrace differences and foster a culture of connection and belonging.

Empower with accountability. We trust each other to own and deliver on common goals.

Because You Matter

As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following :

Time to Recharge : Flexible time off (FTO), 15 paid holidays

Time to Recover : Paid sick time

Family Well-Being : Parental / new child leave, childcare & elder care assistance, adoption assistance

Extra Perks : Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.

Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants needing accommodations to complete the application process. Please reach out to LeaveofAbsence@epsilon.com to request an accommodation.

For San Francisco Bay and Los Angeles Areas : Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.

#LI-AM1