Data Engineer

Data Engineer

Through our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You have an opportunity to personally thrive, make a difference and be part of a culture where individuality is noticed and valued every day.

As a Data Engineer, you'll play an integral role in building the roadmap of the company's technology strategy.

Responsibilities

Engineer robust Azure data factory pipelines using Linked Services / Datasets to ingest high volume, diverse data from disparate source systems into Azure BLOB storage.

Design and implementation of scalable data pipelines using Azure Databricks and Azure Data factory, adhering to Medallion architecture principles to ensure data integrity, consistency, and performance.

Develop complex and advanced transformation logic using PySpark (Python), user-defined functions (UDFs) within Azure Databricks to design and implement data processing and ETL workflow, enabling efficient transformation of heterogeneous source data into an integrated advanced Benefit and Eligibility system.

Creating modular and reusable notebooks in Azure Databricks utilizing functions, parameters, widgets for dynamic data processing and various python libraries such Panda, numpy, Pyspark SQL, SQL alchemy etc.

Developing highly optimized Databrick notebooks using PySpark (Python & SQL) for advanced data joining, data filtering, pre-aggregation, and processing of large data sets.

Working with SQL Server and Oracle, writing optimized queries with CTEs, ANSI SQL, window functions, Views, materialized Views, stored procedures and Oracle-specific syntax to perform data profiling, validation, balancing, reconciliation to ensure data accuracy (data quality) and data completeness.

Solving complex data engineering challenges including Delta merge for hundreds of millions of records, deduplication, performance tuning, and improving ETL run time efficiency using partitioning strategies, Z-Ordering etc.

Closely working with Client and Business analysts to define and assess complex data conversion and data integration requirements, translating business needs into technical solutions.

Requirements

Bachelors Degree in Computer Science or related field.

Total experience 10+ as data analyst / engineer.

Federal government or State level experience.

2 years experience in Health and Huma Services programs (SNAP and TANF).

Flexible Working

At Conduent, we want you to be yourself. We recognize that everyone is different and that how people want to work and deliver at their best is different for everyone too. In this role, you can expect the following working conditions :

Remote work : Enjoy the convenience of working from home and maximize your time by unplugging at the end of your workday.

Working For You

Perks and rewards designed for you :

Career Growth Opportunities : We help you thrive, so together, we can grow. We provide opportunities to advance your career with a vast portfolio of businesses and a global footprint.

Great Work Environment : We are proud of our award-winning culture and the recognition we've received for our diversity efforts.

Join Us

At Conduent, we are one team, one mission. We understand that our success is directly related to the success of our associates. We strive to create a culture where you can :

Bring your authentic self to work.

Grow and thrive, both personally and professionally.

Make a difference with our clients, in our communities, and with the millions of people we support.

When you join Conduent, you are engaged in creating the future - both our company's and your own. With more than 60,000 associates across 24 countries, we will provide you the opportunity to grow with a team of people who will challenge and inspire you to be the best!

Pay Transparency Laws in some locations require disclosure of compensation-related information. For this position, actual salaries will vary and may be above or below the range based on various factors including but not limited to location, experience, and performance. In addition to base pay, this position, based on business need, may be eligible for a bonus or incentive. In addition, Conduent provides a variety of benefits to employees including health insurance coverage, voluntary dental and vision programs, life and disability insurance, a retirement savings plan, paid holidays, and paid time off (PTO) or vacation or sick time.

The estimated salary range for this role is $96,250 - $125,000.

Conduent is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, creed, religion, ancestry, national origin, age, gender identity, gender expression, sex / gender, marital status, sexual orientation, physical or mental disability, medical condition, use of a guide dog or service animal, military / veteran status, citizenship status, basis of genetic information, or any other group protected by law.