Big Data Engineer

A company is looking for a Big Data Engineer to lead the development of scalable data solutions in a cloud-native environment.

Key Responsibilities

Create and maintain programs in Python, Spark, Perl, Shell Scripting, and C for data processing

Collaborate with cross-functional teams to understand data requirements and ensure data quality and governance

Mentor junior engineers and drive performance tuning and automation of data workflows

Required Qualifications

Bachelor's degree or equivalent in computer science

Minimum 5 years of experience in Python, Perl, and C programming languages

Good understanding of Spark and pySpark

Familiarity with databases such as Hive, Postgres, or Oracle

Experience with scheduling tools such as Airflow or Control-M