Data Engineer

Data Engineer Experience : 8 years of relevant experience Location : Chicago IL (Hybrid 3 days onsite per week)

Whats in it for you

Opportunity to work as a Strong Data Engineer with hands-on expertise in ETL development Python SQL and practical experience with PySpark Databricks AWS Terraform Angular and CI / CD tools .

Responsibilities :

Design develop and maintain ETL pipelines using Python PySpark and SQL

Perform large-scale data processing and transformation using Databricks

Work with AWS services including S3 CloudWatch IAM SNS and Lambda

Use Terraform for infrastructure provisioning and management

Support front-end integration tasks using Angular

Collaborate on source control through Git and manage deployments using Octopus and Azure DevOps

Basic exposure to Scala and HL7 standards is an added advantage

Educational Qualifications :

Engineering degree : BE / ME / BTech / MTech / BSc / MSc

Technical certifications across relevant technologies are preferred

Skills

Mandatory Skills :

Strong hands-on experience in Python PySpark and SQL

Front-end development experience with Angular

Experience with AWS services : S3 CloudWatch IAM SNS Lambda

Working knowledge of Terraform

Experience with Git Octopus and Azure DevOps for CI / CD processes

Good to Have Skills :

Experience with PySpark Databricks AWS Terraform and Angular

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1