Data Engineer

JOB DESCRIPTION

Responsibilities :

Designing and developing data pipelines and data storage using cloud technologies using approved AWS technologies and services.

Data management for data in AWS GovCloud

Data migration for large programs such as migrating from Oracle, DB2.

Data mapping, ETL / ELT frame works, using streaming data processing

Developing data pipe lines using AWS technologies Aurora, DynamoDB, RedShift, S3, Glue, Lambda, etc.

Troubleshooting data related issues, helping testing team for data validation and partner with DevSecOps and external partners for releasing of software with appropriate documentation and controls

Proficient in database management best practices

Working experience in Agile development methodologies; SDLC

Working on complex projects crossing multiple platforms and diverse technologies

Data migration, database change management and data management through the stages of the development life cycle

Planning, estimating, performing, and tracking work related to systems development, systems process analysis, process design or process reengineering. Resolve system problems and provide options to determine optimal solution.

Designing and implementing solutions and architectural design patterns requiring complex technologies in an enterprise environment across multiple platforms.

Qualifications :

10+ years working on designing and developing data pipelines and data storage using cloud technologies

AWS experience including DynamoDB and Redshift. Tableau, SQL.

Experience with data migration for large programs such as migrating from Oracle, DB2.