Data Engineer

ComResource is looking for a Data Engineer.

We need someone to assist in developing and maintaining enterprise data pipelines while supporting high-priority initiatives that require scalable, accurate, and reliable data solutions.

Responsibilities:

• Design, build, test, and maintain scalable data pipelines and data management systems.
• Develop and optimize ETL processes using IBM DataStage, Snowflake, dbt, and MettleCI.
• Ensure data solutions adhere to governance standards and coding best practices.
• Perform unit testing, integration testing, and regression testing of data pipelines.
• Implement data validation and data quality frameworks.
• Integrate new data engineering tools and technologies into existing architectures.
• Develop data modeling and data mining processes to support analytics initiatives.
• Collaborate with solution architects, data scientists, and engineering teams.
• Identify opportunities to improve data quality, reliability, and performance.
• Maintain disaster recovery processes and ensure system resilience.

Essentials:

• Experience building and optimizing ETL pipelines using IBM DataStage, Snowflake, dbt, and MettleCI.
• Experience performing data pipeline testing, including unit, integration, and regression testing.
• Experience implementing data quality and validation frameworks.
• Strong understanding of data governance and coding standards.
• Strong attention to detail and ability to deliver high-quality data solutions.

Desired:

• Experience working with CI/CD pipelines for data engineering.
• Experience working on large enterprise data initiatives.
• Experience collaborating with data scientists and analytics teams.

Req ID: AM636465310