Talent.com
Data Engineer - AWS, Snowflake, Python
Data Engineer - AWS, Snowflake, PythonIntraEdge • Chandler, AZ
Data Engineer - AWS, Snowflake, Python

Data Engineer - AWS, Snowflake, Python

IntraEdge • Chandler, AZ
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Job Requirements The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
[job_alerts.create_a_job]

Data Engineer - AWS, Snowflake, Python • Chandler, AZ

[internal_linking.similar_jobs]

AWS Sales Engineer - Data & AI

AccentureScottsdale, AZ, United States
[job_card.full_time]

Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accel...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

TechDigital CorporationPhoenix, AZ, United States
[job_card.full_time]

Design, develop, and maintain scalable data pipelines and ETL processes using Python, Spark.Good knowledge with client data ecosystems (Cornerstone and Lumi).Genesys WFM data knowledge is a plus.Kn...[internal_linking.show_more]

 • [job_card.promoted]

AWS cloud Engineer (UI)

Purple DrivePhoenix, AZ, United States
[job_card.full_time]

AWS cloud Engineer who has extensive experience in developing and deploying cloud services for applications.Terraform experience is preferred.Must have UI (react js) experience as the application i...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer (DE) - US

Zortech SolutionsScottsdale, AZ, United States
[job_card.full_time]

Location: Scottsdale AZ (day 1 onsite).Must have skill set: Java , Scala , Python, Spark, S3, Glue, Redshift.You have 6-8 years of relevant software development experience.You have hands-on experie...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

VeracityPhoenix, AZ, United States
[job_card.full_time]

We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives.The successful can...[internal_linking.show_more]

 • [job_card.promoted]

Senior Data Engineer

St. George Tanaq CorporationPhoenix, AZ, United States
[job_card.full_time]

Tanaq Technical Services (TTS), a division of St.George Tanaq (SGT) Corporation, is an 8(a) Alaskan Native Small Business that specializes in delivering Enterprise Integrated Technology Solutions a...[internal_linking.show_more]

 • [job_card.promoted]

GCP Engineer

The Judge GroupPhoenix, AZ, United States
[job_card.full_time]

The ideal candidate will have a deep understanding of distributed data processing, performance optimization, and cloud-native architecture.Design and implement end-to-end data pipelines and ETL pro...[internal_linking.show_more]

 • [job_card.promoted]

AWS & Azure Cloud Architect

TEKsystemsChandler, AZ, United States
[job_card.full_time]

The Cloud Identity Engineer will be responsible for leading and participating in design, implementation, and maintenance of critical Cloud Identity systems.This role involves leading and participat...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Veterans Sourcing Group LLCScottsdale, AZ, United States
[job_card.full_time]

Location: Phoenix, AZ (Hybrid).Solid experience with Database design practices and data warehousing concepts.Design, develop, and maintain data pipelines and ETL processes to extract, transform, an...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer II

Early Warning ServicesScottsdale, AZ, United States
[job_card.full_time]

At Early Warning, we've powered and protected the U.As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hu...[internal_linking.show_more]

 • [job_card.promoted]

Consultant, Data Engineer

IBMPhoenix, AZ, United States
[job_card.full_time]

At IBM, work is more than a job - it's a calling: To build.To think along with clients and sell.Not just to do something better, but to attempt things you've never thought possible.Are you ready to...[internal_linking.show_more]

 • [job_card.promoted]

Cloud Platform Engineer (AWS)

Eliassen GroupPhoenix, AZ, United States
[job_card.full_time]

Our client is seeking a mid-level AWS Platform Engineer to design, build, and operate secure, scalable cloud infrastructure on AWS.The role focuses on developing reusable infrastructure patterns, a...[internal_linking.show_more]

 • [job_card.promoted]

GCP Data Engineer | ONSITE - Phoenix, AZ

Kaav Inc.Phoenix, AZ, United States
[job_card.full_time]

Working knowledge on Big Query.Hands on experience on Dataproc Javapython programming language.Good to have ComposerAirflow experience.Good team player communicator can operate independently with m...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

ATS StaffingPhoenix, AZ, United States
[job_card.full_time]

On-site Role in Phoenix, AZ - US Citizenship or Green Card Required.Not eligible for OPT or visa sponsorship.Our client is a fast-growing global software company with 4,000 employees and a 27-year ...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

RIT SolutionsPhoenix, AZ, United States
[job_card.full_time]

Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one.Data Engineers will be data mining, writing code, and creating tables/environments in S3.SQL, Pytho...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

InterSourcesPhoenix, AZ, United States
[job_card.full_time]

Experience in SQL, Big Data Hive Pyspark, GCP, Tableau Power BI, Data Modelling.Unix Scripting Github Actions Github Enterprise, Jenkins Hands on experience with application design, software develo...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

SARIAN CoPhoenix, AZ, United States
[job_card.full_time]

Strong proficiency in SQL and database technologies.Familiarity with data warehousing and data modelling concepts.Hands-on experience with Google Cloud Platform (GCP) tools such as Big Query, Cloud...[internal_linking.show_more]

 • [job_card.promoted]

GenAI Python Systems Engineer -Senior Manager

PwCPhoenix, AZ, United States
[job_card.full_time]

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients.They play a crucial role in tra...[internal_linking.show_more]