Talent.com
IntraEdge
Data Engineer - AWS, Snowflake, PythonIntraEdge • Chandler, AZ
Data Engineer - AWS, Snowflake, Python

Data Engineer - AWS, Snowflake, Python

IntraEdge • Chandler, AZ
30+ days ago
Job type
  • Full-time
Job description

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Job Requirements The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Create a job alert for this search

Data Engineer - AWS, Snowflake, Python • Chandler, AZ

Similar jobs

Senior Software Engineer - Data Platform

CoinbasePhoenix, AZ, United States
Full-time

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.It’s a massive, ambitious opportunity that demands the best of us, ... Show more

 • Promoted

Senior AI-Native Platform Engineer

Jobs via DiceTempe, AZ, United States
Full-time

Jobs via Dice is seeking a software engineer in Tempe, Arizona to build AI-enabled applications and secure API integrations.This role requires 4+ years of experience in software engineering, with a... Show more

 • Promoted

Azure Snowflake Architect - Lead Data Platform (Hybrid)

NucleusTeqPhoenix, AZ, United States
Full-time

A leading tech company is looking for a Snowflake Solutions Architect to design and implement an enterprise Snowflake Data Platform on Azure.The role involves architecting multi-zone data layers an... Show more

 • Promoted

Senior Data & Analytics Architect

Davis Technology ManagementPhoenix, AZ, United States
Full-time

Davis Technology Management is seeking a senior-level Software Architect specialized in Data & Analytics to design and implement a modern enterprise analytics platform.This strategic role involves ... Show more

 • Promoted

Senior Data Platform Engineer — Scalable Pipelines (Remote)

CoinbasePhoenix, AZ, United States
Remote
Full-time

A leading cryptocurrency exchange in Phoenix, Arizona, seeks a Software Engineer for its Data Platform team.The role involves designing and maintaining scalable data services and applications to fa... Show more

 • Promoted

Sr. Data Engineer – Azure

INSPYR SolutionsScottsdale, AZ, United States
Full-time +1

Work Requirements: US Citizen, GC Holders or Authorized to Work in US.If interested, please contact Margot Parsons at mparsons@inspyrsolutions.We are seeking a highly skilled and motivated Senior D... Show more

 • Promoted

Data Technology Manager: Lead Data Engineers & Analytics

PetSmart Store Support Group, Inc.Phoenix, AZ, United States
Full-time

PetSmart Store Support Group, Inc.Manager – Data Technology to lead the Data Technology team at their Phoenix Home Office.The role demands strong leadership and operational execution, ensuring succ... Show more

 • Promoted

Senior Backend Engineer: APIs, Microservices & AWS

FutureRecruit.netScottsdale, AZ, United States
Full-time

An emerging technology firm in Scottsdale, Arizona is seeking a Software Engineer to design and develop back-end services and APIs in a fast-paced environment.Candidates should have at least 3 year... Show more

 • Promoted

Principal AI Solutions Engineer

Bausch + LombPhoenix, AZ, United States
Full-time

The Principal AI Solutions Engineer is a hands‑on individual contributor responsible for designing, building, and deploying production‑ready AI solutions, with a strong focus on AI agents that reas... Show more

 • Promoted

Remote Full-Stack Data-Driven Engineer (Java/Vue)

PearsonPhoenix, AZ, United States
Remote
Full-time

Pearson is seeking a Software Engineer (Full Stack) to work on data-intensive applications.The role emphasizes developing backend services with Java and creating modern user interfaces with Vue.Can... Show more

 • Promoted

Hybrid Cloud Software Engineer - Microservices & AWS

Siemens AGTempe, AZ, United States
Full-time

A leading technology company is seeking a Senior Software Engineer in Tempe, AZ.The role involves product definition, project management, and transforming existing products into modularized microse... Show more

 • Promoted

Senior Software Engineer II (TASER Data Science)

AxonScottsdale, AZ, United States
Full-time

Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life.We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud sof... Show more

 • Promoted

Lead Cloud Platform Engineer - Azure & AI

Wolters KluwerPhoenix, AZ, United States
Full-time

Wolters Kluwer is seeking a Lead Product Software Engineer - Cloud Operations in Phoenix, Arizona.This role focuses on owning the cloud infrastructure and operations for AI products.Responsibilitie... Show more

 • Promoted

Sr Enterprise Cloud Architect – AWS Governance, Standards & FinOps

Western Governors UniversityPhoenix, AZ, United States
Full-time +1

Sr Enterprise Cloud Architect – AWS Governance, Standards & FinOps.Apply locations Salt Lake City, UT Phoenix, AZ time type Full time posted on Posted 6 Days Ago time left to apply End Date: Februa... Show more

 • Promoted

Senior Azure Data Engineer - Scalable Pipelines & Analytics

INSPYR SolutionsScottsdale, AZ, United States
Full-time

A technology solutions provider is looking for a Senior Data Engineer to lead the design and optimization of data solutions in a cloud-forward environment.This role requires expertise in Azure Data... Show more

 • Promoted

Senior AWS Mid-Market Architect: Cloud & AI Solutions

AccentureScottsdale, AZ, United States
Full-time

A leading consulting firm is seeking an experienced AWS Cloud Architect to design reusable Enterprise Cloud Architecture and AI solutions.In this role, you'll lead project delivery while providing ... Show more

 • Promoted

Senior Edge AI Software Engineer SaaS/Cloud

Microchip Technology IncChandler, AZ, United States
Full-time

A leading technology company in Chandler, Arizona is seeking an experienced software engineer to develop applications for their Edge AI Development platform.The ideal candidate will have strong sof... Show more

 • Promoted

Senior Python/Django Engineer - Remote-friendly & Impactful

ATGPhoenix, AZ, United States
Remote
Full-time

A leading technology firm is looking for a Senior Software Engineer with expertise in Python Django to develop scalable web applications and APIs.This role offers the opportunity to collaborate wit... Show more

 • Promoted

AI Data Architect: Lakehouse & AI Pipelines Lead

InsightChandler, AZ, United States
Full-time

A technology solutions integrator is seeking an AI Data Architect to maintain and manage data lakehouse architecture.This role requires a strong background in data engineering, particularly with Da... Show more

 • Promoted

Remote-First Solutions Architect: Enterprise Data Platforms Lead

JobotPhoenix, AZ, United States
Remote
Full-time

Jobot is looking for a Solutions Architect in Phoenix, Arizona to optimize enterprise cloud data platforms.You will design and implement platforms across Snowflake, AWS, and Azure, lead migrations,... Show more