Data EngineerUnited IT Solutions • Scottsdale, AZ, United States
[error_messages.no_longer_accepting]
Data Engineer
United IT Solutions • Scottsdale, AZ, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Advanced level understanding of streaming data pipelines and how they differ from batch systems Formalize concepts of how to handle late data, defining windows, and data freshness Advanced understanding of ETL and ELT and ETL / ELT tools such as Data Migration Service etc Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc. Familiarity and / or expertise with Great Expectations or other data quality / data validation frameworks a bonus Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization) Indexing and partitioning strategy experience Debug, troubleshoot, design, and implement solutions to complex technical issues Experience with large-scale, high-performance enterprise big data application deployment and solution Architecture experience in AWS environment a bonus Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI / CD pipelines Experience working with AWS Lambdas for configuration and optimization and experience with S3 Familiarity with Schema Registry, and message formats such as Avro, ORC, etc. Ability to thrive in a team-based environment Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management
Must have : Skillset : Java, Scala, S3, Glue, aws , Redshift
6-8 years of IT experience focusing on enterprise data architecture and management.
- Experience in Conceptual / Logical / Physical Data Modeling & expertise in Relational and Dimensional Data Modeling
- Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
- Experience with Spark Scala and Java programming
- Data Lake concepts such as time travel and schema evolution and optimization
- Structured Streaming and Delta Live Tables with Databricks as a bonus
- Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data
mart build, and data lakes implementation / support
[job_alerts.create_a_job]
Data Engineer • Scottsdale, AZ, United States
[internal_linking.similar_jobs]
At Iron Mountain we know that work, when done well, makes a positive impact for our customers, our employees, and our planet.
That's why we need smart, committed people to join us.Whether you're loo...[show_more]
Please share relevant profiles as per attached JD.Google Cloud Big Data Engineer || 9190007, 9190008, 9190009 || Phoenix.
Contract to Hire || Rate : $60 / hr Max || Open for W2 + 1.NOTE : Pls share prof...[show_more]
Principal Engineer I - Senior Azure Databricks Administrator.As a Principal Engineer I embedded in the Enterprise Data & Analytics function, you will be responsible for delivery and operations of t...[show_more]
At Teradata, we believe that people thrive when empowered with better information.That's why we built the most complete cloud analytics and data platform for AI.
By delivering harmonized data, trust...[show_more]
Mandatory AWS services like S3 Athena Glue Kinesis and EMR.Design and implement scalable secure and highly available data architectures on AWS for AMOS applications.
Develop and maintain data pipeli...[show_more]
THIS ROLE IS HYBRID IN PHOENIX, AZ •.Job Title : GEN AI - BIG DATA ENGINEER.Prompt engineering, Model evaluation / optimization, Response quality.
Build data systems and pipelines.Evaluate business need...[show_more]
Location : Phoenix, AZ (Hybrid 3 days onsite).Experience Level 10 years of experience.Job Summary We are looking for a Data Architect This role requires a deep understanding of data architecture dat...[show_more]
The Customer Success Services team needs an AI Engineer that can design, develop, configure, evaluate, monitor and optimize generative AI and agent solutions for Oracle applications, as well as dev...[show_more]
Experience Required - 5+ Years.Must Have Technical / Functional Skills.Adobe Experience Platform (AEP) implementation and operations.
Proven expertise in Real-Time CDP (RT-CDP) configuration and profi...[show_more] Location : Preferred Work Location : Phoenix, AZ.We are seeking an experienced Senior Data Architect to modernize and optimize our existing data.
This includes large data volumes,.The role involves r...[show_more] 
The Integration Engineer II is responsible for orchestrating the seamless flow of data, ensuring efficient curation for ingestion into the Data Warehouse (DW), as well as extracting and transformin...[show_more]
Big Data Systems Engineer (Remote).Belong, Connect, Grow, with KBR!.KBR's National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in ...[show_more]
The Integration Engineer II is responsible for orchestrating the seamless flow of data, ensuring efficient curation for ingestion into the Data Warehouse (DW), as well as extracting and transformin...[show_more]
An SEI-er is a master communicator and active listener who understands how to navigate an audience.Self-aware, almost to a fault, SEI-ers keenly understand how to adjust their support and problem s...[show_more]
Job Title : Oracle Cloud Data Engineer.Location : Phoenix, AZ 85004 (Hybrid).We are seeking a hands-on Technology Lead with deep expertise in Oracle Cloud Infrastructure (OCI) data services and Power...[show_more]
Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts,Knowledge of Financial reporting ecosystem will be a plus.
Expert on Distributed ecosystem Hands-on experience with pro...[show_more]
Equal Opportunity Employer, is an IT consulting firm headquartered in Fremont, CA servicing clients nationwide.We provide services in IT, Telecom, Finance & Accounting and Engineering categories.Lo...[show_more]
The position is eligible for medical, dental, vision, and life insurance coverage, & PTO.The Senior Data Engineer is responsible for designing, building, and maintaining scalable data platforms tha...[show_more]
Global Strategic Design and Solutions Engineer Data Center- Mechanical
Iron Mountain Inc • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Google Cloud Big Data Engineer
CData Software • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Principal Engineer I - Senior Azure Databricks Administrator
Western Alliance Bank • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Teradata • Phoenix, AZ, United States
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
AWS-Data Architect
Kaav Inc. • Scottsdale, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
GEN AI - BIG DATA ENGINEER
Keylent Inc • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AWS Data Architect
Futran Tech Solutions Pvt. Ltd. • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Oracle • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AEP Engineer
TEPHRA • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Big Data Architect
United IT Solutions • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Integration Engineer II-ST
SwitchThink Solutions • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Big Data Systems Engineer (Remote)
KBR • Phoenix, AZ, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Integration Engineer II-ST
Desert Financial Credit Union • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data and Analytics Consultant
SEI • Phoenix, AZ, United States
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
Oracle Cloud Data Engineer
eTeam • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Big Data Engineer (Java or Python)
Purple Drive • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Immediate Hiring for Big Data Engineer Phoenix, AZ (On-site)
Northern Base • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer
Addison Group • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]