Senior Data EngineerMSR Technology Group • Scottsdale, AZ, US

Senior Data Engineer

MSR Technology Group • Scottsdale, AZ, US

[job_card.30_days_ago]

[job_preview.job_type]

[job_card.permanent]

[job_card.job_description]

Job Description

Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies.

Essential Duties and Responsibilities:

Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership.
Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data warehouse and distributed analytic systems running in the cloud.
Leads side-by-side design sessions with our business experts and engineers to understand our product and business to design, socialize, and implement proper conceptual, logical and physical data models.
Spearheads efforts with multiple, disparate, data providers, as well as downstream consumers, to engineer efficient, tracable, and fault tolerant, batch and streaming, data pipelines to that support complex analytical analysis and enterprise-wide Business Intelligence applications
In collaoration with our Data Science team, lead efforts to develop and implement production grade code/pipelines, in laguages including Python, leveraging advanced statistical routines, Machine Learning and other AI technologies.
Responsible for oversight and improvements on approaches to monitor and support data quality automation efforts. Working along side QA Engineering, implement quality check routines as part of data processing frameworks and validates flow of information.
Drives engineering efforts for Data Warehouse and Big Data infrastructure needs, including but not limited to, automation of system builds, security requirements, performance requirements and logging/monitoring in collaboration with DevOps engineers
Resolves escalated issues related to complex data anomolies and performance. In addition, implements adjustments, conducts after action reviews to determine root cause/corrective measures, and ensures knowledge transfer to operations support team.
Provides mentorship and guidance to help guide and grow the technical depth of junior Data Engineers and across the BI & Analytics team.
Ensures documentation is complete and up to date with regard to standards, best practices and technical specifications.
Leads design and code review sessions and provides feedback and mentorship to peers.
Educates the BI & Analytics team on the latest industry technologies, trends and strategies; Provides thought leadership around approaches, patterns and best practices in the Data Engineering domain.
Assists employees, vendors or other customers by answering questions related to Data Warehousing and Big Data processes, procedures and services
Collaborate with data team, product owners, Scrum-master to refine and estimate stories/epics to deliver on commitments on time and with high quality while providing exceptional customer service
Provides Tier 3 support and create run books to mentor Tier 1 and Tier 2 support staff
Other duties as assigned

Background & Experience Required:

This position requires a minimum of 10 years of progressive database development and integration experience.
Demonstrated experience in designing and implementing large-scale logical and physical data model with expert knowledge of Kimball methodologies.
Demonstrated advanced/expert level experience in multiple relational (RDMS) and non-relational (NoSQL) data platforms is required.
Demonstrated advanced experience in SQL tuning, indexing, distribution, partitioning, data access patterns and scaling strategies is required.
Demonstrated advanced scripting knowledge with Jupyter/Python or R is required.
Demonstrated expert experience with data integrations and data processing for business intelligence and analytics workloads is required.
Experience in software versioning tools including git, SVN or related.
Advanced experience with AWS S3 or other distributed object stores, MPP Data Warehousing, (e.g. AWS Redshift), Elastic MapReduce is needed.
Experience implementing statistical models, ML and other AI technologies into production data is required.
Experience developing container
Demonstrated experience implamenting Big Data pipelines including Spark, Hive, Sqoop or related technologies.
Experience implementing streaming data pipelines to support realtime and near realtime decision making.
Understanding of Software Development Life Cycle (SDLC) methodologies such as Agile and Waterfall is needed.
Proven track record of designing data platforms leveraging large complex data sets.

Educational Requirements:

This position requires a Bachelors Degree in Computer Science, Computer Information Systems or related or equivalent experience.

Data or cloud related certifications are a plus.

[job_alerts.create_a_job]

Senior Data Engineer • Scottsdale, AZ, US

[internal_linking.similar_jobs]

Presales Solutions Engineer - Data Protection

SHI GmbH • Phoenix, AZ, United States

[job_card.full_time]

Since 1989, SHI International Corp.We've grown every year since, and today we're proud to be a $16 billion global provider of IT solutions and services.Over 17,000 organizations worldwide rely on S...[show_more]

[last_updated.last_updated_1_day] • [promoted]

Data Platform Engineer - Remote

DriveTime • Tempe, AZ, United States

[filters.remote]

[job_card.full_time] +1

What's Under the HoodDriveTime Family of Brands is the largest privately owned used car sales finance & servicing company in the nation.Headquartered in Tempe, Arizona and Dallas, Texas, we create ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Data Engineer

Viasat • Tempe, Arizona, United States

[job_card.full_time]

At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Principal Engineer I - Senior Azure Databricks Administrator

Western Alliance Bank • Phoenix, AZ, United States

[job_card.full_time]

Principal Engineer I - Senior Azure Databricks Administrator.As a Principal Engineer I embedded in the Enterprise Data & Analytics function, you will be responsible for delivery and operations of t...[show_more]

[last_updated.last_updated_variable_hours] • [promoted] • [new]

Google Data Analytics Engineer

InterSources • Phoenix, AZ, United States

[job_card.full_time]

Job Title: Google Data Analytics Engineer.Job Location: Phoenix, AZ OR Charlotte, NC ( Day 1 onsite).Developing comprehensive site tagging & tracking data capture strategies using URL query params,...[show_more]

[last_updated.last_updated_1_hour] • [promoted] • [new]

AI Engineer

Teradata • Phoenix, AZ, United States

[job_card.full_time]

At Teradata, we believe that people thrive when empowered with better information.That's why we built the most complete cloud analytics and data platform for AI.By delivering harmonized data, trust...[show_more]

[last_updated.last_updated_1_day] • [promoted]

Senior Software Engineer, Cloud Performance

Phoenix Staffing Services • Phoenix, AZ, United States

[job_card.full_time]

This position is based onsite in Nashville, TN.Oracle Cloud Infrastructure (OCI) delivers mission-critical applications for top tier enterprises around the world.Our cloud offers unmatched hyper-sc...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Process Piping Design Engineer, Data Center

AECOM • Phoenix, AZ, United States

[job_card.full_time]

At AECOM, we're delivering a better world.Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thr...[show_more]

[last_updated.last_updated_1_day] • [promoted]

AI Engineer

Oracle • Phoenix, AZ, United States

[job_card.full_time]

The Customer Success Services team needs an AI Engineer that can design, develop, configure, evaluate, monitor and optimize generative AI and agent solutions for Oracle applications, as well as dev...[show_more]

[last_updated.last_updated_1_day] • [promoted]

AI Engineer

Wise Pelican • Scottsdale, AZ, United States

[job_card.full_time]

AI Engineer (AI-First Software Developer).Wise Pelican is hiring a dedicated AI Engineer who will learn fast, ship faster, and build real product features using modern frameworks and AI-assisted, v...[show_more]

[last_updated.last_updated_1_day] • [promoted]

Staff Data Architect: Cloud-Native Data Pipelines Lead

Arizona State University • Scottsdale, AZ, United States

[job_card.full_time]

A prominent educational institution in Scottsdale is seeking a Staff Data Architect to lead the development of robust data pipelines.You will play a key role in leveraging cloud technologies (AWS, ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Sr. Storage Infrastructure Engineer

Gusto • Scottsdale, AZ, United States

[job_card.full_time]

As a Storage Infrastructure Engineer at Gusto, you will design, implement, and maintain production‑grade data storage platforms, ensuring they are resilient, usable, and secure for our product engi...[show_more]

[last_updated.last_updated_30] • [promoted]

Data Engineer

Vensoft Inc • Phoenix, AZ, United States

[job_card.full_time]

[filters_job_card.quick_apply]

Hi, Please share resumes at abhic@vensoft.Data Engineer with experience in Oracle Taleo integrations and performing data ingestions from Oracle HCM Platforms into Datalakes and transforming to faci...[show_more]

[last_updated.last_updated_variable_days]

Civil (Design) Engineer (Data Centers)

Jacobs • Tempe, AZ, United States

[job_card.full_time]

This job opportunity is available at ANY location in the United States.Ideally, selected candidates will be near a JACOBS U.At Jacobs, we don't settle - always looking beyond to raise the bar and d...[show_more]

[last_updated.last_updated_1_day] • [promoted]

Senior Solution Engineer

RELX • Chandler, AZ, United States

[job_card.full_time]

Are you ready to use your data science and analytics skills to drive customer value and innovation?Do you thrive on solving complex problems and building tools that make a real impact for customers...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Big data and Hadoop Developer / Lead

Tech Resource Group • Phoenix, AZ, United States

[job_card.full_time]

Big Data And Hadoop Developer / Lead.Looking for Big data and Hadoop with good experience in Java.All your information will be kept confidential according to EEO guidelines.[show_more]

[last_updated.last_updated_variable_days] • [promoted]