Senior Data EngineerMSR Technology Group • Scottsdale, AZ, US
Senior Data Engineer
MSR Technology Group • Scottsdale, AZ, US
[job_card.30_days_ago]
[job_preview.job_type]
- [job_card.permanent]
[job_card.job_description]
Job Description
Job Description
Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies.
Essential Duties and Responsibilities:
- Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership.
- Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data warehouse and distributed analytic systems running in the cloud.
- Leads side-by-side design sessions with our business experts and engineers to understand our product and business to design, socialize, and implement proper conceptual, logical and physical data models.
- Spearheads efforts with multiple, disparate, data providers, as well as downstream consumers, to engineer efficient, tracable, and fault tolerant, batch and streaming, data pipelines to that support complex analytical analysis and enterprise-wide Business Intelligence applications
- In collaoration with our Data Science team, lead efforts to develop and implement production grade code/pipelines, in laguages including Python, leveraging advanced statistical routines, Machine Learning and other AI technologies.
- Responsible for oversight and improvements on approaches to monitor and support data quality automation efforts. Working along side QA Engineering, implement quality check routines as part of data processing frameworks and validates flow of information.
- Drives engineering efforts for Data Warehouse and Big Data infrastructure needs, including but not limited to, automation of system builds, security requirements, performance requirements and logging/monitoring in collaboration with DevOps engineers
- Resolves escalated issues related to complex data anomolies and performance. In addition, implements adjustments, conducts after action reviews to determine root cause/corrective measures, and ensures knowledge transfer to operations support team.
- Provides mentorship and guidance to help guide and grow the technical depth of junior Data Engineers and across the BI & Analytics team.
- Ensures documentation is complete and up to date with regard to standards, best practices and technical specifications.
- Leads design and code review sessions and provides feedback and mentorship to peers.
- Educates the BI & Analytics team on the latest industry technologies, trends and strategies; Provides thought leadership around approaches, patterns and best practices in the Data Engineering domain.
- Assists employees, vendors or other customers by answering questions related to Data Warehousing and Big Data processes, procedures and services
- Collaborate with data team, product owners, Scrum-master to refine and estimate stories/epics to deliver on commitments on time and with high quality while providing exceptional customer service
- Provides Tier 3 support and create run books to mentor Tier 1 and Tier 2 support staff
- Other duties as assigned
Background & Experience Required:
- This position requires a minimum of 10 years of progressive database development and integration experience.
- Demonstrated experience in designing and implementing large-scale logical and physical data model with expert knowledge of Kimball methodologies.
- Demonstrated advanced/expert level experience in multiple relational (RDMS) and non-relational (NoSQL) data platforms is required.
- Demonstrated advanced experience in SQL tuning, indexing, distribution, partitioning, data access patterns and scaling strategies is required.
- Demonstrated advanced scripting knowledge with Jupyter/Python or R is required.
- Demonstrated expert experience with data integrations and data processing for business intelligence and analytics workloads is required.
- Experience in software versioning tools including git, SVN or related.
- Advanced experience with AWS S3 or other distributed object stores, MPP Data Warehousing, (e.g. AWS Redshift), Elastic MapReduce is needed.
- Experience implementing statistical models, ML and other AI technologies into production data is required.
- Experience developing container
- Demonstrated experience implamenting Big Data pipelines including Spark, Hive, Sqoop or related technologies.
- Experience implementing streaming data pipelines to support realtime and near realtime decision making.
- Understanding of Software Development Life Cycle (SDLC) methodologies such as Agile and Waterfall is needed.
- Proven track record of designing data platforms leveraging large complex data sets.
Educational Requirements:
This position requires a Bachelors Degree in Computer Science, Computer Information Systems or related or equivalent experience.
Data or cloud related certifications are a plus.
[job_alerts.create_a_job]
Senior Data Engineer • Scottsdale, AZ, US
[internal_linking.similar_jobs]
What's Under the HoodDriveTime Family of Brands is the largest privately owned used car sales finance & servicing company in the nation.Headquartered in Tempe, Arizona and Dallas, Texas, we create ...[show_more]
Job Title: AI Engineer Job Location: Phoenix, AZ Job Type: Contract Job Description: Develop and implement AI solutions usi...[show_more]
This position is based onsite in Nashville, TN.Oracle Cloud Infrastructure (OCI) delivers mission-critical applications for top tier enterprises around the world.Our cloud offers unmatched hyper-sc...[show_more]
Control Data coupling, OOT - Object Oriented Technology compliant analysis, SRS and SDD work.DO-178 and Deos experience is highly desirable.We are looking for a skilled engineer to support Honeywel...[show_more]
Full Stack Engineer/Data Architect.Mainly remote but will need to come into the office periodically for meetings.Full Stack Engineer/Data Architect.The Client is developing a centralized portal to ...[show_more]
Data Steward • Very Important to have Good experience with working with Record Retention and Deletion policies • Understanding of Data Management and Data Governance concepts (metadata, lineage, da...[show_more]
A prominent educational institution in Scottsdale is seeking a Staff Data Architect to lead the development of robust data pipelines.You will play a key role in leveraging cloud technologies (AWS, ...[show_more]
As a Storage Infrastructure Engineer at Gusto, you will design, implement, and maintain production‑grade data storage platforms, ensuring they are resilient, usable, and secure for our product engi...[show_more]
Hi, Please share resumes at abhic@vensoft.Data Engineer with experience in Oracle Taleo integrations and performing data ingestions from Oracle HCM Platforms into Datalakes and transforming to faci...[show_more]
SAP Data Migration Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their...[show_more]
A leading technology solutions company is looking for a Pre-sales Engineer III to provide pre-sales technical support in a remote capacity.The ideal candidate will have a Bachelor's degree in Infor...[show_more]
Tracks and monitors ongoing Data Center critical infrastructure maintenance and repair for all service lines to pre-defined service level agreements (SLAs).Manages incidents that impact Data Center...[show_more]
This job opportunity is available at ANY location in the United States.Ideally, selected candidates will be near a JACOBS U.At Jacobs, we don't settle - always looking beyond to raise the bar and d...[show_more]
Join Expedient's AI CTRL product team as an AI Data Engineer, where you'll transform complex, unstructured datasets into clean, AI-ready data for enterprise clients.Working on-site in Expedient's P...[show_more]
We believe CVNA is in the early stages of becoming the next U.Stephens Investment Bank, Analyst Report, Sept.Building leading-edge technology has been at the core of Carvana’s strategy since our fo...[show_more]
Job Title : Data Solutions ArchitectLocation : Remote or hybrid from Glendale, Anaheim, West Covina, Riverside, San Diego, Phoenix, Las Vegas, or UtahOverviewOur client is seeking a hands-on Data S...[show_more]
Join our mission to create a completely new, 100% digital bank that uses consumer feedback to truly meet customers' best interests.Jenius Bank, a division of SMBC MANUBANK, and a member of SMBC Gro...[show_more] A leading tech company is seeking a Storage Infrastructure Engineer in Scottsdale, AZ, to design and maintain robust data storage platforms.Responsibilities include planning migrations, establishin...[show_more]
Data Platform Engineer - Remote
DriveTime • Tempe, AZ, United States
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Staffingine LLC • Phoenix, AZ, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days]
Senior Software Engineer, Cloud Performance
Phoenix Staffing Services • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Engineer
Yochana • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Full Stack Engineer/Data Architect - Phoenix Arizona (Remote)
Sunrise Systems • Phoenix, Arizona, United States
[filters.remote]
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Data Steward
Purple Drive • Phoenix, AZ, Arizona, USA
[job_card.full_time]
[last_updated.last_updated_variable_days]
Staff Data Architect: Cloud-Native Data Pipelines Lead
Arizona State University • Scottsdale, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Sr. Storage Infrastructure Engineer
Gusto • Scottsdale, AZ, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Engineer
Vensoft Inc • Phoenix, AZ, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days]
SAP Data Migration Engineer
Bright Vision Technologies • Phoenix, AZ, US
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days]
National Pre-Sales Engineer Data Center Solutions (Remote)
Insight • Phoenix, AZ, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Center Facilities Engineer I
Oracle • Phoenix, AZ, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Civil (Design) Engineer (Data Centers)
Jacobs • Tempe, AZ, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
AI Data Outcomes Engineer
Expedient • Phoenix, AZ
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Senior Data Engineer
Carvana • Tempe, AZ
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days]
Remote Azure Data Architect / Engineer
Irvine Tech Corp • Phoenix, AZ, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Software Engineer - Data (Remote)
SMBC • Phoenix, AZ, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Storage Engineer: Build Resilient Data Platforms
Gusto • Scottsdale, AZ, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]