Talent.com
Data Engineer
Data EngineerUnited IT Solutions • Scottsdale, AZ, United States
[error_messages.no_longer_accepting]
Data Engineer

Data Engineer

United IT Solutions • Scottsdale, AZ, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Must have : Skillset : Java, Scala, S3, Glue, aws , Redshift

6-8 years of IT experience focusing on enterprise data architecture and management.

  • Experience in Conceptual / Logical / Physical Data Modeling & expertise in Relational and Dimensional Data Modeling
  • Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
  • Experience with Spark Scala and Java programming
  • Data Lake concepts such as time travel and schema evolution and optimization
  • Structured Streaming and Delta Live Tables with Databricks as a bonus
  • Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data

mart build, and data lakes implementation / support

  • Advanced level understanding of streaming data pipelines and how they differ from batch systems
  • Formalize concepts of how to handle late data, defining windows, and data freshness
  • Advanced understanding of ETL and ELT and ETL / ELT tools such as Data Migration Service etc
  • Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.
  • Familiarity and / or expertise with Great Expectations or other data quality / data validation frameworks a bonus
  • Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
  • Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
  • Indexing and partitioning strategy experience
  • Debug, troubleshoot, design, and implement solutions to complex technical issues
  • Experience with large-scale, high-performance enterprise big data application deployment and solution
  • Architecture experience in AWS environment a bonus
  • Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
  • Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI / CD pipelines
  • Experience working with AWS Lambdas for configuration and optimization and experience with S3
  • Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
  • Ability to thrive in a team-based environment
  • Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management
  • [job_alerts.create_a_job]

    Data Engineer • Scottsdale, AZ, United States

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Contexture • Phoenix, AZ, United States
    [job_card.full_time] +1
    Reports To : Manager, Data Engineering.Minimum Starting Monthly Range : $7,599.Hiring Range (Monthly Pay) : $7,599 - $8,750.Exempt / Non-E...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Global Strategic Design and Solutions Engineer Data Center- Mechanical

    Global Strategic Design and Solutions Engineer Data Center- Mechanical

    Iron Mountain Inc • Phoenix, AZ, United States
    [job_card.full_time]
    At Iron Mountain we know that work, when done well, makes a positive impact for our customers, our employees, and our planet. That's why we need smart, committed people to join us.Whether you're loo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    VirtualVocations • Tempe, Arizona, United States
    [job_card.full_time]
    A company is looking for a Data Engineer to design, build, and maintain data pipelines and infrastructure.Key Responsibilities Design, develop, and maintain scalable ETL pipelines for processing ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Production Analytics

    Data Engineer, Production Analytics

    Carvana • Tempe, AZ, US
    [job_card.full_time]
    At Carvana, we're changing the way people buy and sell cars.With an ambitious vision and a fundamentally different approach designed to be fun, fast, and fair, Carvana became the fastest-growin...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Engineer III - Remote (6001)

    Data Engineer III - Remote (6001)

    itD Website • Phoenix, AZ, US
    [filters.remote]
    [job_card.full_time]
    This role contributes directly to data reliability, performance, and insight generation by delivering high-quality datasets that support advertising efficiency and business growth.The ideal candida...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Project Engineer - Data Centers

    Sr Project Engineer - Data Centers

    Sundt • Phoenix, AZ, United States
    [job_card.full_time]
    As a 100% employee-owned contractor, when you work at Sundt, you're not just hiring on at a company, you're joining a culture. Because everyone at Sundt is part owner, you'll join a team of people w...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Distributed Data Systems Engineer

    Senior Distributed Data Systems Engineer

    Artech • Phoenix, AZ, United States
    [job_card.full_time]
    Phoenix, AZ - A vibrant city known for its warm climate, cultural diversity, and rapidly growing tech scene.Required Skills & Qualifications. Applicants must be able to work directly for Artech on W...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Job Title

    Job Title

    Tata Consultancy Services • Phoenix, AZ, United States
    [job_card.full_time]
    Job Title : GCP engineer with Bigquery, Pyspark Experience Required - 7+ Years.Must Have Technical / Functional Skills.GCP Engineer with Bigquery, Pyspark and Python experience.Experience working on ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    AEP Engineer

    AEP Engineer

    TEPHRA • Phoenix, AZ, United States
    [job_card.full_time]
    Experience Required - 5+ Years.Must Have Technical / Functional Skills.Adobe Experience Platform (AEP) implementation and operations. Proven expertise in Real-Time CDP (RT-CDP) configuration and profi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Full Stack Engineer / Data Architect - Phoenix Arizona (Remote)

    Full Stack Engineer / Data Architect - Phoenix Arizona (Remote)

    Sunrise Systems • Phoenix, Arizona, United States
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Full Stack Engineer / Data Architect.Mainly remote but will need to come into the office periodically for meetings.Full Stack Engineer / Data Architect. The Client is developing a centralized portal to ...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer# 3509406

    Senior Data Engineer# 3509406

    Axiom Path • Phoenix, AZ, US
    [job_card.full_time]
    Be Part Of A High-Performing Team.This organization operates within the financial services sector, delivering data-driven solutions that support enterprise-scale decision-making.The technology team...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Big Data Engineer / Data Engineer

    Big Data Engineer / Data Engineer

    CrackaJack Digital Solutions LLC • Phoenix, AZ, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    In-Person round of interview mandatory.Big Data, Spark, Python, SQL, GCP is must.Need a hardcore, heavy hitting Data Engineer who is extremely skilled and is able to function independently and mana...[show_more]
    [last_updated.last_updated_30]
    Data Governance Informatica Engineer

    Data Governance Informatica Engineer

    Irvine Technology Corporation • Tempe, AZ, US
    [job_card.full_time]
    Job Title : Data Governance Informatica Engineer.Location : US Tempe, Arizona, Columbus, Indiana, Charlotte, NC, Raleigh, NC,. We are seeking a highly skilled Data Governance Informatica Engineer to j...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Opentext Voltage Data Protection Engineer

    Opentext Voltage Data Protection Engineer

    Motion Recruitment • Chandler, AZ, United States
    [job_card.full_time]
    Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Project Manager in Phoenix, AZ (Hybrid). Work with the brightest minds at one of the largest fina...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Integration Engineer II-ST

    Integration Engineer II-ST

    Desert Financial Credit Union • Phoenix, AZ, United States
    [job_card.full_time]
    The Integration Engineer II is responsible for orchestrating the seamless flow of data, ensuring efficient curation for ingestion into the Data Warehouse (DW), as well as extracting and transformin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    I and C Engineer - Intermediate (Data Centers)

    I and C Engineer - Intermediate (Data Centers)

    Jacobs • Tempe, AZ, United States
    [job_card.full_time]
    This job opportunity is available at ANY location in the United States.Ideally, selected candidates will be near a JACOBS U. Our People & Places Solutions business - reinforces our drive to improve ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Community Medical Services • Scottsdale, AZ, US
    [job_card.full_time]
    Please Note : Applicants must reside in one of the 13 states CMS operates in : AZ, CO, TX, MI, MT, MN, IN, OH, WI, IL, OR, WA, AK. Community Medical Services (CMS) is hiring a.Senior Data Solutions En...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Prompt Engineer

    AI Prompt Engineer

    Purple Drive • Phoenix, AZ, United States
    [job_card.full_time]
    Extract and organize project data from multiple tools (Confluence, Jira, Rally, etc.Develop and refine prompts in ChatGPT to automate reporting workflows. Generate project dashboards and summaries u...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]