Talent.com
Data Engineer
Data EngineerForhyre • Phoenix, AZ, US
[error_messages.no_longer_accepting]
Data Engineer

Data Engineer

Forhyre • Phoenix, AZ, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.
  • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
  • [job_alerts.create_a_job]

    Data Engineer • Phoenix, AZ, US

    [internal_linking.similar_jobs]
    Lead AWS Data Engineer

    Lead AWS Data Engineer

    Tech Mahindra Limited • Phoenix, Arizona, United States
    [job_card.full_time]
    Position Title : Lead AWS Data Engineer Location : St.Louis, MO Job Description Design and build scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices.Men...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Data Engineer

    Principal Data Engineer

    DigiCert, Inc. • Phoenix, Arizona, United States
    [job_card.full_time]
    Principal Data Engineer (DigiCert, Inc.Lehi, UT) Architect and contribute to the design of distributed data processing systems, focusing on modularity, reusability, and fault tolerance.Collaborate ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Machine Learning Engineer – Data and AI

    Machine Learning Engineer – Data and AI

    Genesis10 • Phoenix, Arizona, United States
    [job_card.permanent]
    Genesis10 is seeking a Machine Learning Engineer for our client in the wealth management industry.This Direct Hire position is located in either Plano, TX OR Camus, WA W2 Status : If you require Cur...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer, Production Analytics

    Data Engineer, Production Analytics

    Carvana • Tempe, AZ, US
    [job_card.full_time]
    At Carvana, we're changing the way people buy and sell cars.With an ambitious vision and a fundamentally different approach designed to be fun, fast, and fair, Carvana became the fastest-growin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Project Engineer - Data Centers

    Sr Project Engineer - Data Centers

    Sundt • Phoenix, AZ, United States
    [job_card.full_time]
    As a 100% employee-owned contractor, when you work at Sundt, you're not just hiring on at a company, you're joining a culture. Because everyone at Sundt is part owner, you'll join a team of people w...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Staff Data Engineer

    Sr. Staff Data Engineer

    Achieve • Tempe, AZ, US
    [job_card.full_time]
    Achieve is a leading digital personal finance company.We help everyday people move from struggling to thriving by providing innovative, personalized financial solutions. By leveraging proprietary da...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Distributed Data Systems Engineer

    Senior Distributed Data Systems Engineer

    Artech • Phoenix, AZ, United States
    [job_card.full_time]
    Phoenix, AZ - A vibrant city known for its warm climate, cultural diversity, and rapidly growing tech scene.Required Skills & Qualifications. Applicants must be able to work directly for Artech on W...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Full Stack Engineer / Data Architect - Phoenix Arizona (Remote)

    Full Stack Engineer / Data Architect - Phoenix Arizona (Remote)

    Sunrise Systems • Phoenix, Arizona, United States
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Full Stack Engineer / Data Architect.Mainly remote but will need to come into the office periodically for meetings.Full Stack Engineer / Data Architect. The Client is developing a centralized portal to ...[show_more]
    [last_updated.last_updated_30]
    Sr. Analytics Engineer

    Sr. Analytics Engineer

    Dutch Bros Coffee • Tempe, AZ, United States
    [job_card.full_time]
    It's fun to work in a company where people truly believe in what they are doing.At Dutch Bros Coffee, we are more than just a coffee company. We are a fun-loving, mind-blowing company that makes a d...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Big Data Engineer / Data Engineer

    Big Data Engineer / Data Engineer

    CrackaJack Digital Solutions LLC • Phoenix, AZ, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    In-Person round of interview mandatory.Big Data, Spark, Python, SQL, GCP is must.Need a hardcore, heavy hitting Data Engineer who is extremely skilled and is able to function independently and mana...[show_more]
    [last_updated.last_updated_30]
    Transportation Data Engineer

    Transportation Data Engineer

    Kittelson & Associates, Inc. • Phoenix, Arizona, United States
    [job_card.full_time]
    Transportation Data Engineer, Kittelson & Associates, Inc.Provide data analytics, visualization, write scripts, conduct literature reviews, prepare technical memoranda, manage own work and peer sta...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    AI Engineer

    AI Engineer

    Eliassen Group • Phoenix, AZ, United States
    [job_card.permanent]
    Our client seeks an innovative, hands-on AI Engineer to develop prototypes that solve business problems and integrate AI, ML, and NLP solutions within cloud native environments.The role emphasizes ...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Research Engineer

    Research Engineer

    Waabi • Phoenix, AZ, US
    [job_card.full_time]
    Waabi, founded by AI pioneer and visionary Raquel Urtasun, is an AI company building the next generation of self-driving technology. With a world class team and an innovative approach that unleashes...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Engineer

    Data Engineer

    United States Cold Storage, Inc. • Phoenix, Arizona, United States
    [job_card.full_time]
    United States Cold Storage, Inc.The Data Engineer will migrate and automate all customer inventory balance reports to enhance visibility of reports and aid the business in making informed decisions...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer II

    Data Engineer II

    VirtualVocations • Chandler, Arizona, United States
    [job_card.full_time]
    A company is looking for a Data Engineer II - Gen AI - Music.Key Responsibilities Build and maintain large-scale data pipelines using data processing frameworks on Google Cloud Platform Drive op...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Civil (Design) Engineer (Data Centers)

    Civil (Design) Engineer (Data Centers)

    Jacobs • Tempe, AZ, United States
    [job_card.full_time]
    This job opportunity is available at ANY location in the United States.Ideally, selected candidates will be near a JACOBS U. At Jacobs, we don't settle - always looking beyond to raise the bar and d...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Community Medical Services • Scottsdale, AZ, US
    [job_card.full_time]
    Please Note : Applicants must reside in one of the 13 states CMS operates in : AZ, CO, TX, MI, MT, MN, IN, OH, WI, IL, OR, WA, AK. Community Medical Services (CMS) is hiring a.Senior Data Solutions En...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Scientist or Data Engineer

    Data Scientist or Data Engineer

    Genie Pro Technolgies Inc • Phoenix, Arizona, United States
    [job_card.full_time]
    We are seeking a Data Scientist or Data Engineer with strong expertise in PostgreSQL, ETL, Machine Learning, and Data Engineering for an opportunity based in Woodlawn, MD.Please review the updated ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]