Talent.com
Data Engineer
Data EngineerForhyre • Carolina, NC, US
Data Engineer

Data Engineer

Forhyre • Carolina, NC, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

    • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
    • [job_alerts.create_a_job]

    Data Engineer • Carolina, NC, US

    [internal_linking.similar_jobs]
    Systems & Controls Validation Engineer

    Systems & Controls Validation Engineer

    GKN Automotive • Mebane, NC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Picture your morning in Alamance, NC : you open a fresh set of system requirements, map them to testable criteria, and plan a feasibility run for a new control strategy. By midday, you’re drafting pr...[show_more]
    [last_updated.last_updated_variable_days]
    Aviation Engineer II - Engine Quality

    Aviation Engineer II - Engine Quality

    Honda Aero • Burlington, NC, United States
    [job_card.full_time]
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and its a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that will hel...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel CT Tech - $2,477 per week in Burlington, NC

    Travel CT Tech - $2,477 per week in Burlington, NC

    AlliedTravelCareers • Burlington, NC, US
    [job_card.full_time]
    Windsor Healthcare Recruitment Group, Inc.AlliedTravelCareers is working with Windsor Healthcare Recruitment Group, Inc.CT Tech in Burlington, North Carolina, 27215!. MANDATORY QUESTIONNAIRE •Please...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel CT Tech - $2,554 per week in Burlington, NC

    Travel CT Tech - $2,554 per week in Burlington, NC

    AlliedTravelCareers • Burlington, NC, US
    [job_card.full_time]
    Windsor Healthcare Recruitment Group, Inc.AlliedTravelCareers is working with Windsor Healthcare Recruitment Group, Inc.CT Tech in Burlington, North Carolina, 27215!. MANDATORY QUESTIONNAIRE •Please...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Project Engineer

    Project Engineer

    Mountaire • Siler City, North Carolina, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Facilitates engineering, design, and project management for assigned projects.Major Duties & Responsibilities : .Works with internal customers and third parties (architects, engineers, constructi...[show_more]
    [last_updated.last_updated_30]
    Retail Sales Associate

    Retail Sales Associate

    Verizon • Burlington, NC, United States
    [job_card.full_time] +1
    A place to share your ideas freely - even if they're daring or different.Where the true you can learn, grow, and thrive.At Verizon, we power and empower how people live, work and play by connecting...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Controls Engineer

    Controls Engineer

    Actalent • Mebane, NC, United States
    [job_card.permanent]
    Job Title : Controls EngineerJob Description.We are seeking a highly skilled Controls Engineer to support the development of control functions and parameters for eDrive and AWD systems.This role is ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manufacturing Process Engineer

    Manufacturing Process Engineer

    Manpower Group Inc. • Mebane, NC, United States
    [job_card.full_time]
    Our client, a leader in manufacturing and industrial solutions, is seeking a Manufacturing Process Engineer to join their team. As a Manufacturing Process Engineer, you will be part of the Engineeri...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate Mechanical Design Engineer

    Associate Mechanical Design Engineer

    Abb Holdings Inc • Mebane, NC, United States
    [job_card.full_time]
    At ABB, we help industries outrun - leaner and cleaner.Here, progress is an expectation - for you, your team, and the world. As a global market leader, we'll give you what you need to make it happen...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Qualified Intellectual Disabilities Professional (QP / QIDP)

    Qualified Intellectual Disabilities Professional (QP / QIDP)

    All Ways Caring HomeCare • Burlington, NC, United States
    [job_card.full_time]
    Qualified Intellectual Disabilities Professional (QP / QIDP).The Qualified Intellectual Disabilities Professional (QIDP) oversees delivery of consumer support services for assigned location.This po...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Community Otolaryngology – Mebane, North Carolina

    Community Otolaryngology – Mebane, North Carolina

    Duke Health • Mebane, US
    [job_card.full_time]
    The Duke Department of Head and Neck Surgery & Communication Sciences invites applications for a board certified / board eligible Community Otolaryngologist. This position would enjoy both the aut...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Associate Mechanical Design Engineer

    Associate Mechanical Design Engineer

    ABB • Mebane, NC, United States
    [job_card.full_time]
    At ABB, we help industries outrun - leaner and cleaner.Here, progress is an expectation - for you, your team, and the world. As a global market leader, we'll give you what you need to make it happen...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Mobile Building Engineer

    Mobile Building Engineer

    CBRE • Burlington, NC, United States
    [job_card.full_time]
    Burlington - North Carolina - United States of America, Greensboro - North Carolina - United States of America, High Point - North Carolina - United States of America, Winston Salem - North Carolin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Controls Engineer

    Controls Engineer

    Manpower Group Inc. • Mebane, NC, United States
    [job_card.full_time]
    Controls Engineer - Assembly Cell Automation.Mebane, NC | Full-Time | On-Site.This isn't software or quality engineering - it's. You'll work closely with robots, sensors, PLCs, and operators to make...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote C# Software Engineer - AI Trainer

    Remote C# Software Engineer - AI Trainer

    SuperAnnotate • Burlington, North Carolina, US
    [filters.remote]
    [job_card.full_time]
    This is an hourly-paid, fully remote contractor role where you will review AI-generated responses and / or generate C# / . NET engineering content, evaluating reasoning quality and step-by-step problem-...[show_more]
    [last_updated.last_updated_variable_days]
    Controls Engineer

    Controls Engineer

    Pureflow • Graham, NC, United States
    [job_card.full_time]
    Watch this video to learn more about Pureflow!.With over 38 years of experience providing high purity water solutions, Pureflow is committed to serving clients by designing, building, installing an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Project Engineer

    Project Engineer

    Pro Found Recruiting • Burlington, NC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Project Engineer – Food Manufacturing.Greater Research Triangle Region, NC.Targeting $90,000–$110,000k + bonus + strong benefits (4 weeks PTO, 401k match). A fast-growing food production facility in...[show_more]
    [last_updated.last_updated_variable_days]
    Aviation Engineer II - Engine Quality

    Aviation Engineer II - Engine Quality

    Honda Aero, LLC. • Burlington, NC, United States
    [job_card.full_time]
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that will he...[show_more]
    [last_updated.last_updated_1_day] • [promoted]