Talent.com
Data Engineer
Data EngineerForhyre • New York, NY, US
Data Engineer

Data Engineer

Forhyre • New York, NY, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

    • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
    • [job_alerts.create_a_job]

    Data Engineer • New York, NY, US

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Open Roles • New York, New York, United States
    [job_card.full_time]
    Trillium is a leading proprietary trading firm active in US Equities, US Options, Canadian Equities, and OTC Equities.With trading technology built, tested, and optimized in-house, our engineers an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analytics Data Engineer

    Analytics Data Engineer

    Anthropic • New York, New York, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Data Engineer

    AI Data Engineer

    Ladders • New York, New York, United States
    [job_card.full_time]
    At Ladders, we’re redefining how professionals find better, more rewarding careers.With over a million job listings and a mission to make the job search smarter, faster, and more effective, we leve...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    January • New York, New York, United States
    [job_card.full_time] +1
    At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer - NYC

    Data Engineer - NYC

    Aircall • New York, NY, United States
    [job_card.full_time]
    Aircall is a place where voices are valued.Backed by over $220 million of investment since 2015, we create technology that fuels accessible, transparent and collaborative communication to empower o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer III

    Data Engineer III

    Match Group • New York, New York, United States
    [job_card.full_time]
    Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Iex Group • New York, NY, United States
    [job_card.full_time]
    Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business model and unique architecture designed to protect investors. Today, IEX applies its propr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Platform

    Data Engineer, Platform

    Basis Research Institute • New York, NY, United States
    [job_card.full_time]
    AI research organization with two mutually reinforcing goals.This means to establish the mathematical principles of what it means to reason, to learn, to make decisions, to understand, and to expla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Kasheesh • New York, New York, United States
    [job_card.full_time]
    Kasheesh is the first and only product that lets consumers split their payments across multiple credit, debit, and gift cards. Kasheesh is on an exciting mission to drive unparalleled flexibility fo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer Clips / ML Data

    Data Engineer Clips / ML Data

    Medal • New York, New York, United States
    [job_card.full_time]
    At Medal, we’re redefining how people capture and share gameplay experiences.Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights.W...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    10a Labs • New York, New York, United States
    [job_card.full_time]
    Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    The Daily Beast • New York, New York, United States
    [job_card.full_time]
    The Daily Beast delivers award-winning original reporting and sharp opinions in politics, pop culture, and world news.We reach more than 20 million readers per month and are based in New York as an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Data Engineer

    Cloud Data Engineer

    Govx • New York, New York, United States
    [filters.remote]
    [job_card.full_time]
    The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Coast • New York, New York, United States
    [job_card.full_time]
    Coast is re-imagining the trillion-dollar U.B2B card payments infrastructure, with a focus on the country’s 500,000 commercial fleets, 40 million commercial vehicles, and many million commercial dr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Endex • New York, New York, United States
    [job_card.full_time]
    Over the next few years, every financial institution will have teams of AI analysts working alongside their sharpest minds. At Endex, we're on a mission to bridge the present to the inevitable by bu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Fanduel • New York, New York, United States
    [job_card.full_time]
    Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Staff

    Data Engineer, Staff

    Hebbia • New York, New York, United States
    [job_card.full_time]
    The user interface for universal knowledge capture.We want every atom of information that our users need to be at their fingertips. Designed to be generally capable– it can tackle even the most comp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Point72 • New York, New York, United States
    [job_card.full_time]
    A CAREER WITH POINT72’S TECHNOLOGY TEAM.As Point72 reimagines the future of investing, our Technology team is constantly improving our company’s IT infrastructure, positioning us at the forefront o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]