Talent.com
Data Engineer
Data EngineerForhyre • New York, NY, US
Data Engineer

Data Engineer

Forhyre • New York, NY, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

    • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
    • [job_alerts.create_a_job]

    Data Engineer • New York, NY, US

    [internal_linking.similar_jobs]
    Data Engineer

    Data Engineer

    Sharp Decisions • New York, NY, United States
    [job_card.full_time]
    We are looking for a mid-level data engineer.As a result of this expansion, we are seeking experienced software Data engineers with 5+ years of relevant experience to support the design and develop...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Engineer

    Data Engineer

    Artisan • New York, NY, United States
    [job_card.full_time]
    You’ll be responsible for building reliable data pipelines, integrating external APIs, maintaining clean and structured data models, and enabling the product and ML teams to iterate quickly.You sho...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Contact Government Services, LLC • New York, NY, US
    [job_card.full_time]
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    BDG • New York, NY, US
    [job_card.full_time]
    Bustle Digital Group (BDG) is looking for a talented.You will work alongside the Director of Data Engineering to build, optimize, and scale our data infrastructure, supporting the development of da...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Software Engineer - Data Engineer

    Lead Software Engineer - Data Engineer

    J.P. Morgan • Jersey City, New York, US
    [job_card.full_time]
    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Sector's Fi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer #3402930

    Data Engineer #3402930

    Axiom Path • New York, NY, US
    [job_card.full_time]
    Be Part of a High-Performing Team.This position supports a major financial institution undergoing an extensive digital transformation to modernize its data ecosystem and cloud strategy.The organiza...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Engineer

    Data Engineer

    Amalgamated Bank of NY • New York, NY, US
    [job_card.full_time]
    We are looking for an experienced and highly skilled Data Engineer to join our Data Governance Team.The ideal candidate will have a strong background in data engineering with specific experience in...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Data Engineer (Weehawken)

    Azure Data Engineer (Weehawken)

    Programmers.io • Weehawken, NJ, US
    [job_card.full_time] +1
    Job Title : Azure Data Engineer.Location : Weehawken, NJ ( 5 days WFO).Expert level skills writing and optimizing complex SQL. Experience with complex data modelling, ETL design, and using large datab...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    [job_card.full_time]
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Engineer - Data Platform

    AI Engineer - Data Platform

    Traversal • New York, NY, United States
    [job_card.full_time]
    AI Site Reliability Engineer (SRE) for the enterprise—already trusted by some of the largest companies in the world to troubleshoot, remediate, and even prevent the most complex production incident...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Rokt • New York, NY, US
    [job_card.full_time]
    We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most. Rokt’s AI Brain and ecommerce Network powers...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Palantir Technologies • New York, NY, US
    [job_card.full_time]
    Palantir builds the world’s leading software for data-driven decisions and operations.By bringing the right data to the people who need it, our platforms empower our partners to develop lifes...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer (AI, ML, and Data Science)

    Data Engineer (AI, ML, and Data Science)

    Consumer Reports • Yonkers, New York, United States
    [job_card.full_time]
    Consumer Reports is an independent, nonprofit organization dedicated to a fair and just marketplace for all.CR is known for our rigorous testing and trusted ratings on thousands of products and ser...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Radical AI • New York, NY, US
    [job_card.full_time]
    We are at the forefront of innovation in the field of materials R&D, a critical driver for advancing our most cutting-edge industries and shaping the future. Breaking away from the traditionally...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Zone IT Solutions • New York, NY, US
    [job_card.permanent]
    We are actively looking for Data Engineer for a permanent position.This exciting opportunity is with a well-established global IT service provider known for its excellence in the industry.Designing...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Planned Parenthood Federation of America • New York, NY, US
    [job_card.full_time]
    Planned Parenthood organizations serve all people with care and compassion, with respect, and without judgment, striving to create equitable access to health care. Through health centers, programs i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Prizeout • New York, NY, US
    [job_card.full_time]
    Prizeout is a fast-growing fintech transforming how people interact with their money by turning everyday transactions into rewarding, value-driven moments. We sit at the intersection of payments, re...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    SPS-North America • New York, NY, US
    [job_card.full_time]
    Collaborate with software engineers, business stake holders and / or domain experts to translate business requirements into product features, tools, projects. Develop, implement, and deploy ETL soluti...[show_more]
    [last_updated.last_updated_30] • [promoted]