Talent.com
Hadoop Developer
Hadoop DeveloperDiverse Lynx • Charlotte, NY, United States
Hadoop Developer

Hadoop Developer

Diverse Lynx • Charlotte, NY, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Role : Hadoop Developer

Job Location New York, NY / Charlotte, NC

Job Type : Full Time

Must Have Technical / Functional Skills

  • Primary Skil : Hadoop ecosystem (HDFS, Hive, Spark),PySpark,Python,Apache Kafka
  • Secondary : UI - Angular.
  • Experience : Minimum 9 years

Roles & Responsibilities

Architectural Leadership :

  • Define end-to-end architecture for data platforms, streaming systems, and web applications.
  • Ensure alignment with enterprise standards, security, and compliance requirements.
  • Evaluate emerging technologies and recommend adoption strategies.

    • Data Engineering :

  • Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.
  • Optimize ETL workflows for large-scale datasets and real-time streaming.
  • Integrate Apache Kafka for event-driven architectures and messaging.

    • Application Development :

  • Build and maintain backend services using Python and microservices architecture.
  • Develop responsive, dynamic front-end applications using Angular.
  • Implement RESTful APIs and ensure seamless integration between components.

    • Collaboration & Leadership :

  • Work closely with product owners, business analysts, and DevOps teams.
  • Mentor junior developers and data engineers.
  • Participate in agile ceremonies, code reviews, and design discussions.

    • Required Skills & Qualifications :

    Technical Expertise :

  • Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
  • Proficiency in PySpark for distributed data processing.
  • Advanced programming skills in Python.
  • Hands-on experience with Apache Kafka for real-time streaming.
  • Frontend development using Angular (TypeScript, HTML, CSS).

    • Architectural Skills :

  • Expertise in designing scalable, secure, and high-performance systems.
  • Familiarity with microservices, API design, and cloud-native architectures.

    • Additional Skills :

  • Knowledge of CI / CD pipelines, containerization (Docker / Kubernetes).
  • Exposure to cloud platforms (AWS, Azure, GCP).

    • Education :

    Bachelor's or Master's degree in Computer Science, Engineering, or related field.

    Experience :

    9+ years in software development, with at least 4 + years in architecture and Big Data technologies.

    Preferred Qualifications :

  • BFSI domain experience or large-scale enterprise systems.
  • Understanding of data governance, security, and compliance standards.

    • Soft Skills :

  • Strong analytical and problem-solving abilities.
  • Excellent communication and leadership skills.
  • Ability to thrive in a fast-paced, agile environment.

    • Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

    [job_alerts.create_a_job]

    Developer • Charlotte, NY, United States

    [internal_linking.similar_jobs]
    Senior Software Engineer, Embedded Middleware

    Senior Software Engineer, Embedded Middleware

    QuidelOrtho • Rochester, NY, United States
    [job_card.full_time]
    QuidelOrtho unites the strengths of Quidel Corporation and Ortho Clinical Diagnostics, creating a world-leading in vitro diagnostics company with award-winning expertise in immunoassay and molecula...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Digital Verification Engineer

    Senior Digital Verification Engineer

    Ciena • Pittsford, NY, United States
    [job_card.full_time]
    As the global leader in high-speed connectivity, Ciena is committed to a people-first approach.Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Work from Home

    Work from Home

    HomeJobFinder • Spencerport, NY
    [filters.remote]
    [job_card.full_time]
    Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Dashers - Sign Up and Start Earning

    Dashers - Sign Up and Start Earning

    DoorDash • Hilton, New York, United States
    [job_card.full_time] +1
    Why Deliver with DoorDash? DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Surgical Tech - $1,429 per week in Rochester, NY

    Travel Surgical Tech - $1,429 per week in Rochester, NY

    Prime HealthCare Staffing • Irondequoit, NY, United States
    [job_card.full_time]
    Surgical Tech Location : Rochester, NY Agency : Prime HealthCare Staffing Pay : $1,429 per week Shift Information : Days - 3 days x 12 hours Contract Duration : 13 Weeks Start Date : 1 / 20 / 2026 About the ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Avani Group - H1B Visa / Transfer program for UI Developer

    Avani Group - H1B Visa / Transfer program for UI Developer

    Avani Technology Solutions • Rochester, NY, United States
    [job_card.full_time]
    Attention skilled professionals seeking new opportunities in the United States! We are thrilled to introduce our FREE H1B Visa Program and Transfer Program, designed to help you kick start your Ame...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Analyst - Prog Support

    Analyst - Prog Support

    MAXIMUS • Rochester, NY, United States
    [job_card.full_time]
    Maximus is searching for an Analyst - Prog Support.Position is contingent upon contract award •.Must have the ability to pass a federal background check. Equipment will be provided but must meet the ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Analyst - Remote

    Data Analyst - Remote

    Recruit Monitor • Rochester, NY, United States
    [filters.remote]
    [job_card.full_time]
    About the job Data Analyst - Remote.Endeavor Streaming, part of Endeavor, is building the worlds most advanced content distribution platform for Content Creators, Global Brands, TV Broadcasters and...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Architect

    Data Architect

    Novocure Inc • Rochester, NY, United States
    [job_card.full_time]
    We are seeking an experienced and innovative Data Architect to lead the design, development, and optimization of our enterprise data architecture. This individual will play a critical role in aligni...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Continuous Improvement

    Continuous Improvement

    Howmet • Rochester, NY, United States
    [job_card.full_time]
    McKee Rd, Rochester, NY, 14611, US.This position entails access to export-controlled items and employment offers are conditioned upon an applicant's ability to lawfully obtain access to such items....[show_more]
    [last_updated.last_updated_30] • [promoted]
    Forward Deployed AI Engineer-Palantir Foundry-Senior Associate

    Forward Deployed AI Engineer-Palantir Foundry-Senior Associate

    PwC • Rochester, NY, United States
    [job_card.full_time]
    At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    OR Tech

    OR Tech

    White Glove Placement • Rochester, NY, United States
    [job_card.permanent]
    Estimated Gross Weekly Wage $2338.Schedule Day 4x10-Hour (07 : 00 - 17 : 00).Access the largest, most reliable job database, updated in real-time to ensure you see the latest openings.Benefit from dire...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Precast Senior Designer

    Precast Senior Designer

    Fisher Associates • Rochester, NY, United States
    [job_card.full_time]
    Charlotte+Street+Rochester+NY+USA+14607) • Transportation.Precast Senior Designer- Civil / Structural.Precast Senior Designer – Lead Concrete Design & Mentor Future Engineering Leaders.Are you passio...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    DevOps Engineer - Remote (Req. #746, #747)

    DevOps Engineer - Remote (Req. #746, #747)

    Mindex • Rochester, New York, United States
    [filters.remote]
    [job_card.full_time]
    Founded in 1994 and celebrating 30 years in business, Mindex is a software development company with a rich history of demonstrated software and product development success.We specialize in agile so...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    OCPA • Charlotte, New York, us
    [filters.remote]
    [job_card.part_time] +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Delivery Driver - Sign Up and Start Earning

    Delivery Driver - Sign Up and Start Earning

    DoorDash • Hilton, New York, United States
    [job_card.full_time] +1
    Why Deliver with DoorDash? DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Architect - Power & Utilities - Senior Manager- Consulting - Location OPEN

    Data Architect - Power & Utilities - Senior Manager- Consulting - Location OPEN

    EY • Rochester, NY, United States
    [job_card.full_time]
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    ServiceNow Admin / Developer Subject Matter Expert (SME)

    ServiceNow Admin / Developer Subject Matter Expert (SME)

    Damco Solutions • Rochester, NY, United States
    [job_card.full_time]
    Job Title : ServiceNow Admin / Developer Subject Matter Expert (SME).Client Location : Rochester, NY (100% Remote).We are looking for a skilled ServiceNow Admin / Developer Subject Matter Expert (SME) wi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]