Talent.com
Data Engineer / Apache Airflow Python / PySpark
Data Engineer / Apache Airflow Python / PySparkMotion Recruitment • Irving, TX, United States
Data Engineer / Apache Airflow Python / PySpark

Data Engineer / Apache Airflow Python / PySpark

Motion Recruitment • Irving, TX, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Data Engineer in Westlake, TX (Hybrid - 3 days onsite / 2 days remote). Act fast and apply now – interviews will kick off next week!

This position can sit at anywhere of the following locations :

  • Westlake, TX
  • Charlotte, NC
  • Chandler, AZ

Minneapolis, MN

  • This role does not allow for C2C consultants nor participate in C2H. Must be authorized to work in the U.S. without sponsorship
  • Work with the brightest minds at one of the largest financial institutions in the world. Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

    Contract Duration : 12 Months

    Top Core Key Skills

  • Python
  • PySpark
  • Apache Airflow
  • Cloudera
  • Google Cloud (GCP) - highly desired

    Required Skills & Experience

  • 5+ years of Data Management, Business Analysis, Analytics, or Project Management experience, or equivalent demonstrated through one or a combination of the following : work or consulting experience, training, military experience, education.
  • 5+ years of experience as Data Engineer
  • 3+ years of hands-on experience building data processing frameworks
  • 3+ years of hands-on experience with developing and maintaining efficient and scalable data pipelines leveraging PySpark and workflow orchestration tools
  • 1+ year experience in using Apache Airflow for workflow orchestration
  • 3+ years of Python programming
  • Experience with SQL and database management systems
  • Experience with Linux

    What You Will Be Doing

  • Consult on or participate in moderately complex initiatives and deliverables within Specialty Software Engineering and contribute to large-scale planning related to Specialty Software Engineering deliverables.
  • Review and analyze moderately complex Specialty Software Engineering challenges that require an in-depth evaluation of variable factors.
  • Contribute to the resolution of moderately complex issues and consult with others to meet Specialty Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements.
  • Collaborate with client personnel in Specialty Software Engineering.

    [job_alerts.create_a_job]

    Data Engineer Python • Irving, TX, United States

    [internal_linking.similar_jobs]
    DataBricks Engineer

    DataBricks Engineer

    Texas State Library and Archives Commision • Irving, TX, United States
    [job_card.full_time]
    GCP Senior Technical Lead with Databricks.Strong proficiency in PySpark, SQL, and Delta Lake.Hands-on experience with GCP Dataproc. Lead the installation and configuration of Databricks on GCP cloud...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Engineer

    Python Engineer

    Echo IT Solutions, Inc. • Farmers Branch, TX, United States
    [job_card.full_time]
    Mechanical Engineering, Applied Mathematics, Physics, Computational Engineering, or related field.Strong command over Python programming with experience in scientific libraries such as NumPy, SciPy...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Python Microservices Developer - TX

    Sr. Python Microservices Developer - TX

    Photon • Irving, TX, United States
    [job_card.full_time]
    Fast API, building API, create microservice using python.Pydantic, Linting using flake8 or similar process in python microservice. Hands on experience using pyMongo integration and retrieval of Mong...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Python Developer with AWS at Dallas, TX (Remote)

    Senior Python Developer with AWS at Dallas, TX (Remote)

    Intellisoft Technologies • Farmers Branch, TX, United States
    [filters.remote]
    [job_card.full_time]
    Job Title : Senior Python Developer with AWS.We load data (from EMS / Kafka / Batch files), store data (in Elasticsearch, OpenSearch, DynamoDB, and soon Aurora), in some cases publish data to Kafka, and...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    VirtualVocations • Grand Prairie, Texas, United States
    [job_card.full_time]
    A company is looking for a Data Engineer with 2-5 years of experience in a GCP-based big data environment.Key Responsibilities Build, maintain, and support data pipelines in Google Cloud Platform...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Python data engineer

    Python data engineer

    CData Software • Irving, TX, United States
    [job_card.full_time]
    Python dev with 10 years and aboveSQL 10 exp years and above Experience with Azure Data Factory, Synapse, Event Hub, AKSHands-on AWS and Azure cloud knowledge 5 yearsDistributed processing framewor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead AI Engineer

    Lead AI Engineer

    Paycom Payroll Llc • Grapevine, Texas, United States
    [job_card.full_time]
    Salary : $100,000 - 140,000 per year.We are looking for a Bachelor's degree holder in Computer Science, Machine Learning, Artificial Intelligence, or a related discipline. The ideal candidate will ha...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Engineer

    Data Engineer

    Omnitech, Inc. • Arlington, Texas, United States
    [job_card.full_time]
    REQUIREMENTS : Qualified candidates must be legally authorized to be employed in the United States on a full-time basis for any position. Omnitech will not provide sponsorship for employment visa sta...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Automation Engineer w / Python programming

    Automation Engineer w / Python programming

    The Judge Group • Irving, TX, United States
    [job_card.full_time]
    Client is looking for Automation engineer with Python, ansible, and Django framework exp.Person will be developing Python code in Cyber Security group as an automation engineer.Wells Fargo is seeki...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    Exadel • Arlington, Texas, United States
    [job_card.full_time]
    We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Sta...[show_more]
    [last_updated.last_updated_30] • [promoted]
    GCP Data Engineer / Lead

    GCP Data Engineer / Lead

    Dexian • Irving, TX, United States
    [job_card.full_time]
    Informatica / DataStage) experience.Google Cloud Platform services like Big Query, Dataflow, Pub / Sub, and Cloud Storage. Query optimization, data structures, transformation, metadata, dependency, and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer + Java

    Data Engineer + Java

    Confidential • Irving, Texas, United States
    [job_card.full_time]
    Bachelor's degree in Computer Science or related technical field, or equivalent practical experience.Listen to Kafka streams (in-house tools). NoSQL database server - MongoDB, Hive, Cassandra.[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Python Developer

    Lead Python Developer

    Ahon Solutions Inc • Irving, TX, United States
    [job_card.full_time]
    About the job Lead Python Developer.Stixis Technologies is a dynamic technology company dedicated to delivering innovative software solutions that empower businesses to thrive in a digital world.We...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Python Developer / Lead

    Sr. Python Developer / Lead

    Dexian • Irving, TX, United States
    [job_card.full_time]
    Required skills and qualifications.Kafka or similar event-streaming platforms.Docker and deploying through CI / CD pipelines (GCP DevOps / GitHub). Own the full lifecycle of the application - from archi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Big Data Lead

    Big Data Lead

    Omni Inclusive • Irving, TX, United States
    [job_card.full_time]
    Lead technical teams in the design and implementation of solutions using apache spark, scala, and python.Provide technical expertise and guidance to team members in resolving complex technical issu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Full Stack Engineer - Data Engineer (Hybrid position)

    Full Stack Engineer - Data Engineer (Hybrid position)

    The Planet Group • Irving, TX, United States
    [job_card.full_time]
    Senior Full Stack / Data Engineering.Net, Angular, Azure Databricks, AI / ML).W2 (We can only consider candidates.Irving, must be onsite Tues, Wed, Thursday. Looking for a Senior Full Stack & Data Engin...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Data Architect

    Data Architect

    Tata Consultancy Services • Southlake, TX, United States
    [job_card.full_time]
    Must Have Technical / Functional Skills : .Strong expertise in data modeling techniques (conceptual, logical, physical).Proficiency in SQL and NoSQL databases (e. MySQL, PostgreSQL, MongoDB, Cassandra)....[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Sr. Python Developer - TX

    Sr. Python Developer - TX

    Photon • Irving, TX, United States
    [job_card.full_time]
    Develop, test, and maintain applications using FastAPI.Design and implement database models and schemas using SQLAlchemy. Integrate user-facing elements developed by front-end developers with server...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]