Talent.com
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Data Engineering (Palantir, Spark, PySpark, Python)- W2 RoleCLOUDSCOUTS SOFTWARE SOLUTIONS LLC • Frisco, TX, US
Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role

Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role

CLOUDSCOUTS SOFTWARE SOLUTIONS LLC • Frisco, TX, US
30+ days ago
Job type
  • Full-time
Job description

Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python)

Please dont apply if you dont have
PALANTIR experience

Onsite work :One or two days in a month
W2 role
OPT with 7 years exp is fine



Job Summary


We are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations.


Key Responsibilities


  • Lead the design and implementation of scalable data platforms and pipelines using PySpark, Spark, and Python
  • Drive adoption and best practices for Palantir Foundry (data pipelines, ontology, workflows, and operational applications)
  • Architect and optimize high-performance data processing solutions for large-scale datasets
  • Provide technical leadership and mentorship to data engineers, ensuring code quality and best practices
  • Collaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions
  • Design robust data models, ETL/ELT frameworks, and data integration strategies
  • Ensure data quality, governance, security, and compliance across enterprise data platforms
  • Lead performance tuning, troubleshooting, and optimization of data pipelines
  • Drive CI/CD implementation, code reviews, and release management
  • Stay current with emerging data engineering technologies and recommend improvements

Required Qualifications


  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
  • 8+ years of experience in data engineering, with at least 2–3 years in a technical leadership role
  • Strong hands-on experience with:
    • Python & PySpark
    • Apache Spark
    • Advanced SQL
  • Experience with Palantir Foundry or similar modern data platforms
  • Deep understanding of data engineering principles (ETL/ELT, data modeling, distributed systems)
  • Experience designing and managing large-scale data architectures
  • Strong leadership, communication, and stakeholder management skills

Preferred Qualifications


  • Experience in retail domain (supply chain, inventory, merchandising, store analytics)
  • Experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with orchestration tools (Airflow, Azure Data Factory, etc.)
  • Experience with real-time/streaming data pipelines
  • Exposure to DevSecOps practices

Key Skills


  • Technical Leadership
  • Data Engineering Architecture
  • PySpark & Spark
  • Python Programming
  • SQL Optimization
  • Palantir Foundry
  • Data Modeling & Warehousing
  • CI/CD & DevOps

Flexible work from home options available.

Create a job alert for this search

Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role • Frisco, TX, US

Similar jobs

Senior ML Data Engineer - Remote

KaavPlano, TX, United States
Remote
Full-time

Senior ML Data Engineer Feature Engineering ETL.ML feature engineering ETL pipeline development and data preparation for ML.Proven experience managing pipelines on Databricks using Apache Spark wit... Show more

 • Promoted

Data Engineer

SynergisticITDallas, TX, United States
Full-time

For over 15 years, SynergisticIT has empowered job seekers to successfully transition into the tech industry by providing them with the in-demand technical skills, hands-on experience, and real-wor... Show more

 • Promoted

Python FullStack Developer

Argyle InfotechFrisco, TX, United States
Full-time

Location: Remote (Local to Texas) need locals.Duration: Long Term (Contract / Full time) position.Key Skills: Python, NodeJS, React JS, Redux & Hooks, AWS Lambda.Indium is looking for a talented an... Show more

 • Promoted

Python Developer | ONSITE - Plano, TX

KaavPlano, TX, United States
Full-time

Work Location: ONSITE - Plano, TX.Must be able to work onsite from the first day of the assignment.Ability to lead a team of Python Developers to deliver a module assigned (design, document, code, ... Show more

 • Promoted

Data Engineer with SQL, Python & Java w/banking or FIS

Staffing the UniversePlano, TX, United States
Full-time

Data Engineer with SQL, Python & JavaRole:Data Engineer with SQL, Python & JavaLocation:Onsite in Plano, TX (Local ONLY)Duration:1year MOI:VIDEO & F2F NO RELOCATIONWe need:Three Senior ... Show more

 • Promoted

Senior SAP Hybris Developer

KaavRichardson, TX, United States
Full-time

As a Senior SAP Hybris Developer, you will play a critical role in designing, developing, and maintaining our SAP Hybris e-commerce platform with a particular emphasis on web services.You will work... Show more

 • Promoted

Enterprise Data Warehouse (EDW) Informatica ETL Developer

RIT SolutionsDallas, TX, United States
Full-time

Informatica PowerCenter and ETL development.Teradata (v17+), including Fastload, TPT, and Multiload utilities.Informatica PowerCenter administration experience.Unix Shell (Bash/Korn) scripting expe... Show more

 • Promoted

Python Developer - Dallas, TX

StaffingDallas, TX, United States
Full-time

Strong programming skills in Python programming language.Experience with writing and testing Python code, debugging for various projects.Familiarity with popular Python frameworks such as Django, F... Show more

 • Promoted

Business Analyst - Data Engineering & Power BI

Argyle InfotechDallas, TX, United States
Full-time

We are seeking a Business Analyst with strong experience in Data Engineering, ETL processes, Databricks, and Power BI reporting.The candidate will work closely with business stakeholders and data e... Show more

 • Promoted

Databricks Data Engineer with Pyspark

Argyle InfotechDallas, TX, United States
Full-time

Role: Databricks Data Engineer with Pyspark Profile Type: Hybrid Client Location: Dallas, TX JD: 8+ Years of experience as Databricks Data Engineer with Pyspark Share updated resume to: rahulk@argy... Show more

 • Promoted

Sr AWS/Big Data developer

ClifyXDallas, TX, United States
Full-time

Location: Dallas, TX or Louisville, KY.Visa type: Citizen/Green card/H1B.Excellent knowledge of Spark, Spark MLib, Scala, HBase, Hive.Good knowledge of AWS environment - EC2, S3, EBS.Knowledge of C... Show more

 • Promoted

SAP HANA Lead Developer

ClifyXDallas, TX, United States
Full-time

Location: Dallas, TX Duration: 6 Months.We expect the developer to work on Calculation Views/Stored Procedures/SLT (Replication) and have expertise in Performance Tuning to make sure there is no is... Show more

 • Promoted

Data Engineer- Plano TX

StaffingPlano, TX, United States
Full-time

Required Skills: Unix, Python, PySpark, SQL, AWS.Analyze business processes to identify areas for improvement and optimization.Develop and maintain data pipelines using Python and PySpark to ensure... Show more

 • Promoted

Data Engineer

Argyle InfotechDallas, TX, United States
Full-time

Location: Dallas, TX Duration: 11 Months.Required skillset: Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, Basics of Azure, Knowledge of Data Lake, Data Warehouse conc... Show more

 • Promoted

Python Developer-Plano, TX

StaffingPlano, TX, United States
Full-time

Duration: 6+ months Location: Plano, TX (Hybrid).Looking for a junior Python developer with minimum 2+ years of experience.Deliver high quality code on time and follow our SDLC process.Own the perf... Show more

 • Promoted

Snowflake Data Engineer

Syntricate TechnologiesRichardson, TX, United States
Full-time

Strong in SQL and Python, 8+ years' experience.Experience with big data frameworks (i.Hadoop and Spark), 5+ years' experience.Experience building automated data pipelines, 5+ years of experience.Ex... Show more

 • Promoted

Senior SAP R2R Lead

Echo IT SolutionsDallas, TX, United States
Full-time

Senior Sap R2r Lead - Atlanta, Ga / Onsite For The Rate Agreed. Show more

 • Promoted

Big Data Engineer

Syntricate TechnologiesPlano, TX, United States
Full-time

We are looking for a big data engineer with Java/AWS experience.This is a hybrid role in Plano, TX, and is a W2 contract only.The ideal candidate will have a combination of Java and Python skills, ... Show more

 • Promoted

Big Data Architect

Argyle InfotechDallas, TX, United States
Full-time

Skills: Databricks and Pyspark Experience, Migration from Teradata to Databricks using Pyspark. Show more

 • Promoted

Senior Data Engineer Remote, High-Volume E-commerce

ShutterflyPlano, TX, United States
Remote
Full-time

A prominent e-commerce company is seeking a Principal Data Engineer to design and maintain data pipelines for marketing and customer engagement.This fully remote position requires 710 years of expe... Show more