Talent.com
Data Engineer
Data EngineerArtech • Plano, TX, United States
Data Engineer

Data Engineer

Artech • Plano, TX, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]
Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview

Overview:

We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction.

Key Responsibilities:
  • Build and maintain APIs to support enterprise-wide data needs.
  • Analyze large volumes of data and write efficient SQL queries.
  • Develop and manage billing data pipelines.
  • Design and implement ETL pipelines for processing large-scale data.
  • Collaborate with the compliance team as part of the centralized data management team.
  • Ensure compliance with regulatory and ethical standards through effective data management.
  • Handle high-volume data processing and optimize performance.
  • Work closely with stakeholders to gather requirements and provide data-driven solutions.
  • Experience working with financial institutions is preferred.
About the Team:
  • We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
  • This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
  • We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
  • Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
  • This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.
Data Volume and Infrastructure:
  • We manage approximately 40 million records daily, with potential increases beyond this figure.
  • Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
  • These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
  • On average, we handle 60 to 70 million records within our data pipelines.
Skills:
  • AWS: 20%
  • Python: 20%
  • Scala: 20%
  • Spark: 20%
  • SQL: 20%

For immediate consideration please click APPLY.
[job_alerts.create_a_job]

Data Engineer • Plano, TX, United States

[internal_linking.similar_jobs]

DATA ENGINEER

Purple DrivePlano, TX, United States
[job_card.full_time]

Design, build, and monitor ETL/ELT pipelines for scalable data processing.Automate data ingestion using APIs and scripting tools.Implement automated health checks and pipeline monitoring systems.Wo...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Experis/Manpower GroupDallas, TX, United States
[job_card.full_time]

Our client, a leading organization in the technology and data industry, is seeking a Data Engineer to join their team.As a Data Engineer, you will be part of the Data Engineering Department support...[internal_linking.show_more]

 • [job_card.promoted]

Lead Data Engineer

Coca Cola Southwest BeveragesDallas, Texas, United States
[job_card.full_time]

This role oversees and manages the work of Data Engineer who design and develop ETL pipelines and processes in our Cloud Infrastructure.They are responsible for the overall data integrity and quali...[internal_linking.show_more]

 • [job_card.promoted]

Senior Data Engineer (Developer)

BravoTECHDallas, TX, United States
[job_card.full_time]

Senior Data Engineer (Developer).Join Our Innovative MediaLab Team as a Senior Data Engineer.Are you passionate about designing cutting-edge data solutions and eager to contribute to a dynamic, col...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Genesis10Plano, TX, United States
[job_card.full_time] +1

Genesis10 is currently seeking a Data Engineer for a full-time, direct hire opportunity with a Top-Tier Financial Institution located in Plano, TX.The salary range for this position is $130-$150K.Y...[internal_linking.show_more]

 • [job_card.promoted]

Databricks Data Engineer - Senior - Consulting - Location Open

EYDallas, TX, United States
[job_card.full_time]

At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

ExperisDallas, TX, United States
[job_card.full_time]

Our client, a leading organization in the technology and data industry, is seeking a Data Engineer to join their team.As a Data Engineer, you will be part of the Data Engineering Department support...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

YochanaDallas, TX, United States
[job_card.full_time]

Design, build, and maintain scalable data pipelines using Python, SQL, PySpark, and Microsoft Fabric.Integrate with external systems using REST/Graph APIs, managing authentication, pagination, rate...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

ConnectedX IncPlano, TX, United States
[job_card.full_time]

Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem.Success in designing and impleme...[internal_linking.show_more]

 • [job_card.promoted]

Mid Data Engineer

My3Tech IncPlano, TX, United States
[job_card.full_time]

Must have independently worked on at least 2 to 3 mid to large-sized development projects.Supports the creation of unit tests to ensure accuracy.Track record of identifying largest risk areas and d...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer with AWS

VBeyondDallas, TX, United States
[job_card.full_time]

Location : Dallas, TX (100% Onsite) - Only Local candidates.Mandate : AWS , Databricks , Python /Java /Scala , Kafka , ETL.As part of our global team, you will be responsible for the specification,...[internal_linking.show_more]

 • [job_card.promoted]

Contract Data Engineer

Three Point TurnDallas, TX, United States
[job_card.full_time]

About Us: Three Point Turn is a forward-thinking technology company focused on delivering innovative, scalable solutions that empower organizations to harness their data and drive strategic growth....[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

r2 Technologies, Inc.Plano, TX, United States
[job_card.full_time]

We hire the best employees to serve our customers.We are looking for an experienced Software Developers and Engineers who has a passion for building software solutions, asking questions to solve cu...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Kasmo GlobalDallas, TX, United States
[job_card.full_time]

Primary skills: Azure, Databricks, AWS.Should you be interested, please send me a copy of your resume in word format along with the following details ASAP.[internal_linking.show_more]

 • [job_card.promoted]

Lead Data Engineer

Capital One Financial CorpPlano, TX, United States
[job_card.full_time] +1

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Axelon Services CorporationDallas, TX, US
[job_card.full_time]

Summary: Work Mode: Not specified Responsibilities: Identify stakeholders, gather business and technical requirements, and develop a project plan for the company team.Break the project into phases,...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer - Sr. Databricks Engineer

CapgeminiDallas, TX, United States
[job_card.full_time]

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues...[internal_linking.show_more]

 • [job_card.promoted]

Data Engineer

Keylent IncPlano, TX, United States
[job_card.full_time]

Required Skills : Unix,Java,Spring Boot,Spark,SQL,AWS.As a Data Engineer within our multinational corporation, you will leverage your expertise in Java, SpringBoot, Spark, AWS, SQL, and Unix to dri...[internal_linking.show_more]