Talent.com
Data Engineer
Data EngineerComerica Bank • Frisco, TX
Data Engineer

Data Engineer

Comerica Bank • Frisco, TX
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Data Engineer II

A Data Engineer II works alongside Information Architects, Engineers, Data Scientists, and other stakeholders to design, develop, deploy, and end-to-end testing of moderate to advanced data pipelines. The Data Engineer II is responsible for building and maintaining the data pipelines and the data in relational and non-relational databases that support various data engineering applications, tools. The Data Engineer II is responsible for developing and supporting reports that provide accurate and timely data for internal and external clients. The incumbent will develop and maintain the data infrastructure that powers our ability to make timely and data-driven decision. This role requires familiarity of data architecture and extraction & manipulation of data sets of various sizes. Position Responsibilities :

Design and Methodology

  • Design, implement and operate medium to large-scale, high-volume, high-performance data structures for reporting, analytics, and data science.
  • Write and refine code to ensure performance and reliability of data extraction and processing.
  • Implement data ingestion routines both real time and batch using best practices in data modeling, ETL / ELT processes by leveraging big data tools.
  • Create data products for analytics and Data Scientist team members to improve their productivity.
  • Document and test moderate data systems that bring together data from disparate sources, making it available to Data Scientists, and other users using scripting and / or programming languages.
  • Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages etc.)
  • Leverage the understanding of software architecture and software design patterns to write scalable, maintainable, well-designed, and future-proof software.
  • Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.)
  • Design and build solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations.
  • Document and test data processes including performance of through data validation and verification.

Technical Consulting

  • Gather business and functional requirements and translate these requirements into robust, scalable operable solutions with a flexible and adaptable data architecture.
  • Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
  • Collaborate with Data Scientists to create fast and efficient algorithms that exploit our rich data sets for optimization, statistical analysis, prediction, clustering, and machine learning.
  • Coordination with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting.
  • Participate in sprint planning meetings as needed.
  • Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
  • Optimize support for ad-hod analysis across various data sources.
  • Planning & Organizing

  • Ensure best practices are followed across architecture, codebase, and configuration.
  • Continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
  • In collaboration with the Data Engineer III, contribute to the exploration and understanding of new tools and techniques for improvements to the data pipeline.
  • Risk Management

  • Review and are familiar with automated processes for performance and fault tolerance.
  • Review functional and technical designs to identify areas of risk and any missing requirements.
  • Design and implement security measures to protect data from unauthorized access or misuse.
  • In collaboration with the Data Engineer III, design backup and recovery procedures to ensure data integrity is maintained.
  • Administration / Support

  • Keeps management informed of status of on activities through accurate, timely, and appropriate reporting.
  • Contribute to Data Governance, system documentation and sharing of data asset knowledge.
  • Actively participates in committees representing the department and / or planning unit.
  • Keeps abreast of leading-edge technologies in the Data Engineering space.
  • [job_alerts.create_a_job]

    Data Engineer • Frisco, TX

    [internal_linking.similar_jobs]
    Data Engineer with Snowflake Certification

    Data Engineer with Snowflake Certification

    VirtualVocations • Dallas, Texas, United States
    [job_card.temporary]
    A company is looking for a Senior Data Engineer for a 6-month contract position that may work 100% remotely.Key Responsibilities Develop efficient and scalable data extraction methodologies from ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    SR Data Engineer

    SR Data Engineer

    Alliance Technical Group • Dallas, TX, United States
    [job_card.full_time]
    Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms.In...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Protagona • Dallas, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS.Client engag...[show_more]
    [last_updated.last_updated_30]
    Cloud Data Engineer (AWS / Databricks)

    Cloud Data Engineer (AWS / Databricks)

    Purple Drive • Plano, TX, United States
    [job_card.full_time]
    Design, build, and optimize scalable data pipelines and frameworks on.EMR, EKS, S3, and related services.Implement infrastructure as code (IaC) solutions using. Write efficient, reusable, and optimi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Ascentt • Plano, Texas, United States
    [job_card.full_time]
    Describe the role and team the candidate will be joining.Describe the specific responsibilities and job functions of the role. Describe the experience and attributes of the ideal candidate.[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Royal Electric • Dallas, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    At Royal Electric Company we provide expert electrical design, construction, and service with builders, contractors and facility owners who value relationships, trust, expertise, and a commitment t...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Data Engineer

    Senior Data Engineer

    Streamline Digital • Frisco, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Who We Are At Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation.We help organizations navigate the constantly evolving landscape of IT.Our sole focus is ...[show_more]
    [last_updated.last_updated_variable_days]
    Data Engineer

    Data Engineer

    Cg Infinity • Plano, Texas, United States
    [job_card.full_time]
    Data Engineer (Full Time Position) Dallas, TX.We offer solutions that are tailored to the needs of each individual cli...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer-2

    Data Engineer-2

    eTeam Inc • Plano, Texas, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Extensive experience in designing, configuring, deploying, managing and automating AWS Core Services like S3, IAM, EC2, Route53, SNS, SQS, ELB, CloudWatch, Lambda and VPC.Experience in automating c...[show_more]
    [last_updated.last_updated_30]
    Data Engineer / Architect

    Data Engineer / Architect

    InstantServe LLC • Dallas, TX, United States
    [job_card.full_time]
    Note : Big Data with strong SQL curricula will match the demand.Architect, Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer (Databricks+ ADF)

    Data Engineer (Databricks+ ADF)

    Allata • Dallas, Texas, United States
    [job_card.full_time]
    Allata is a global consulting and technology services firm with offices in the US, India, and Argentina.We help organizations accelerate growth, drive innovation, and solve complex challenges by co...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer Lead : 24-02271 (No C2C)

    Data Engineer Lead : 24-02271 (No C2C)

    Akraya Inc • Dallas, Texas, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    AWS, SQL, Python, Redshift, S3.Dallas, TX OR Seattle, WA (Hybrid.Plan, design, implement, and manage a deployment of self-service data platform using native AWS services. Design, build, and maintain...[show_more]
    [last_updated.last_updated_30]
    GCP Data Engineer

    GCP Data Engineer

    Biogensys • Dallas, TX, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are hiring a GCP Data Engineer for one of our clients in Dallas, TX.Job Description : Yahoo is a global media and tech company connecting...[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Enable Data Incorporated • Plano, Texas, United States
    [job_card.full_time]
    At Enable Data Incorporated, we are excited to welcome a talented Senior AWS Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and cloud engineering service...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AWS Cloud Data Engineer

    Senior AWS Cloud Data Engineer

    BOK Financial • Addison, TX, United States
    [job_card.full_time]
    Information Technology; Information Services.Pay Transparency Salary Range : .BOK Financial Corporation Group includes BOKF, NA. BOK Financial Securities, Inc.BOK Financial Private Wealth, Inc.BOKF, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Data Engineer

    Azure Data Engineer

    Futran Tech Solutions Pvt. Ltd. • Dallas, TX, United States
    [job_card.full_time]
    Wipro Limited (NYSE : WIT, BSE : 507685, NSE : WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transf...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer - Hybrid (Houston or Dallas, TX)

    Lead Data Engineer - Hybrid (Houston or Dallas, TX)

    Aecom • Dallas, Texas, United States
    [job_card.full_time]
    At AECOM, we're delivering a better world.Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Data Engineer I

    Sr. Data Engineer I

    Axs • Frisco, Texas, United States
    [job_card.full_time]
    AXS connects fans with the artists and teams they love.Each year we sell millions of tickets to thousands of incredible events – from concerts and festivals to sports and theater – at some of the m...[show_more]
    [last_updated.last_updated_30] • [promoted]