Talent.com
Senior Data Engineer
Senior Data EngineerStreamline Digital • Frisco, Texas, USA
Senior Data Engineer

Senior Data Engineer

Streamline Digital • Frisco, Texas, USA
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Who We Are

At Streamline we are experts in Enterprise Mobility Product Engineering and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our clients organization is armed with the strategies products and solutions that are transformative to their business. Streamline works closely with our clients takes pride in developing genuine relationships and embraces open communication and collaboration. Our team is comprised of world-class strategists architects engineers and developers.

Overview

This is a fully remote position. We are seeking a highly experienced and motivated Senior Data Engineer to design develop and optimize our data infrastructure and pipelines. The ideal candidate will have extensive experience across the Microsoft Azure data ecosystem and advanced proficiency in key data processing and analysis technologies. You will be instrumental in transforming raw data into actionable insights for the business.

Key Responsibilities

  • Design and Development : Design build and maintain robust scalable and efficient ETL / ELT pipelines using Azure Data Factory (ADF) and Databricks (using Python ).
  • Data Modeling & Storage : Develop and optimize data models in various storage solutions including Azure Data Explorer (ADX) and No-SQL databases.
  • Performance Optimization : Tune and improve the performance of data pipelines and data storage solutions for optimal data retrieval and processing speeds.
  • Collaboration : Work closely with data scientists analysts and business stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Data Visualization Support : Ensure data is accurately structured and prepared for visualization tools primarily Power BI .
  • Quality & Governance : Implement best practices for data quality security and governance across all data platforms.

Qualifications and Experience

  • Bachelors or Masters degree in Computer Science Engineering or a related quantitative field.
  • Minimum 10 years of professional hands-on experience across the following technologies :
  • Python : Expert-level proficiency in Python for data manipulation scripting and pipeline development.
  • Azure : Deep knowledge and experience with the Azure cloud platform and its core data services.
  • Azure Data Factory (ADF) : Extensive experience in building and managing complex orchestrated data pipelines.
  • Azure Data Explorer (ADX) : Proven experience with ingesting querying and optimizing data within ADX (Kusto) .
  • No-SQL : Strong understanding and practical experience with No-SQL databases (e.g. Cosmos DB MongoDB Cassandra).
  • Databricks : Hands-on experience with Databricks environments Spark and developing scalable data processing solutions.
  • Power BI : Experience preparing data specifically for and a strong understanding of how data is consumed by Power BI reports and dashboards.
  • Experience with stream processing technologies (e.g. Azure Event Hubs Kafka).
  • Azure certification (e.g. Azure Data Engineer Associate - DP-203).
  • Technical Skills

    Solid understanding of modern data warehousing concepts including Kimball and Inmon methodologies.

  • Experience with version control systems (e.g. Git).
  • Familiarity with CI / CD processes for data infrastructure deployment.
  • What We Offer

  • A challenging and rewarding role in a dynamic and international environment.
  • Opportunity to be part of a growing company with a strong commitment to innovation and excellence.
  • A supportive and collaborative team culture that values personal growth and development.
  • Competitive compensation and benefits package.
  • Required Experience :

    Senior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    [job_alerts.create_a_job]

    Senior Data Engineer • Frisco, Texas, USA

    [internal_linking.similar_jobs]
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Dallas, Texas, United States
    [job_card.full_time]
    A company is looking for a Senior Data Engineer to drive business understanding and leverage data for actionable insights. Key Responsibilities Understand business processes to identify key metric...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    SR Data Engineer

    SR Data Engineer

    Alliance Technical Group • Dallas, TX, United States
    [job_card.full_time]
    Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms.In...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Streamline Digital • Frisco, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Who We Are At Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation.We help organizations navigate the constantly evolving landscape of IT.Our sole focus is ...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Big Data Engineer

    Senior Big Data Engineer

    Apex Informatics • Plano, TX, United States
    [job_card.full_time]
    Very Strong Java or Python coding.Looking for true software engineering skill set.Experience working with large data sets, ETL, or applications that do high-volume data collection.Spark or other la...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Ascentt • Plano, Texas, United States
    [job_card.full_time]
    Describe the role and team the candidate will be joining.Describe the specific responsibilities and job functions of the role. Describe the experience and attributes of the ideal candidate.[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    GalaxEsystems • Plano, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Senior Data Engineer Location : .Remote Visa : USC / GC / Ead We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions.The ideal candidate will...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    Cg Infinity • Plano, Texas, United States
    [job_card.full_time]
    Data Engineer (Full Time Position) Dallas, TX.We offer solutions that are tailored to the needs of each individual cli...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    PollyEx • Dallas, Texas, United States, 75201
    [job_card.full_time]
    Youre a hands on Senior Data Engineer with strong Python skills and experience building robust data pipelines in cloud environments. You enjoy solving complex data problems, working cross-functional...[show_more]
    [last_updated.last_updated_30]
    Senior Data Engineer - Microsoft Fabric

    Senior Data Engineer - Microsoft Fabric

    Accellor • Dallas, Texas, United States
    [filters.remote]
    [job_card.full_time]
    At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients.We’ve created an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Business Needs Inc. • Dallas, TX, US
    [job_card.full_time]
    Snowflake Data Engineer-ONLY LOCAL.Location : Dallas, TX (Onsite from Day 1st).This role is for an expert Snowflake Data Engineer with. You will design, implement, and deploy scalable Snowflake archi...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Engineer (Databricks+ ADF)

    Data Engineer (Databricks+ ADF)

    Allata • Dallas, Texas, United States
    [job_card.full_time]
    Allata is a global consulting and technology services firm with offices in the US, India, and Argentina.We help organizations accelerate growth, drive innovation, and solve complex challenges by co...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    AmTrust Financial • Dallas, TX, United States
    [job_card.full_time]
    US-TX-Dallas | US-OH-Cleveland.We are seeking a highly skilled.This role will focus on migrating on-premise systems to the cloud, consolidating data warehouses, and designing scalable architecture ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Lead Data Engineer (Intelligent Foundations and Experiences) (Plano)

    Senior Lead Data Engineer (Intelligent Foundations and Experiences) (Plano)

    Capital One • Plano, Texas, US
    [job_card.full_time] +1
    Senior Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Enable Data Incorporated • Plano, Texas, United States
    [job_card.full_time]
    At Enable Data Incorporated, we are excited to welcome a talented Senior AWS Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and cloud engineering service...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AWS Cloud Data Engineer

    Senior AWS Cloud Data Engineer

    BOK Financial • Addison, TX, United States
    [job_card.full_time]
    Information Technology; Information Services.Pay Transparency Salary Range : .BOK Financial Corporation Group includes BOKF, NA. BOK Financial Securities, Inc.BOK Financial Private Wealth, Inc.BOKF, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Data Engineer

    Azure Data Engineer

    Futran Tech Solutions Pvt. Ltd. • Dallas, TX, United States
    [job_card.full_time]
    Wipro Limited (NYSE : WIT, BSE : 507685, NSE : WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transf...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer - Hybrid (Houston or Dallas, TX)

    Lead Data Engineer - Hybrid (Houston or Dallas, TX)

    Aecom • Dallas, Texas, United States
    [job_card.full_time]
    At AECOM, we're delivering a better world.Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Data Engineer I

    Sr. Data Engineer I

    Axs • Frisco, Texas, United States
    [job_card.full_time]
    AXS connects fans with the artists and teams they love.Each year we sell millions of tickets to thousands of incredible events – from concerts and festivals to sports and theater – at some of the m...[show_more]
    [last_updated.last_updated_30] • [promoted]