Talent.com
Senior Data Engineer
Senior Data EngineerAuthority Partners • Irvine, California
Senior Data Engineer

Senior Data Engineer

Authority Partners • Irvine, California
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.permanent]
  • [filters.remote]
[job_card.job_description]

Authority Partners is seeking an experienced Data Engineer to join our team. You will design, expand, and optimize data pipelines and architectures to support cross-functional teams. The ideal candidate is skilled in building and enhancing data systems, supporting developers, analysts, and scientists, and ensuring seamless data delivery across projects.

Up for the challenge? Then read on and apply!

Responsibilities :

  • Design, build, and maintain reliable and scalable data pipelines for ingesting, transforming, and delivering structured and unstructured data.
  • Implement batch and streaming data workflows that support real-time and analytical use cases.
  • Optimize data flows for performance, cost-efficiency, and maintainability.
  • Develop and maintain data models that support business intelligence, analytics, and operational needs.
  • Ensure effective partitioning, indexing, and data lifecycle management strategies.
  • Collaborate with analysts and business stakeholders to understand data requirements and deliver high-quality datasets and data products.
  • Implement data quality checks, monitoring, and validation processes to ensure data accuracy and integrity.
  • Ensure compliance with relevant data governance, security, and privacy standards.
  • Monitor and troubleshoot data pipelines and systems to ensure reliability and high availability.
  • Design and develop interactive dashboards and reports that provide actionable insights to stakeholders, ensuring data is presented in a clear, intuitive, and visually compelling manner.

What you have :

  • Strong experience with Databricks for building scalable data pipelines and transformation workflows.
  • Hands-on experience with PySpark for distributed data processing.
  • Strong proficiency in SparkSQL for data transformation and analysis.
  • Solid understanding of data pipelines and data modelling.
  • You stand out if you have :

  • Experience working with Azure cloud services.
  • Working knowledge of Databricks Dashboards.
  • Exposure to data visualization tools (Power BI, Tableau, Looker).
  • Experience with CI / CD pipelines for data engineering workflows.
  • Working knowledge of Microsoft Fabric and Dynamics 365 Finance and Operations.
  • Education :

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
  • About Authority Partners :

    Authority Partners is a leading and global IT services company with over 25 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success.

    Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.

    [job_alerts.create_a_job]

    Senior Data Engineer • Irvine, California

    [internal_linking.similar_jobs]
    Remote Senior SQL Engineer - AI Trainer

    Remote Senior SQL Engineer - AI Trainer

    SuperAnnotate • Dana Point, California, US
    [filters.remote]
    [job_card.full_time]
    As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Earn Haus • Dana Point, CA, US
    [filters.remote]
    [job_card.full_time] +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    PT Senior Sales Associate Store 2607

    PT Senior Sales Associate Store 2607

    Music & Arts • San Clemente, CA, US
    [job_card.full_time]
    The purpose of this job is to consistently achieve individual sales goals to support the store's sales and profit objectives, provide superior customer service, and take on other senior-level respo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Design Engineer

    Senior Design Engineer

    Essel • Pomona, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are seeking a highly skilled and motivated Design Engineer to lead our design team in the development of plans and specifications for our water capital improvement projects.The Design Engineer w...[show_more]
    [last_updated.last_updated_30]
    PLM Data Migration Application Engineer

    PLM Data Migration Application Engineer

    Saratech • Mission Viejo, CA, USA
    [job_card.full_time] +1
    [filters_job_card.quick_apply]
    PLM Data Migration Senior Application Engineer Job Description.Position : Product Lifecycle Management (PLM) Data Migration Senior Application Engineer. From start-ups to blue-chips, Saratech (sarate...[show_more]
    [last_updated.last_updated_30]
    Senior Software Engineer

    Senior Software Engineer

    JS Consulting • Irvine, CA, United States
    [job_card.temporary]
    [filters_job_card.quick_apply]
    Job Title- Senior Software Engineer Project Location Irvine, CA (Onsite) Duration- 12+ months cont...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Dana Point, California
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Data Engineer

    Principal Data Engineer

    Americor • Irvine, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Americor is a leading provider of debt relief solutions for people of all backgrounds.We offer various services to help our clients achieve financial freedom, including debt consolidation loans, de...[show_more]
    [last_updated.last_updated_30]
    Cloud Data & AI Engineer

    Cloud Data & AI Engineer

    OSI Digital • Irvine, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Cloud Data & AI Engineer Employment : Full-time At OSI Digital Inc, we accelerate our client’s digital transformation journey by delivering modern data solutions, enabling them to unlock t...[show_more]
    [last_updated.last_updated_30]
    Staff AI Engineer

    Staff AI Engineer

    GoodLeap • Irvine, California, United States, 92602
    [job_card.full_time]
    [filters_job_card.quick_apply]
    GoodLeap is a technology company delivering best-in-class financing and software products for sustainable solutions, from solar panels and batteries to energy-efficient HVAC, heat pumps, roofing, w...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Full-stack Software Engineer

    Senior Full-stack Software Engineer

    Kettle • Irvine, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    About Us and Position Overview.Kettle is a fast growing Managing General Agency (MGA) specializing in wildfire insurance combining advanced underwriting technology with deep industry experience.We’...[show_more]
    [last_updated.last_updated_less] • [new]
    AWS Redshift Data Engineer / Data Architect

    AWS Redshift Data Engineer / Data Architect

    Numentica LLC • Corona, CA, us
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are looking for a senior AWS Redshift expert to support analytics platform enhancements, including Redshift optimization, migration to Redshift Serverless, and modern data ingestion architecture...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Engineer, Machine Learning

    Senior Engineer, Machine Learning

    Syntiant • Irvine, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    AI software and semiconductor solutions space, is looking for an experienced and talented.Senior Engineer, Machine Learning. Machine Learning function in a growing organization.Senior Engineer, Mach...[show_more]
    [last_updated.last_updated_variable_days]
    Nuclear Engineer

    Nuclear Engineer

    U.S. Navy • San Clemente, CA, US
    [job_card.full_time]
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.The most powerful energy sources in the world need the most powerful minds behind them.As a Nuclear Reactors Eng...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Information Technology Professional

    Information Technology Professional

    U.S. Navy • San Clemente, CA, US
    [job_card.full_time] +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.At any given moment, hundreds of complex networked computer systems are operating in tandem to keep ships and su...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Shift Leader (P1-1360764-0)

    Shift Leader (P1-1360764-0)

    Panda Restaurant Group • San Clemente, CA, United States
    [job_card.full_time]
    Our Panda Shift Leader associates are important leaders of our team and are responsible for bringing Panda's mission alive in our restaurants by supporting management in creating food with passion,...[show_more]
    [last_updated.last_updated_30] • [promoted]
    10607 – Software Engineer III (Data Engineer)

    10607 – Software Engineer III (Data Engineer)

    Hyundai Autoever America • Irvine, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Software Engineer III (Data Engineer), Irvine, CA Company Overview Hyundai AutoEver America (HAEA) is the dynamic IT powerhouse behind Hyundai Motor Corporation, a Fortune 500 global leader in...[show_more]
    [last_updated.last_updated_variable_days]
    Principal / Distinguished Engineer - Distributed Systems, Graph Databases, and Planet-Scale AI [...]

    Principal / Distinguished Engineer - Distributed Systems, Graph Databases, and Planet-Scale AI [...]

    Anonymous • Laguna Beach, CA, United States
    [job_card.full_time]
    Principal / Distinguished Engineer - Distributed Systems, Graph Databases, and Planet-Scale AI Infrastructure.Mobius is creating the foundational infrastructure for the next generation of AI econom...[show_more]
    [last_updated.last_updated_30] • [promoted]