Talent.com
Software Engineer - Data Platform
Software Engineer - Data PlatformAvride • Austin, Texas, United States
Software Engineer - Data Platform

Software Engineer - Data Platform

Avride • Austin, Texas, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About the Team

Our team is responsible for the collection, storage, and processing of large-scale datasets generated by autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other onboard systems. Scaling reliable storage and providing efficient compute tools is essential for supporting downstream teams—such as machine learning, simulation, and algorithm development. Our data processing stack incorporates specialized algorithms similar to those deployed directly on autonomous systems in the field.

About the Role

As a Software Engineer, Data Platform at Avride, you will be responsible for designing, building, and maintaining the core data and machine learning infrastructure with a strong focus on software design and code quality. You will design systems to ingest, process, and organize petabytes of telemetry and sensor data into a globally distributed data lake, enabling high-throughput, low-latency access to data for both model training and online inference. Your work will help ML engineers and data scientists iterate faster and deliver better-performing systems.

‍What You'll Do

  • Build and maintain robust data pipelines and core datasets to support simulation, analytics, and machine learning workflows, as well as business use cases
  • Design and implement scalable database architectures to manage massive and complex datasets, optimizing for performance, cost, and usability
  • Collaborate closely with internal teams such as Simulation, Perception, Prediction, and Planning to understand their data requirements and workflows
  • Evaluate, integrate, and extend open-source tools (e.g., Apache Spark, Ray, Apache Beam, Argo Workflows) as well as internal systems

What You'll Need

  • Strong proficiency in Python (required); experience with C++ is highly desirable
  • Proven ability to write high-quality, maintainable code and design scalable, robust systems
  • Experience with Kubernetes for deploying and managing distributed systems
  • Hands-on experience with large-scale open-source data infrastructure (e.g., Kafka, Flink, Cassandra, Redis)
  • Deep understanding of distributed systems and big data platforms, with experience managing petabyte-scale datasets
  • Nice to Have

  • Experience building and operating large-scale ML systems
  • Understanding of ML / AI workflows and experience with machine learning pipelines
  • Experience optimizing resource usage and performance in distributed environments
  • Familiarity with data visualization and dashboarding tools (e.g., Grafana, Apache Superset)
  • Experience with cloud-based infrastructure (e.g., AWS, GCP, Microsoft Azure)
  • Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.

    [job_alerts.create_a_job]

    Software Engineer Data Platform • Austin, Texas, United States

    [internal_linking.similar_jobs]
    AI Data Solutions Engineer

    AI Data Solutions Engineer

    Crowe • Austin, TX, United States
    [job_card.full_time]
    Join Crowe's AI Transformation Team.At Crowe, our mission is to enhance the future of human work by harnessing cutting-edge technology and expert knowledge to create AI-driven solutions that redefi...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Azure Data Engineer

    Azure Data Engineer

    ATTAINX INC • Manor, Texas, United States, 78653
    [job_card.full_time]
    US Citizen w / Active Secret Clearance.We are seeking an experienced Azure Data Engineer with proven ability to evaluate, optimize, and modernize enterprise data warehouse environments.The role comb...[show_more]
    [last_updated.last_updated_variable_days]
    Staff Full Stack Software Engineer, Platform Engineering

    Staff Full Stack Software Engineer, Platform Engineering

    Cloudera • Austin, TX, United States
    [job_card.full_time]
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Data Security Software Engineer

    Principal Data Security Software Engineer

    Dell • Austin, TX, US
    [job_card.full_time]
    Principal Data Security Software Engineer.The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we desig...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Security Software Engineer

    Data Security Software Engineer

    Dell • Austin, Texas, United States
    [job_card.full_time]
    Data Security Software Engineer.The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and deve...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    R&D Software Engineer (ESA)

    R&D Software Engineer (ESA)

    University of Texas at Austin • Austin, TX, United States
    [job_card.full_time]
    Advanced Technology Laboratory (ATL).Design, implement and test real-time and data analysis software applications to support the development of high-frequency tactical sonar systems.Work and commun...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Director of Software Development - AI Data Storage Innovations

    Director of Software Development - AI Data Storage Innovations

    Oracle • Austin, TX, United States
    [job_card.full_time]
    Join Oracle Cloud Infrastructure (OCI) in a pivotal role as a.In this influential position, you will spearhead the exploration and integration of innovative distributed data storage services, shape...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Principal Software Engineer

    Principal Software Engineer

    Procore • Austin, TX, United States
    [job_card.full_time]
    Procore's Product & Technology Team.Procore software solutions aim to improve the lives of everyone in construction and the people within Product & Technology are the driving force behind our innov...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Platform Engineer

    Platform Engineer

    Base Power Company • Austin, TX, United States
    [job_card.full_time]
    Base is America's next-generation power company.We're rebuilding the foundation of modern civilization-electricity-by deploying a vast network of distributed batteries that is transforming today's ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Platform Engineer / Architect

    Platform Engineer / Architect

    Zortech Solutions • Austin, TX, United States
    [job_card.full_time]
    Role : Platform Engineer / Architect.Basic Dev and Incident Management), L2 (Complex Incident Management), L3 (Complex Dev) support. New GCP service and / or pattern enablement and support through infras...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Analytics Engineer (Observability Tooling)

    Analytics Engineer (Observability Tooling)

    Sepal • Austin, TX, United States
    [job_card.full_time]
    Sepal AI builds the worlds hardest tests for AI grounded in real-world software systems.Were hiring a Data Engineer with 3+ years of experience and a strong systems mindset to help us build evaluat...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Platform Engineer

    Platform Engineer

    Eagle Eye Networks Inc • Austin, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    About Us Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more effi...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    IQ Clarity, LLC • Austin, TX, US
    [job_card.full_time]
    IQ Clarity's client is seeking a Data Engineer to design, build, and maintain scalable, cloud-based data platforms and pipelines. This role partners closely with engineering, analytics, and business...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Data Engineer - Harbor Data Systems (HDS)

    Senior Data Engineer - Harbor Data Systems (HDS)

    Harbor Health • Austin, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    COMPANY OVERVIEW At Harbor Health, we’re transforming healthcare in Texas through collaboration and innovation.We’re seeking passionate individuals to help us create a member-centered e...[show_more]
    [last_updated.last_updated_variable_days]
    Platform Engineer

    Platform Engineer

    Eagle Eye Networks • Austin, TX, United States
    [job_card.full_time]
    Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Principal Software Engineer (Cloud and AI Platforms)

    Principal Software Engineer (Cloud and AI Platforms)

    BlueFlag LLP • Austin, TX, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    BlueFlag is seeking a principal-level software engineer to lead the design and delivery of cloud-native applications, services, and data platform capabilities. In this role, you will be a hands-on t...[show_more]
    [last_updated.last_updated_variable_days]
    EA-Software Engineer

    EA-Software Engineer

    Social Solutions Global • Austin, TX, United States
    [job_card.full_time]
    US Base Salary Range : $74,600 - $120,000.NGP VAN is the winningest technology platform in the history of democratic and progressive causes, working tirelessly to innovate and advance the technology...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Applied AI Engineer

    Senior Software Applied AI Engineer

    hackerone • Austin, TX, United States
    [job_card.full_time]
    HackerOne is a global leader in Continuous Threat Exposure Management (CTEM).The HackerOne Platform unites agentic AI solutions with the ingenuity of the world's largest community of security resea...[show_more]
    [last_updated.last_updated_1_day] • [promoted]