Talent.com
Software Engineer - Data Platform
Software Engineer - Data PlatformAvride • Austin, Texas, United States
Software Engineer - Data Platform

Software Engineer - Data Platform

Avride • Austin, Texas, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About the Team

Our team is responsible for the collection, storage, and processing of large-scale datasets generated by autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other onboard systems. Scaling reliable storage and providing efficient compute tools is essential for supporting downstream teams—such as machine learning, simulation, and algorithm development. Our data processing stack incorporates specialized algorithms similar to those deployed directly on autonomous systems in the field.

About the Role

As a Software Engineer, Data Platform at Avride, you will be responsible for designing, building, and maintaining the core data and machine learning infrastructure with a strong focus on software design and code quality. You will design systems to ingest, process, and organize petabytes of telemetry and sensor data into a globally distributed data lake, enabling high-throughput, low-latency access to data for both model training and online inference. Your work will help ML engineers and data scientists iterate faster and deliver better-performing systems.

‍What You'll Do

  • Build and maintain robust data pipelines and core datasets to support simulation, analytics, and machine learning workflows, as well as business use cases
  • Design and implement scalable database architectures to manage massive and complex datasets, optimizing for performance, cost, and usability
  • Collaborate closely with internal teams such as Simulation, Perception, Prediction, and Planning to understand their data requirements and workflows
  • Evaluate, integrate, and extend open-source tools (e.g., Apache Spark, Ray, Apache Beam, Argo Workflows) as well as internal systems

What You'll Need

  • Strong proficiency in Python (required); experience with C++ is highly desirable
  • Proven ability to write high-quality, maintainable code and design scalable, robust systems
  • Experience with Kubernetes for deploying and managing distributed systems
  • Hands-on experience with large-scale open-source data infrastructure (e.g., Kafka, Flink, Cassandra, Redis)
  • Deep understanding of distributed systems and big data platforms, with experience managing petabyte-scale datasets
  • Nice to Have

  • Experience building and operating large-scale ML systems
  • Understanding of ML / AI workflows and experience with machine learning pipelines
  • Experience optimizing resource usage and performance in distributed environments
  • Familiarity with data visualization and dashboarding tools (e.g., Grafana, Apache Superset)
  • Experience with cloud-based infrastructure (e.g., AWS, GCP, Microsoft Azure)
  • Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.

    [job_alerts.create_a_job]

    Software Engineer Data Platform • Austin, Texas, United States

    [internal_linking.similar_jobs]
    Azure Data Engineer

    Azure Data Engineer

    ATTAINX INC • Manor, Texas, United States, 78653
    [job_card.full_time]
    US Citizen w / Active Secret Clearance.We are seeking an experienced Azure Data Engineer with proven ability to evaluate, optimize, and modernize enterprise data warehouse environments.The role comb...[show_more]
    [last_updated.last_updated_variable_days]
    Staff Full Stack Software Engineer, Platform Engineering

    Staff Full Stack Software Engineer, Platform Engineering

    Cloudera • Austin, TX, United States
    [job_card.full_time]
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Forward Deployed

    Senior Software Engineer, Forward Deployed

    Invisible Technologies • Austin, TX, United States
    [job_card.full_time]
    Senior Software Engineer, Forward Deployed.Invisible Technologies makes AI work.Our end-to-end AI platform structures messy data, automates digital workflows, deploys agentic solutions, measures ou...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Data Security Software Engineer

    Principal Data Security Software Engineer

    Dell • Austin, TX, US
    [job_card.full_time]
    Principal Data Security Software Engineer.The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we desig...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Staff Software Engineer - Remote

    Staff Software Engineer - Remote

    TradeJobsWorkForce • 78745 Austin, TX, US
    [filters.remote]
    [job_card.full_time]
    Staff Software Engineer Remote Job Duties : • Implement and evolve a Data Lake storage system with low latency and high thr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    R&D Software Engineer (ESA)

    R&D Software Engineer (ESA)

    University of Texas at Austin • Austin, TX, United States
    [job_card.full_time]
    Advanced Technology Laboratory (ATL).Design, implement and test real-time and data analysis software applications to support the development of high-frequency tactical sonar systems.Work and commun...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer

    Software Engineer

    TradeJobsWorkForce • 78778 Austin, TX, US
    [job_card.full_time]
    Software Engineer Job Duties : Develops information systems by designing, developing, and installin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Procore • Austin, TX, United States
    [job_card.full_time]
    Procore's Product & Technology Team.Procore software solutions aim to improve the lives of everyone in construction and the people within Product & Technology are the driving force behind our innov...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - DevOps

    Senior Software Engineer - DevOps

    Apptronik • Austin, TX, United States
    [job_card.full_time]
    Senior Software Engineer - DevOps.Apptronik is building robots for the real world to improve human quality of life and to help solve the ever-increasing labor shortage problem.Our team has been bui...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Platform Engineer

    Platform Engineer

    Eagle Eye Networks Inc • Austin, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    About Us Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more effi...[show_more]
    [last_updated.last_updated_30]
    GCP Data Engineer

    GCP Data Engineer

    Zone IT Solutions • Austin, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are seeking a talented GCP Data Engineer based in California City.You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Pl...[show_more]
    [last_updated.last_updated_30]
    Senior DevOps Engineer, Mobile Platform

    Senior DevOps Engineer, Mobile Platform

    Procore • Austin, TX, United States
    [job_card.full_time]
    Senior DevOps Engineer, Mobile Platform.In this role, you'll be a key contributor in architecting and maintaining our CI / CD pipelines and infrastructure for native Android, iOS and cross platform m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer - Harbor Data Systems (HDS)

    Senior Data Engineer - Harbor Data Systems (HDS)

    Harbor Health • Austin, TX, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    COMPANY OVERVIEW At Harbor Health, we’re transforming healthcare in Texas through collaboration and innovation.We’re seeking passionate individuals to help us create a member-centered e...[show_more]
    [last_updated.last_updated_variable_days]
    Data Security Software Engineer

    Data Security Software Engineer

    Dell • Austin, TX, US
    [job_card.full_time]
    Data Security Software Engineer The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and de...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Enterprise Application Engineer

    Enterprise Application Engineer

    Q2 • Austin, TX, United States
    [job_card.full_time]
    Q2 is a leading provider of digital banking and lending solutions to banks, credit unions, alternative finance companies, and fintechs in the U. Our mission is simple : build strong and diverse commu...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Software Engineer

    Software Engineer

    TradeJobsWorkforce • 78722 Austin, TX, US
    [job_card.full_time]
    Software Engineer Job Duties : Develops information systems by designing, developing, and instal...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Lever Demo - IS Opportunities • Austin, Texas, United States, 78701
    [job_card.full_time]
    This is a test for all departments and teams in Austin, Texas.Conversica has a strong engineering team that is committed to our customers, passionate about technology and motivated to succeed.We ar...[show_more]
    [last_updated.last_updated_variable_days]
    Principal Software Engineer (Cloud and AI Platforms)

    Principal Software Engineer (Cloud and AI Platforms)

    BlueFlag LLP • Austin, TX, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    BlueFlag is seeking a principal-level software engineer to lead the design and delivery of cloud-native applications, services, and data platform capabilities. In this role, you will be a hands-on t...[show_more]
    [last_updated.last_updated_variable_days]