Talent.com
LLM Applications Engineer (Enterprise)
LLM Applications Engineer (Enterprise)Rise Technical Recruitment Limited • San Francisco, CA, United States
LLM Applications Engineer (Enterprise)

LLM Applications Engineer (Enterprise)

Rise Technical Recruitment Limited • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

LLM Applications Engineer (DevTool Start-Up)

$120,000 - $180,000 + Equity + Benefits + PTO

San Francisco, CA

Are you passionate about building production‑grade application systems on top of large language models? Do you thrive in environments where you directly own customer‑facing infrastructure that ships alongside the fastest‑moving AI models in the world?

This is an opportunity to join a fast‑growing, profitable startup at the forefront of AI infrastructure, building the systems layer that powers how real customers deploy and use language models in production.

Backed by top‑tier investors and trusted by major enterprises, the team has built a unified API framework that makes it seamless for developers to integrate across multiple LLM providers. Now, they’re looking for a Founding Application / Systems Engineer to own the translation, rollout, and reliability of new models and endpoints across the platform.

As a founding member of the engineering team, you’ll take ownership of the customer‑facing systems layer, shaping how new LLM models, providers, and APIs are translated, normalized, and deployed. You’ll work closely with paying customers, internal teams, and the developer community to ensure new models are available, reliable, and production-ready from day one.

If you’re looking for a role where you can combine hands‑on systems engineering with real customer impact and directly influence the infrastructure that underpins modern AI applications, this is an outstanding opportunity.

The Role :

  • Own and resolve LLM translation issues for paid customers in production
  • Roll out support for new LLM models, providers, and endpoints across the platform
  • Lead day0 launches for new model releases from OpenAI, Anthropic, and Google
  • Implement and maintain translation and normalization logic across differing LLM APIs
  • Maintain provider integrations and ensure consistent behavior, reliability, and performance
  • Improve observability, error handling, and system resilience for AI driven workloads
  • Collaborate with internal teams and customers to turn real world usage into platform improvements

The Person :

  • Proficiency in Python and async frameworks
  • Strong familiarity with LLM APIs and application level translation or integration layers
  • Solid understanding of backend systems, API design, and distributed services
  • Comfortable owning production systems and debugging customer facing issues
  • #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Application Engineer • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    ML Systems Engineer : Distributed LLM Training & Inference

    ML Systems Engineer : Distributed LLM Training & Inference

    Scale AI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experien...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior ML Ops Engineer | Distributed Systems Lead

    Senior ML Ops Engineer | Distributed Systems Lead

    Baton Trucking, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading logistics technology company in San Francisco is seeking a Staff Software Engineer - ML Ops to enhance its machine learning infrastructure. The role involves building robust distributed sy...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Embedded Linux Software Engineer

    Embedded Linux Software Engineer

    Farcast • San Francisco, CA, United States
    [job_card.permanent]
    At Farcast, we aim to improve global prosperity.We achieve this goal by building innovative products that enable access to information. Satellite internet is one of the most important ways to achiev...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Applications Engineer - Contract Lifecycle Management (CLM)

    Staff Applications Engineer - Contract Lifecycle Management (CLM)

    Uber • San Francisco, CA, United States
    [job_card.full_time]
    Staff Applications Engineer - Contract Lifecycle Management (CLM).Staff Applications Engineer - Contract Lifecycle Management (CLM). We are seeking an experienced and highly skilled staff applicatio...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Solutions Engineer - Enterprise - AMER

    Solutions Engineer - Enterprise - AMER

    Notion Labs, Inc • San Francisco, CA, United States
    [job_card.full_time]
    Notion helps you build beautiful tools for your life's work.In today's world of endless apps and tabs, Notion provides one place for teams to get everything done, seamlessly connecting docs, notes,...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior LLM Engineer

    Senior LLM Engineer

    Conviva • Foster City, CA, United States
    [job_card.full_time]
    Conviva is the first and best place to go to understand and optimize digital customer experiences.Our Operational Data Platform harnesses full-census, comprehensive client-side telemetry—capturing ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    RTL Design Engineer

    RTL Design Engineer

    Apple • San Francisco, CA, United States
    [job_card.full_time]
    Come and join Apple’s growing wireless silicon development team.Our wireless SoC organization is responsible for all aspects of wireless silicon development, emphasizing highly energy-efficient des...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    RTL Engineer, PCIe

    RTL Engineer, PCIe

    Eridu • San Francisco, CA, United States
    [job_card.full_time]
    Eridu AI is a Silicon Valley-based hardware startup pioneering infrastructure solutions that accelerate training and inference for large-scale AI models. Today’s AI performance is frequently limited...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    RTL Engineer, PCIe

    RTL Engineer, PCIe

    Eridu Corporation • San Francisco, CA, United States
    [job_card.full_time]
    Eridu AI is a Silicon Valley-based hardware startup pioneering infrastructure solutions that accelerate training and inference for large-scale AI models. Today’s AI performance is frequently limited...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer LMTS

    Software Engineer LMTS

    Salesforce, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job CategorySoftware EngineeringJob Details • • • •Abo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    ML Infrastructure Engineer

    ML Infrastructure Engineer

    Openai • San Francisco, California, United States
    [job_card.full_time]
    The Runtime team builds the low level framework components to power our ML training systems.We work on building robust, scalable, high performance components to support our distributed training wor...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineer - ML Infrastructure

    Software Engineer - ML Infrastructure

    Specter • San Francisco, California, United States
    [job_card.full_time]
    Specter is creating a software-defined "control plane" for the physical world.We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets.T...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior ML Infrastructure Engineer — Low-Latency Production

    Senior ML Infrastructure Engineer — Low-Latency Production

    Twelve Labs Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI startup in San Francisco is seeking a Software Engineer in ML Infrastructure to enhance their video solutions and manage ML workflows. The ideal candidate will have over 6 years of expe...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, ML Infrastructure, PrePlan

    Senior Software Engineer, ML Infrastructure, PrePlan

    Waymo • San Francisco, California, United States
    [job_card.full_time]
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk, Inc. • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leader in customer experience solutions is looking for a Senior ML Engineer to enhance their retrieval-augmented generation (RAG) platform. In this role, you will leverage the latest in LLM techno...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk Group • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading customer experience software provider in San Francisco is looking for a Senior ML Engineer to enhance their retrieval-augmented generation platform. In this role, you will deliver AI-power...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer - Release Infrastructure

    Senior Software Engineer - Release Infrastructure

    Celonis • Redwood City, California, United States
    [job_card.full_time]
    We're Celonis, the global leader in Process Mining technology and one of the world's fastest-growing SaaS firms.We believe there is a massive opportunity to unlock productivity by placing data and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer (ML Platform)

    Software Engineer (ML Platform)

    Anyscale • San Francisco, California, United States
    [job_card.full_time]
    Ray in their tech stacks to accelerate the progress of AI applications out into the real world.With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can s...[show_more]
    [last_updated.last_updated_30] • [promoted]