Talent.com
LLM Applications Engineer (Enterprise)
LLM Applications Engineer (Enterprise)Rise Technical • San Francisco
LLM Applications Engineer (Enterprise)

LLM Applications Engineer (Enterprise)

Rise Technical • San Francisco
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.permanent]
[job_card.job_description]

LLM Applications Engineer (DevTool Start-Up)

$120,000 - $180,000 + Equity + Benefits + PTO

San Francisco, CA

Are you passionate about building production-grade application systems on top of large language models? Do you thrive in environments where you directly own customer-facing infrastructure that ships alongside the fastest-moving AI models in the world?

This is an opportunity to join a fast-growing, profitable startup at the forefront of AI infrastructure, building the systems layer that powers how real customers deploy and use language models in production.

Backed by top-tier investors and trusted by major enterprises, the team has built a unified API framework that makes it seamless for developers to integrate across multiple LLM providers. Now, they're looking for a Founding Application / Systems Engineer to own the translation, rollout, and reliability of new models and endpoints across the platform.

As a founding member of the engineering team, you'll take ownership of the customer-facing systems layer, shaping how new LLM models, providers, and APIs are translated, normalized, and deployed. You'll work closely with paying customers, internal teams, and the developer community to ensure new models are available, reliable, and production-ready from day one.

If you're looking for a role where you can combine hands-on systems engineering with real customer impact and directly influence the infrastructure that underpins modern AI applications, this is an outstanding opportunity.

The Role :

  • Own and resolve LLM translation issues for paid customers in production
  • Roll out support for new LLM models, providers, and endpoints across the platform
  • Lead day0 launches for new model releases from OpenAI, Anthropic, and Google
  • Implement and maintain translation and normalization logic across differing LLM APIs
  • Maintain provider integrations and ensure consistent behavior, reliability, and performance
  • Improve observability, error handling, and system resilience for AI driven workloads
  • Collaborate with internal teams and customers to turn real world usage into platform improvements

The Person :

  • Proficiency in Python and async frameworks
  • Strong familiarity with LLM APIs and application level translation or integration layers
  • Solid understanding of backend systems, API design, and distributed services
  • Comfortable owning production systems and debugging customer facing issues
  • [job_alerts.create_a_job]

    Application Engineer • San Francisco

    [internal_linking.similar_jobs]
    ML Systems Engineer : Distributed LLM Training & Inference

    ML Systems Engineer : Distributed LLM Training & Inference

    Scale AI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experien...[show_more]
    [last_updated.last_updated_30] • [promoted]
    DevOps Engineer

    DevOps Engineer

    NimbleRx • Redwood City, CA, US
    [job_card.full_time]
    We are starting by building the largest, most loved pharmacy business in the world.We are a fast-growing, technology-first startup driven by perfecting the patient and pharmacist experience.Nimble ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Enterprise Engineer

    Enterprise Engineer

    Amiri Recruiting • San Francisco, CA, US
    [job_card.full_time]
    Relevant Skills and Experience.What You’ll Do (Day-to-Day).Understand Enterprise customer's needs and design product solutions. Work across all the stack : infra, frontend client, backend, ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer (Erlang)

    Senior Software Engineer (Erlang)

    Cypress HCM • Redwood City, CA, US
    [job_card.full_time]
    Also open to mid-level, staff, principal, and team lead level engineers.Redwood City, CA | In the office 3-4 days per week with flexibility. Director of Platform Engineering.Supply chain, warehouse ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior LLMOps Engineer

    Senior LLMOps Engineer

    VirtualVocations • Oakland, California, United States
    [job_card.full_time]
    A company is looking for a Senior LLMOps Engineer.Key Responsibilities Design and operate LLM orchestration and runtime systems for reliable AI workflows Build and maintain evaluation pipelines ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Data Software Engineer (Menlo Park, CA ) #4433

    Staff Data Software Engineer (Menlo Park, CA ) #4433

    GRAIL • Menlo Park, CA, US
    [job_card.full_time]
    Our mission is to detect cancer early, when it can be cured.We are working to change the trajectory of cancer mortality and bring stakeholders together to adopt innovative, safe, and effective tech...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead DevOps Engineer

    Lead DevOps Engineer

    UnifyID (acquired by Prove) • Redwood City, CA, US
    [job_card.full_time]
    About Prove (acquired UnifyID).Prove is the modern platform for continuous identity authentication and is used by over 1,000 enterprises and 500 financial institutions, including 9 of the top 10 U....[show_more]
    [last_updated.last_updated_30] • [promoted]
    Logistics Optimization - Senior Software Engineer

    Logistics Optimization - Senior Software Engineer

    Sprinter Health • Menlo Park, CA, US
    [job_card.full_time]
    At Sprinter Health, our mission is reimagining how people access care by bringing it directly to their homes.Nearly 30% of patients in the U. For many, the ER becomes their first touchpoint with the...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior LLM Engineer

    Senior LLM Engineer

    Conviva • Foster City, CA, United States
    [job_card.full_time]
    Conviva is the first and best place to go to understand and optimize digital customer experiences.Our Operational Data Platform harnesses full-census, comprehensive client-side telemetry—capturing ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Solutions Engineer

    Solutions Engineer

    Blueprint • South San Francisco, CA, US
    [job_card.full_time]
    Rocketlane is a high-growth SaaS company on a mission to deliver chaos-free, consistent, and delightful B2B client project delivery. The platform empowers customer-facing teams - especially in B2B S...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Firmware Engineer

    Firmware Engineer

    Russell Solutions Group • Menlo Park, CA, US
    [job_card.full_time]
    Lead Embedded Software Engineer.VP of Electronic Systems Engineering.Inquis Medical is a Bay Area MedTech startup founded in 2020 by seasoned medical device entrepreneurs with more than three decad...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk, Inc. • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leader in customer experience solutions is looking for a Senior ML Engineer to enhance their retrieval-augmented generation (RAG) platform. In this role, you will leverage the latest in LLM techno...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk Group • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading customer experience software provider in San Francisco is looking for a Senior ML Engineer to enhance their retrieval-augmented generation platform. In this role, you will deliver AI-power...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Embedded Software Engineer

    Embedded Software Engineer

    Quilt • Redwood City, CA, US
    [job_card.full_time]
    Our mission is to move humanity off of fossil fuel heating.US global warming emissions come from homes (that's more than cars!). The largest driver of home emissions is burning fossil fuels for ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    LLM Applications Engineer

    LLM Applications Engineer

    Rise Technical • San Francisco, CA, United States
    [job_card.full_time]
    This range is provided by Rise Technical.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Direct message the job poster from Rise Technical.Speci...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    ML Engineer, Discovery Applications

    ML Engineer, Discovery Applications

    Mithrl • San Francisco, CA, US
    [job_card.full_time]
    We imagine a world where new medicines reach patients in months, not years, and where scientific breakthroughs happen at the speed of thought. Mithrl is building the world’s first commercially...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Reliability Engineer

    Reliability Engineer

    Robust.ai • San Carlos, CA, US
    [job_card.full_time]
    Robust AI is a fast-growing, early-stage startup founded in 2019 by an unsurpassed team of veterans in robotics, AI and business. We are a collaborative group with a wide range of backgrounds and pe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Engineer - LLM Systems for Enterprise

    Senior AI Engineer - LLM Systems for Enterprise

    Distyl AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A cutting-edge AI technology firm in San Francisco is on the lookout for AI Engineers at all experience levels to build and deploy AI-native systems. You will be responsible for designing robust LLM...[show_more]
    [last_updated.last_updated_30] • [promoted]