LLM Software Engineer

A company is looking for a LLM Software Engineer (Part-Time) to work remotely in the USA.

Key Responsibilities

Create a framework for managing jobs on a combination of on-premises and external cloud compute

Ensure the framework is robust and includes fault tolerance for job recovery and clean shutdowns

Collaborate effectively with team members throughout the development process

Required Qualifications

2 years of experience with Python

2 years of experience with LLM inference libraries (e.g., vLLM, transformers, nemotron)

2 years of experience with Kubernetes for task and container orchestration

2 years of experience building fault-tolerant distributed systems

Experience with AWS or GCP and basic Git functionality