Machine Learning Engineer

Get AI-powered advice on this job and more exclusive features.

This range is provided by Insight Global. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$200,000.00 / yr - $250,000.00 / yr

Direct message the job poster from Insight Global

Job Description

Insight Global is seeking a team of experienced, driven Machine Learning Engineer to join an established health technology company sitting in San Jose, CA. This is a full-time, permanent role with competitive salary, bonus, and comprehensive benefits.

In this role you'll need :

Deep Learning Frameworks : Hands-on experience with PyTorch (main focus) and familiarity with TensorFlow.

Large-Scale Model Training : Exposure to advanced training techniques like Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), ZeRO, and model parallelism (pipeline / tensor). Experience with distributed training is a strong plus.

Model Optimization : Skilled in improving model performance through techniques like quantization (PTQ, QAT, AWQ, GPTQ), pruning, knowledge distillation, KV-cache tuning, and using efficient attention mechanisms like Flash Attention.

Scalable Model Serving : Understanding of how to deploy models at scale, including autoscaling, load balancing, streaming, batching, and caching. Comfortable working alongside platform engineers to build robust serving pipelines.

Data & Storage Systems : Proficient with both SQL and NoSQL databases, vector databases (e.g., FAISS, Milvus, Pinecone, pgvector), and data formats like Parquet and Delta. Familiar with object storage systems.

Code Quality : Writes efficient, clean, and maintainable code with a focus on performance.

End-to-End ML Lifecycle : Solid grasp of the full machine learning workflow—from data collection and model training to deployment, inference, optimization, and evaluation.

Required Skills & Experience

3–5 years in ML / AI engineering roles owning training and / or serving in production at scale.

Demonstrated success delivering high-throughput, low-latency ML services with reliability and cost improvements.

Experience collaborating across Research, Platform / Infra, Data, and Product functions.

Bachelors in computer science, Electrical / Computer Engineering, or a related field required; Master’s preferred (or equivalent industry experience).

Strong systems / ML engineering with exposure to distributed training and inference optimization.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Staffing and Recruiting

Referrals increase your chances of interviewing at Insight Global by 2x

Benefits

Medical insurance

Vision insurance

401(k)

Get notified about new Machine Learning Engineer jobs in

San Jose, CA .

#J-18808-Ljbffr