Senior ML Inference Systems Engineer at Runpod
Closed
Optimize LLM inference serving at Runpod across GPU hardware and workloads. Measure throughput, token latency and cost, profile bottlenecks from scheduling to kernels, and ship reliable production configurations. Remote work is listed in the United States.
Search jobs by company: Runpod
- Location
- Remote
- Employment
- FullTime
- Work arrangement
- remote
- Technologies
- Python
Save job — free account Saved jobs
Create a free application profile — Keep your skills and projects in a reusable profile. Private by default; you choose when to share. Apply for this job directly with the employer.
By continuing, you agree to processing needed to manage your account and profile. Privacy policy
This opening is not confirmed as active. Check the employer source before applying.
Role overview
Optimize LLM inference serving at Runpod across GPU hardware and workloads. Measure throughput, token latency and cost, profile bottlenecks from scheduling to kernels, and ship reliable production configurations. Remote work is listed in the United States.
How to apply
Check the original posting to confirm the role is still open before applying.
Check employer postingSource checked: 2026-11-18
Browse job categories
Related jobs
- Senior / Staff Backend Engineer, AI Inference at Cohere — Cohere
- People Systems Engineer at GitLab — GitLab
- Cloud Infrastructure Security Engineer at Runpod — Runpod
- IT Systems Engineer, Mobile Client Platform Engineer at Anthropic — Anthropic
- Founding AI and Voice Systems Engineer at Roark — Roark
- Senior Machine Learning Systems Engineer at Reddit — Reddit