Real job — pulled straight from SkyPilot’s careers page · Verified September 3, 2026 · No reposts.
Job description
SkyPilot is hiring a Member of Technical Staff, GPU / ML Systems — a full-time, based in San Mateo, CA role. Apply directly on SkyPilot's careers page below.
Member of Technical Staff, GPU / ML Systems
Location: San Mateo, CA
Department: Engineering
Location Type: IN_OFFICE
Employment Type: FULL_TIME
About SkyPilot
The role
What you'll do
- Own GPU scheduling, utilization and health: how SkyPilot discovers, packs, and binpacks accelerator capacity across clouds and Kubernetes, with real-time GPU health monitoring and automatic failure recovery.
- Build optimizations for training and serving: Enable large scale pre-training with node hot-swapping, design storage systems for fast model checkpointing, container migration, inference autoscaling and multi-cluster serving, preemption handling, and sandboxes for training, RL rollouts, and evals.
- Make the AI stack run great out of the box: deepen integrations with vLLM, PyTorch, Slime, and the frameworks teams use for pre-training and high-throughput inference.
What we're looking for
- Hands-on experience with GPU or accelerator systems and with ML training or inference infrastructure.
- Strongly preferred: Familiarity with the modern ML ecosystem (e.g. vLLM, PyTorch, CUDA, verl/slime) and workload-orchestration frameworks (e.g. Kueue, KAI, KServe).
- You've done real ML-systems performance work - tell us about a bottleneck you hunted down (a stalled data pipeline, GPUs idling on a scheduling gap, communication you overlapped with compute) and what you measured before and after.
- Strong Python, and comfort reaching into systems-level and GPU-adjacent details.
- You care about squeezing most from the compute available to you
- Experience operating large-scale training or high-throughput inference in production
What we offer
- Competitive compensation and equity
- Comprehensive medical, dental, vision coverage for you and your dependents
- The chance to work with some of the best minds in cloud, distributed, and AI systems — with significant autonomy and ownership.
- A front-row seat at the latest open-source infra startup from Berkeley (lineage: Databricks, Anyscale).
- Gourmet lunch & dinner for the team to do their best work
Get Software Engineer jobs like this→
New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.
Email me new jobsSimilar jobs
Frequently asked questions
What skills are required for Member of Technical Staff, GPU / ML Systems at SkyPilot?
The required skills for Member of Technical Staff, GPU / ML Systems at SkyPilot include: Python, Machine Learning, Kubernetes, PyTorch.
What is the seniority level for Member of Technical Staff, GPU / ML Systems at SkyPilot?
Member of Technical Staff, GPU / ML Systems at SkyPilot is a Staff level position.
How do I apply for Member of Technical Staff, GPU / ML Systems at SkyPilot?
You can view the full description and apply for Member of Technical Staff, GPU / ML Systems at SkyPilot on EchoJobs: https://echojobs.io/job/skypilot-member-of-technical-staff-gpu-ml-systems-l005r.