MLE, ML Platform
Team: Machine Learning
Location: San Mateo, CA
Commitment: Full Time
Workplace Type: onsite
About the Role
What You’ll Be Doing
- Build and maintain training infrastructure, feature stores, and model serving pipelines
- Optimize LLM inference performance — compute efficiency, memory management, latency, and throughput
- Read, debug, and contribute to LLM runtime and supporting library code (Rust and/or C++)
- Deploy and manage models at scale using tools like vLLM and Baseten
- Architect scalable pipelines for model training and serving across GPU infrastructure
- Collaborate with ML and data engineers to ensure the platform meets research and production needs
Prior Experience
- PhD in CS, ML, or a related field or MS with 4+ years of relevant industry experience
- Background in LLM optimization: inference efficiency, quantization, memory layout, or serving performance
- Ability to read, navigate, and debug LLM source code and underlying runtime libraries
- Comfortable in Rust and/or C++ at the systems level; strong Python required
- Strong algorithmic fundamentals — data structures, complexity, distributed systems
- Hands-on experience with model serving infrastructure (vLLM, Baseten, Triton, or similar)
- Experience setting up and scaling ML pipelines end-to-end
Nice to Have
- Familiarity with feature store design and management
- Experience with GPU cluster management and optimization
- Contributions to open-source ML infrastructure or LLM tooling
- Experience with Ray, ONNX, TensorRT, or similar optimization and serving frameworks
- Understanding of transformer internals and attention mechanisms at the implementation level
Why Join
- A rare chance to be a founding engineer shaping both company and product direction.
- Competitive salary, benefits, and meaningful equity.
- Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch.
- Onsite culture in San Mateo, designed for deep collaboration and high-velocity building.
- Full benefits package (Medical, Dental, Vision, 401k).
- We sponsor H-1B visas and assist with immigration processes.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
