echojobs.io
Login

Inception Labs

Member of Technical Staff, Backend

Bay Area
Python Kubernetes AWS Azure Terraform Prometheus Grafana API
Search for More Jobs
Description

Member of Technical Staff, Backend, LLM Applications

Location: Bay Area

Department: Platform

Location Type: IN_OFFICE

Employment Type: FULL_TIME

The Role
We seek experienced backend engineers to own the systems that serve our diffusion LLMs in production. You'll build and operate infrastructure that handles billions of inference requests — optimizing for latency, throughput, cost, and reliability. This role sits at the intersection of ML systems and backend infrastructure.

Key Responsibilities
  • Design, build, and operate scalable backend services and model serving infrastructure for our diffusion LLMs.
  • Implement and manage load balancing, autoscaling, and traffic routing for model endpoints.
  • Build systems for model versioning, canary deployments, and zero-downtime rollouts.
  • Develop monitoring, alerting, and observability tooling to ensure SLA compliance and rapid incident response.
  • Benchmark and evaluate serving frameworks and hardware configurations to inform infrastructure decisions.

Qualifications
  • BS/MS/PhD in Computer Science or a related field (or equivalent experience).
  • 5+ years of experience building production backend systems.
  • Strong proficiency in Python, including async programming and concurrent systems.
  • Solid understanding of distributed systems, networking, and load balancing at scale.
  • Familiarity with Kubernetes, CI/CD pipelines, and cloud infra (AWS and/or Azure).

Preferred Skills
  • Experience serving LLMs or other large generative models in production at scale.
  • Experience with cloud infrastructure (AWS, Azure), including GPU instance management and cost optimization.
  • Experience with infrastructure as code tools (Terraform) and deployment automation.
  • Experience with monitoring and observability tools (Prometheus, Grafana).
  • Familiarity with model serving frameworks (vLLM, Triton Inference Server, TensorRT-LLM).
Inception Labs
Inception Labs

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say