Software Engineer - New Products

Department: EPD

Location: San Francisco, New York

Compensation: $165K – $330K • Offers Equity

Employment Type: FullTime

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE:
You’ll join a small team building new products at Baseten. This role is for an infrastructure-leaning, product-minded engineer who likes owning ambiguous problems end-to-end: from shaping an API and system design, to operating it in production with clear SLOs.
You’ll build core platform capabilities that power how researchers, developers and partners ship and operate AI products at scale: API gateways, auth/keys, quotas and metering, multi-tenant isolation, observability, and the workflows around deploying and managing model-backed services.

EXAMPLE INITIATIVES:

• Model APIs for frontier models

• Model training built for production inference
  
  RESPONSIBILITIES:

• Own and lead projects and product areas end-to-end, including architecture, implementation, rollout, and long-term operations.

• Design ergonomic, developer-friendly APIs and abstractions for infrastructure capabilities.

• Build and operate reliable backend services (rate limiting, auth, quotas, metering, migrations) with clear SLOs.

• Drive performance and reliability improvements through profiling, tracing, load testing, and capacity planning.

• Mentor teammates through code reviews, design docs, and technical leadership.

  
  REQUIREMENTS:

• Proven track record owning low-latency, reliable services (auth, rate limiting, quotas, usage metering, migrations).

• Strong infrastructure instincts: observability, incident response, SLOs, and capacity management.

• Comfort working across the stack when needed (backend-first, but willing to dive into frontend/CLI to unblock the product).

• Strong written communication, including clear design docs and effective cross-functional collaboration.

• Interest in AI/ML infrastructure and willingness to learn (ML expertise not required).

NICE TO HAVE:

• Experience with API gateways, service meshes, Kubernetes, or distributed scheduling.

• Experience building developer platforms: SDKs, CLIs, APIs, and self-serve workflows.

• Experience with inference platforms, LLM runtimes, or performance-sensitive systems.

• Familiarity with multi-tenant isolation patterns (fair queuing, noisy-neighbor controls, admission control).

• Frontend experience (React/TypeScript) or strong product UX instincts for developer tools.

BENEFITS

• Competitive compensation, including meaningful equity.

• 100% coverage of medical, dental, and vision insurance for employee and dependents

• Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

• Paid parental leave

• Company-facilitated 401(k)

• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).