echojobs.io
Login

Transluce

AI Systems Engineer

San Francisco, CA
USD 350k - 600k
Python GPU Distributed Systems LLM
Search for More Jobs
Description

AI Systems Engineer

Location: San Francisco

Department: Technical

Location Type: IN_OFFICE

Employment Type: FULL_TIME

Salary range: $350,000 - $600,000/year + benefits

Description: Transluce is a fast-moving research lab building the public tech stack for understanding and debugging AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. We are a non-profit with a mission to steer the development of AI for the public good.

About the role: We are looking for an exceptional AI systems engineer to lead the design and development of our core ML stack, building systems that can scale to thousands of GPUs and performantly query trillion-token databases.

As an early member of a highly collaborative team, you will be free to innovate and move fast, building high-impact systems from the ground up. As part of a mission-focused non-profit, your work will have high direct impact (e.g. used by governments to inform AI policy) and cross-organisational reach (open-source tools the entire community can build on).

Core responsibilities:
  • Set overall code culture and tooling for a fast-growing org
  • Help to solve our core technical challenges across verticals. Examples include:
    • Docent:
      • High-concurrency container-based evals with quick ability to iterate on interventions to agentic trajectories
      • Deterministic sandbox execution of code that can efficiently restore state from checkpoints
    • Interpretability:
      • Inference stacks that are as performant as vLLM but flexible enough to allow complex model introspection and intervention, steering, configurable sampling, etc., and that can scale to 400B+ parameter models
    • Behavior elicitation:
      • Distributed RL training and roll-outs allowing thousands of concurrent rollouts across machines
    • Build great internal tools to speed up the team
  • Help tone-set in the organization around best practices for building and path-set on what infra we should build
  • Help other team members think through infra challenges

Qualities of a strong candidate:
  • Exceptional programmer fluent in Python
  • Bare metal optimization: know GPUs, other accelerators in and out (low-level performance + optimization + parallel programming)
  • Experience engineering at scale (distributed systems, reliability, architecture design)
  • Leader on global code quality and health (designing good primitives, managing complexity and scale)
  • Bonus: can set up LLM pipelines, e.g. multiple specialized LLMs interacting with each other in a performant and reliable way
  • Bonus: experience with open-source community management

We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.
Transluce
Transluce

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say