Staff Ops Engineer (Anterior Labs)

We’re looking for the founding team members of ‘Anterior Labs’. Anterior Labs is our applied research arm, where we believe that “applied” is synonymous with “shipped”. Without benefitting users, research goes unused - this is not that kind of team. We ship. Shipping research is difficult and involves problems that live in an grey area somewhere between infrastructure and research. We’re looking for exceptional staff level research engineers who can performing LLM inference accurately at scale. You’ll work with our infrastructure domain experts to deploy these systems to get your models into production.

About the role

• You'll lead, design and implement the architecture for hosting our LLM-based systems from the ground up

• You'll work with our AI Research team to optimise logical reasoning systems for speed, scale, and cost for our enterprise customers

• You'll play an integral role in improving our LLM-based system’s performance for our custom domain, including fine-tuning and/or pertaining LLMs, creating efficient agents networks, etc.

• You collaborate closely product and clinical teams to rapidly prototype and deliver innovative solutions

About you

• You have extensive Python/Golang/Rust programming experience

• You have expertise in in machine learning and GPU based compute architectures

• You've developed software utilising LLMs (OAI, Anthropic, Mistral etc.) and SLMs (Llama, Phi etc.) before

• You have experience with distributed data processing and large-scale system architecture

• You have the ability to identify and solve complex problems with the communication skills to match and effectively convey your ideas and solutions

• Your peers and colleagues would describe you as a high agency, curious individual

Preferred but not required

• You've worked with research teams before to enhance search quality

• You have a track record of building large scale knowledge bases

• You have experience deploying machine learning models over 70B parameters or multi-GPU systems

What's in it for you?

We're a default in person culture with flexibility. If you require a yoga break, then hit the studio. If you require high-protein or pescatarian meals, then we’ll stock the fridge. However you like to work, we see it as our job to facilitate.

You’ll also enjoy the following benefits:

• Health and dental benefits

• Flexible holiday policy

• Free office lunch, every day

• We’re a default in-person culture and will cover your commute