PolyAI

Software Engineer - Model Evaluation and Productisation (Must be UK based)

London, UK
Python AWS GCP Azure
Description

PolyAI is a leader in automating customer service through innovative voice technology. Our voice assistants empower businesses to deliver exceptional customer service at every interaction.

We are seeking a talented and hands-on Software Engineer with a strong data science background to join our team.

In this role, you will work on building software to enhance the visibility and configurability of large language models (LLMs). You will be responsible for rapidly developing tools and platforms to evaluate, iterate, and productionalize models, ensuring their reliability and accuracy.

We are looking for the right candidate, and therefore are flexible on the levelling for this position ranging from mid- level to senior!

Responsibilities:

  • Must have at least 2 years of Python experience
  • Must have at least 2+ years working experience
  • Develop software that provides visibility into LLM models and offers configurability for tuning and evaluation.
  • Build and maintain evaluation datasets and tools, enabling the measurement of model performance across key metrics.
  • Take a hands-on approach to quickly prototype, test, and iterate on solutions, moving from proof-of-concept to production.
  • Employ a data-driven methodology to drive model accuracy, leveraging evaluation results to inform decisions.
  • Collaborate with cross-functional teams to integrate developed tools and ensure they meet production standards.
  • Formulate hypotheses, design experiments, and collect data to validate model assumptions, consistently striving for improved reliability.
  • Communicate findings and ranking metrics clearly to both technical and non-technical stakeholders.

Why Join Us:

Join a dynamic and innovative team at the forefront of LLM development. You will have the opportunity to work on challenging projects, rapidly build impactful solutions, and drive data-informed improvements that push the boundaries of what LLMs can achieve.

  • Degree in Computer Science, Data Science, or related field, or equivalent experience.
  • Strong proficiency in Python
  • Experience developing evaluation suites, datasets, and data-driven tools for model reliability testing.
  • Ability to rapidly prototype and iterate on solutions while maintaining a focus on production-level quality.
  • Strong problem-solving skills and a creative mindset, with the ability to hypothesize and validate results through experimentation.
  • Familiarity with cloud platforms such as AWS, GCP, or Azure is a plus.
PolyAI
PolyAI
Artificial Intelligence Call Center Customer Service Enterprise Software Machine Learning Software

0 applies

2 views

Other Jobs from PolyAI

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

πŸ₯³πŸ₯³πŸ₯³ 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. πŸ› οΈ
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. πŸš€
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. πŸ“…

What Fellow Engineers Say