AI Model Testing Engineer
Location: Remote (Canada)
Department: Engineering
About the role
We are looking for a scrappy, creative, and detail-oriented AI Model Testing Engineer to build, manage, and continuously enhance our infrastructure for testing and evaluating AI models from leading providers such as OpenAI, Google, and Anthropic. This role will have a particular focus on LLMs & transcription model testing and optimization. You’ll collaborate closely with our medical team to craft targeted test cases, enabling veterinarians to identify and select the most accurate and effective AI-generated outputs.
What you'll do
- Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
- Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
- Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
- Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
- Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
- Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.
Qualifications
- Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work.
- Experience or familiarity with AI model integration.
- Proficiency with Node.js and TypeScript.
- Familiarity with APIs from providers such as OpenAI, Google, or Anthropic.
- Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints.
- Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals.
Why Join Us?
- Opportunity to shape the future of veterinary medicine through AI-driven innovation.
- A highly collaborative, agile environment with room to experiment and innovate.
- Competitive salary and comprehensive benefits.
- Flexible remote work environment, with optional office presence at our HQ in Waterdown, Ontario.
Join CoVet and help us revolutionize veterinary care through cutting-edge AI technology.
About the Company
About CoVet
CoVet is an innovative AI copilot designed specifically for veterinarians, automating medical documentation and providing real-time AI assistance during consultations. Our goal is to empower veterinary professionals by continuously enhancing the accuracy, quality, and efficiency of our AI-driven tools.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say