WeQuel logo

AI Evaluation and Quality Engineer

WeQuel

Hybrid
Stockholm, Sweden
Full-time
Mid Level
3+ yrs
Salary not listedPosted 16m ago

Real job — pulled straight from WeQuel’s careers page · Verified November 20, 2026 · No reposts.

Earn while you search

Sponsored

AI labs pay engineers by the hour to test and improve their models. Remote, part-time, your hours.

Job description

WeQuel is hiring a AI Evaluation and Quality Engineer — a full-time, based in Stockholm, Sweden role. Apply directly on WeQuel's careers page below.

AI Evaluation & Quality Engineer

WeQuel is looking for an AI Evaluation & Quality Engineer for an assignment with one of our clients. You will make sure agentic workflows are measured honestly before and after they reach production – so the organisation knows what works, what does not, and why.

About the assignment

  • Workload: 100%

  • Location: Hybrid

  • Language: English

Your responsibilities

  • Design evaluation strategies and quality metrics for LLM agents (accuracy, task success, safety, cost, latency)

  • Build and maintain evaluation datasets, test cases and automated regression tests

  • Set up LLM-as-judge and human review processes where needed

  • Run red-teaming and robustness tests, including prompt injection scenarios

  • Monitor agent quality in production and feed findings back to development teams

  • Report results clearly to product owners and stakeholders

Requirements

  • At least 3 years of experience in test automation, QA engineering or data science

  • Hands-on experience evaluating LLM or ML solutions

  • Strong Python skills

  • Understanding of statistics and experiment design

  • Fluent English, written and spoken

Meritorious

  • Experience with evaluation and observability tools (e.g. Langfuse, LangSmith, Ragas, DeepEval, promptfoo)

  • Experience with CI/CD pipelines for ML or LLM applications

  • Knowledge of AI safety and the EU AI Act

  • Background in industrial or manufacturing environments

  • Swedish

Who you are

You are analytical, sceptical in a constructive way and thorough. You enjoy finding where things break, explain results in plain language, and help teams make better decisions based on evidence.

Applications are reviewed continuously – apply today!

Get AI Evaluation and Quality Engineer jobs like this→

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
ZenBusiness logo

Software Engineering Manager

Remote · US-eligible
✓ From careers page· 1w ago
Otter.ai logo

Senior Engineering Manager, Product

$230k–$290kMountain View, CA
✓ From careers page· 1w ago
Riot Games logo

Staff Software Engineer, Data Foundations

Los Angeles, CA
✓ From careers page· 1w ago
Riot Games logo

Senior Manager, Software Engineering (Graphics)

Los Angeles, CA
✓ From careers page· 1w ago

Frequently asked questions

What skills are required for AI Evaluation and Quality Engineer at WeQuel?

The required skills for AI Evaluation and Quality Engineer at WeQuel include: Python, LLM, Machine Learning, Data Science, CI/CD.

What is the seniority level for AI Evaluation and Quality Engineer at WeQuel?

AI Evaluation and Quality Engineer at WeQuel is a Mid Level level position.

How do I apply for AI Evaluation and Quality Engineer at WeQuel?

You can view the full description and apply for AI Evaluation and Quality Engineer at WeQuel on EchoJobs: https://echojobs.io/job/wequel-ai-evaluation-quality-engineer-0x3ec.