Arabic AI logo

Senior QA Engineer, AI Products

Arabic AI

On-site
Doha, Qatar
Contract
Senior
7+ yrs
Salary not listedPosted 3w ago

Real job — pulled straight from Arabic AI’s careers page · Verified November 1, 2026 · No reposts.

Earn while you search

Sponsored

AI labs pay engineers by the hour to test and improve their models. Remote, part-time, your hours.

Job description

Arabic AI is hiring a Senior QA Engineer, AI Products — a contract, based in Doha, Qatar role. Apply directly on Arabic AI's careers page below.

Senior QA Engineer - AI Products (6 Months Contract)

Location: Doha, Doha Municipality, Qatar

Department: Technology, AI, Products & PMO

Workplace: on_site

Employment Type: contract

Description

We are looking for a Senior QA Engineer to own quality across our AI products. You will test LLM-powered features end to end, build automated test and evaluation suites, and help ensure every release is accurate, safe, and reliable.

Responsibilities

• Define test strategies and plans for AI features across web, API, and backend.

• Evaluate model outputs for accuracy, consistency, hallucinations, bias, and safety.

• Build evaluation datasets, including edge cases and adversarial / red-team prompts.

• Develop and maintain automated UI, API, and regression tests integrated into CI/CD.

• Run regression testing on model, prompt, and configuration changes.

• Test performance, latency, error handling, and fallback behavior.

• Report defects clearly and provide release-readiness sign-off.

• Test non-deterministic outputs using scoring rubrics, LLM-as-judge, human evaluation, and defined pass/fail thresholds.

• Perform AI security testing, including prompt injection, jailbreaks, and PII / data leakage across chatbots, RAG, and agents.

• Work with ML engineers and product managers to define quality metrics and acceptance criteria.

• Where applicable, monitor production quality and model drift after release.

Requirements

7+ years of experience in QA / software testing, with strong test automation background.

• Proven experience testing AI/ML or LLM-based products (chatbots, RAG, agents, etc.).

• Hands-on scripting experience in Python and/or TypeScript/JavaScript.

• Hands-on with at least one UI automation framework (Playwright, Cypress, Selenium) and a test framework such as Pytest.

• API testing with Postman, REST Assured, or similar.

• Experience with LLM evaluation tools.

• CI/CD and version control: GitHub Actions, GitLab CI or Jenkins; Git.

• Test management and tracking: Jira, TestRail, or Zephyr.

• Excellent written English and clear bug reporting.

Nice to Have

• Performance/load testing (k6, JMeter, Locust).

• Understanding of prompt engineering, embeddings, and vector databases.

• Experience with AI safety, red-teaming, or content policy testing.

• Cloud experience (AWS, GCP, or Azure) and Docker.

Get QA Engineer jobs like this→

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
ZenBusiness logo

Software Engineering Manager

Remote · US-eligible
✓ From careers page· 6d ago
Otter.ai logo

Senior Engineering Manager, Product

$230k–$290kMountain View, CA
✓ From careers page· 6d ago
Riot Games logo

Staff Software Engineer, Data Foundations

Los Angeles, CA
✓ From careers page· 6d ago
Riot Games logo

Senior Manager, Software Engineering (Graphics)

Los Angeles, CA
✓ From careers page· 6d ago

Frequently asked questions

What skills are required for Senior QA Engineer, AI Products at Arabic AI?

The required skills for Senior QA Engineer, AI Products at Arabic AI include: Python, TypeScript, JavaScript, Playwright, Cypress, Selenium, Postman, JIRA, Git, GitHub Actions, GitLab CI, Jenkins, RAG, JMeter, AWS, GCP, Azure, Docker.

What is the seniority level for Senior QA Engineer, AI Products at Arabic AI?

Senior QA Engineer, AI Products at Arabic AI is a Senior level position.

How do I apply for Senior QA Engineer, AI Products at Arabic AI?

You can view the full description and apply for Senior QA Engineer, AI Products at Arabic AI on EchoJobs: https://echojobs.io/job/arabic-ai-senior-qa-engineer-ai-products-6-months-contract-kuusd.