Brillio logo

Lead Quality Engineer

Brillio

On-site
Bangalore, Karnataka
Full-time
Lead
Senior
4+ yrs
Salary not listedPosted 10m ago

Real job — pulled straight from Brillio’s careers page · Verified November 20, 2026 · No reposts.

Earn while you search

Sponsored

AI labs pay engineers by the hour to test and improve their models. Remote, part-time, your hours.

Job description

Brillio is hiring a Lead Quality Engineer — a full-time, based in Bangalore, Karnataka role. Apply directly on Brillio's careers page below.

Lead Quality Engineer - R01573517

Team: AI & Data Engineering : Data Engineering

Location: Bangalore, Karnataka, India

Commitment: Employee

Workplace Type: unspecified

Lead Quality Engineer

Primary Skills

  • Test Data Management, Jenkins, Regression Testing, Postman, Selenium, Functional Testing, BDD - Behavior Driven Development, SoapUI, System Integration testing, Application Testing, Pixel Testing, Cross Browser Testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Visual Testing, Cucumber

Specialization

  • Quality Engineering - Product Applications & Microservices: Lead Quality Engineer

Job requirements

  • Experience Range: with at least 4 to 6 years of experience in quality engineering, including hands-on testing and evaluation of AI-powered product applications and microservices Key Responsibilities: 1. Develop and execute robust evaluation frameworks for AI agents, focusing on Responsible AI and safety metrics such as bias, toxicity, and alignment failures 2. Design synthetic testing environments and simulation strategies to stress-test agents under diverse real-world conditions 3. Implement adversarial testing, red-teaming, and prompt injection methodologies to identify vulnerabilities and ensure agent robustness 4. Integrate evaluation pipelines into CI/CD workflows for continuous quality assurance and rapid iteration 5. Collaborate with policy and legal teams to ensure agent evaluations meet regulatory compliance and ethical standards 6. Analyze evaluation results and provide actionable insights to development teams, prioritizing safety and risk mitigation 7. Configure and execute automated test suites using Python and relevant AI/ML testing libraries (e.g., PyTest, DeepEval, Ragas, Giskard) 8. Manage bug detection, documentation, and tracking using Jira, focusing on performance degradations and alignment failures Required Skills: 1. Python programming 2. PyTest 3. DeepEval 4. Ragas 5. Giskard 6. Langsmith 7. Google Agent Development Kit (ADK) 8. Vertex AI 9. Safety evaluations (red teaming, adversarial testing) 10. Prompt injection testing 11. API testing for AI/ML systems 12. Data analysis with Pandas and SQL Preferred Skills: 1. Gemini models 2. Hugging Face 3. Garbage-in/Garbage-out (GIGO) testing tools 4. Data poisoning techniques 5. AI ethics principles and policy background 6. Visualization tools for evaluation results Desired Qualifications: 1. Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, or Software Engineering 2. ISTQB Foundation Level certification or Certified Software Tester (CST) 3. Certification in AI/ML testing or Responsible AI (e.g., Google Cloud Certified - Professional Machine Learning Engineer)

Get QA Engineer jobs like this→

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
Unisys logo

Full Stack Java Developer

Madrid, Spain
✓ From careers page· 5h ago
Unisys logo

Senior Java Fullstack Engineer

Wabern-Bern, Switzerland
✓ From careers page· 5h ago
Unisys logo

Senior Java & Angular Fullstack Technologist

Wabern-Bern, Switzerland
✓ From careers page· 5h ago
ICW Group logo

Software Development Engineer in Test

$95k–$161kSan Diego, CA
✓ From careers page· 5h ago

Frequently asked questions

What skills are required for Lead Quality Engineer at Brillio?

The required skills for Lead Quality Engineer at Brillio include: Jenkins, Postman, Selenium, Python, Pandas, SQL, Hugging Face.

What is the seniority level for Lead Quality Engineer at Brillio?

Lead Quality Engineer at Brillio is a Lead / Senior level position.

How do I apply for Lead Quality Engineer at Brillio?

You can view the full description and apply for Lead Quality Engineer at Brillio on EchoJobs: https://echojobs.io/job/brillio-lead-quality-engineer-r01573517-o8m78.