Senior QA (Gen AI - Must have) Exp: 5+ Years
Location: Bengaluru, Pune, Mumbai, Chennai, Hyderabad, Gurgaon, Noida
Time Type: Full time
Job Description
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Role: Senior QA (Gen AI - Must Have)
Experience: 5+ Years
Detailed JD :
- Design, automate, and execute API test suites (functional, contract, performance, resilience)
- Define LLM evaluation strategies (performance testing, golden sets, guardrails, hallucination/consistency checks, relevance & latency KPIs); build automated eval pipelines tied to releases.
- Create PDLM deliverables: verification plans/protocols, test reports, risk-based coverage, V&V trace matrices to requirements and use cases.
- Integrate test infrastructure with Azure DevOps (CI/CD, test orchestration, quality gates, dashboards); enforce build-time gates for API and LLM quality.
- Partner with Product, Clinical, and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.
What is required from candidate?
- 5+ years in backend/API test automation (REST, JSON, auth), performance testing, and CI/CD.
- Hands-on with Python/TypeScript, Postman/Newman or REST-assured, PyTest/Jest, k6/JMeter, Docker.
- Experience validating ML/LLM systems (eval datasets, metrics, prompt/response testing, safety/guardrails).
- Strong documentation and traceability discipline for regulated product lifecycles (PDLM/QMS).
- Bonus: Azure DevOps pipelines, FHIR/HL7 familiarity, healthcare data privacy/security.
- Bonus: Frontend testing capabilities are preferred, but not part of the PDLM requirements.
#LI-MA1
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Hiring Related Queries
India: [email protected]
Outside India: [email protected]
Please share resume via job postings
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say