Test Engineer III

Location: San Francisco, California

Department: Software Engineering

The Test Engineer III is a hands-on individual contributor on the Test Engineering team, responsible for executing and extending automated test coverage across our regulated SaMD products. This role focuses on end-to-end system testing and post-deployment verification, contributing to test plans and tool validation activities under the guidance of senior engineers. The Test Engineer III applies an AI-first approach to test automation — using AI-assisted tooling to accelerate authoring and triage — while operating with the rigor required of a medical device QMS environment. The ideal candidate is comfortable with modern UI automation frameworks (Selenium and Playwright), eager to grow their depth in regulated software testing, and motivated to ship high-quality software that supports patient care.

Responsibilities

• Build and maintain automated end-to-end (E2E) tests covering complete user workflows across UI, API, and back-end services.
• Apply AI-assisted test automation techniques — including AI-assisted authoring, self-healing locators, and AI-supported triage — to expand coverage and reduce maintenance overhead.
• Execute post-deployment verification activities such as production smoke tests and monitoring-driven checks.
• Contribute to test plans, test protocols, and test reports under the guidance of senior engineers, ensuring documentation meets QMS expectations.
• Participate in tool validation activities for test infrastructure and automation tooling per internal procedures.
• Implement and maintain UI test automation using Selenium, Vitest and Playwright; follow established framework patterns and contribute improvements.
• Develop API-level tests using tools such as REST Assured, Postman, or Karate.
• Translate requirements and user stories into clear, traceable test cases in partnership with engineers, product, and RA/QA.
• Investigate test failures, file high-quality defect reports, and partner with developers to drive issues to resolution.
• Help keep automated tests running reliably in CI/CD pipelines and respond promptly to pipeline breakages.
• Provide test evidence and documentation to support audits, CAPAs, and regulatory submissions as requested.

Qualifications

• 3–5 years of experience in software test engineering, SDET, or quality engineering roles, with a hands-on automation focus.
• Experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
• Working familiarity with medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation and traceability.
• Proficiency with Selenium / WebDriver and Playwright, including writing stable, maintainable UI automation.
• Hands-on experience contributing to E2E automation suites and test frameworks.
• Exposure to authoring or maintaining test plans, protocols, and reports in a regulated environment.
• Practical use of AI-assisted testing tools or techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-supported triage).
• Solid programming skills in at least one mainstream language used for automation (e.g., TypeScript/JavaScript, Python, Java, or C#).
• Experience with API testing tools (REST Assured, Postman, Karate, or equivalent).
• Familiarity with CI/CD systems (e.g., GitHub Actions, Jenkins, GitLab CI) and basic exposure to cloud environments such as AWS.
• Strong debugging skills and a structured approach to investigating failures.
• Clear written and verbal communication; able to document test designs and defects effectively.
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Desired

• Exposure to RA/QA processes and supporting evidence collection for audits.
• Experience testing ML/AI features, clinical workflows, or medical imaging products.
• Experience validating visualizations such as 3D models, overlays, or measurement views.
• Familiarity with non-functional / performance testing tools (e.g., k6, Locust, JMeter, Gatling).
• Exposure to data-pipeline or microservices testing.

A reasonable estimate of the base salary compensation range is $130,000 to $160,000, bonus, and equity. #LI-IB1