Director of Quality Assurance

Location: Remote

• Lead the QA team and set the overall test strategy, quality standards, and processes needed to meet client targets and performance goals.
• Own Ludi's quality roadmap: evaluate current practices, identify gaps, and drive a comprehensive test strategy across manual and automated testing.
• Build, manage, and mentor a high-performing QA team, including hiring, coaching, and career development for QA Engineers.
• Partner with engineering and product leadership to embed quality practices early in the development lifecycle and align QA priorities with product roadmaps.
• Oversee the design and implementation of automated and manual test frameworks, ensuring comprehensive coverage across all products.
• Establish and track quality metrics and KPIs, reporting on product quality, defect trends, and testing effectiveness to the CTO and executive team.
• Own the bug tracking and triage process within Ludi's agile project management tooling, ensuring issues are documented, prioritized, and resolved efficiently.
• Ensure thorough regression testing practices are followed across the team when bugs are resolved.
• Design automated quality gates and pre-merge guardrails that permit agent-generated code to ship at speed without regression leakage.
• Drive test authoring as an agent-assisted workflow: use coding agents to generate and maintain test suites and set the standards for doing so.
• Critically review agent-generated tests, preventing suites that codify existing bugs, pass trivially, or mirror the implementation instead of the requirement.
• Own the evaluation strategy for AI-driven product features: non-deterministic output handling, eval harnesses, and regression detection for model behavior.
• This position is 100% remote and candidate must be located in the United States.

• Bachelor's degree, preferably in business or computer science; advanced degree a plus.
• 7+ years' experience in QA within SaaS, ideally in healthcare, including at least 3 years in a QA leadership or management capacity.
• 5+ years' experience with automated testing tools and strategy; hands-on experience with Playwright/JavaScript or similar toolsets (Cypress, Selenium).
• Proven track record building and scaling QA practices, tools, and frameworks for large-scale SaaS applications.
• Proven track record hiring, managing, and developing QA talent.
• Direct experience running or scaling QA in an environment that uses coding agents (Claude Code, Codex, Cursor, or equivalent). Strong candidates can articulate how agentic development changes test strategy, not just tooling.
• Demonstrated ability to distinguish genuine coverage from agent-produced test theater — suites that inflate metrics without exercising real behavior.
• Ability to scale verification throughput against high-frequency, agent-driven merge volume.

• Experience using agents to write and maintain Playwright suites, not purely manual authoring.
• Familiarity with evaluating non-deterministic and LLM-driven systems: eval frameworks, output regression, LLM-as-judge approaches.
• Work history at smaller early-stage companies; exposure to Agile development shops.

• Proven problem-solving and relationship-building skills across engineering, product, and executive leadership as part of an egoless, results-focused team.
• Articulate and resourceful; communicates effectively with individuals at all levels, including executive leadership.
• Comfortable working remotely and at ease with shifting priorities, unknowns, and self-guided direction.
• Excellent project management and organizational skills; able to articulate technical detail concisely in writing and verbally.
• Accountable for the team's testing artifacts — test cases, scripts, conditions, and expected results — and for ensuring they map to business requirements and functional designs.
• Represents QA in stand-up and leadership meetings, providing detailed analysis when requested.