
Real job — pulled straight from Qualysoft’s careers page · Verified October 29, 2026 · No reposts.
Job description
Qualysoft is hiring a Java QA Automation Engineer — a full-time, based in Bucharest, Romania role. Apply directly on Qualysoft's careers page below.
Java QA Automation Engineer
Team: Testing & Quality Assurance
Location: Bucharest, Romania
Commitment: Fixed term
Workplace Type: remote
Responsibilities:
• Design and implement Playwright E2E tests for critical user journeys.
• Create stable mocking and fixture strategies (MSW, test fixtures, seeded test data).
• Set up CI quality gates for linting, unit/integration/E2E tests, coverage, and reporting.
• Expand coverage to untested UI and workflow areas and prevent regressions.
• Build an LLM evaluation discipline with golden datasets and measurable quality gates.
• Track model output reliability, detect drift, and gate releases on quality/stability thresholds.
• Improve test maintainability, remove flakiness, and optimize runtime.
• LLM QA Tooling
• Use LangChain4j for JVM-native LLM application support, including agents, RAG, and guardrails.
• Use Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison.
• Use the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation.
• Use Promptfoo in CI when you need language-agnostic regression and red-team checks around the Java stack.
• Use Java schema validation and guardrail patterns with Jackson, Swagger annotations, and LangChain4j guardrails.
• Use OpenTelemetry-based traces and Langfuse datasets as the reproducible source of truth for release gates.
Qualifications:
• Strong Java backend testing skills.
• Strong frontend testing.
• Experience building and maintaining Playwright/Cypress/Selenium E2E suites.
• API testing experience (REST, schema validation, auth/error scenarios).
• Experience with SQL/PostgreSQL testing and test data management.
• CI/CD pipeline experience (GitHub Actions, Azure Pipelines, or Jenkins).
• Practical understanding of testing non-deterministic LLM outputs.
• Performance and benchmark testing experience.
• WebSocket testing experience.
• Security and dependency scanning awareness.
• Experience in legal-tech, fintech, or other regulated domains.
*We are an equal opportunity employer and value diversity. All employment decisions are made without regard to age, gender, disability, race, ethnicity, religion, sexual orientation, or any other protected characteristic. We encourage applicants from all backgrounds to apply.*
Get QA Engineer jobs like this→
New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.
Email me new jobsSimilar jobs




Frequently asked questions
What skills are required for Java QA Automation Engineer at Qualysoft?
The required skills for Java QA Automation Engineer at Qualysoft include: Java, SQL, PostgreSQL, REST, Playwright, Cypress, Selenium, CI/CD, GitHub Actions, Jenkins, OpenTelemetry.
What is the seniority level for Java QA Automation Engineer at Qualysoft?
Java QA Automation Engineer at Qualysoft is a Mid Level level position.
How do I apply for Java QA Automation Engineer at Qualysoft?
You can view the full description and apply for Java QA Automation Engineer at Qualysoft on EchoJobs: https://echojobs.io/job/qualysoft-java-qa-automation-engineer-abd48.