ΑΙ Senior Software Engineer in Test

Location: Athens, Greece

Department: Pipeline Tech & Product

Let's start with the role

You will join an autonomous Agile team and work closely with the Product Owner, Technology Lead Data Scientist and AI engineers to create a competitive advantage for Kaizen and offer a unique online experience to our customers. 

As an AI Senior Software Engineer in Test, you will utilize your experience and technical expertise to make your mark in the quality of the products and experiences we offer our customers. Relish the opportunity to contribute in this key role where you will liaise with our talented AI team and business and domain experts. Your understanding of the testing lifecycle will enable you to liaise seamlessly with a broad cross-section of colleagues, product owners and stakeholders, and provide a vote of confidence regarding the quality of the product. 

You will help us evaluate and improve with insights the quality of our personalized recommendations by moving away beyond traditional API testing. Rather than simply verifying whether an API returns results, you will help determine whether it returns the best possible results for our customers at a given moment. This is not a traditional Software Engineer in Test role. You will act as the voice of our customers, providing meaningful quality feedback that helps improve our AI and GenAI products and models.

As a Senior Software Engineer in Test you will:

• Review user stories and acceptance criteria in order to develop effective test plans and both manual and automated tests cases in collaboration with the AI team;
• Design complex automation solutions regarding functional and non functional testing;
• Apply your deep knowledge of testing strategies and demonstrate the ability to contribute in all levels of the testing pyramid;
• Take ownership of the Software Testing Life Cycle (STLC) for new features on testing suites, taking technical ownership to ensure timely and quality delivery;
• Research test tools, methodologies, and trends and upgrade existing practices and processes;
• Use both automated and manual testing to help us evaluate and improve the quality of our personalized recommendations and responses provided by our AI and GenAI products and models;
• Lead efforts alongside our AI teams to evaluate non-deterministic conversational GenAI products and AI models

What you'll bring

We are looking for a Senior Software Engineer in Test who is a team player with a can-do attitude and excellent communication skills.

• Bachelor's or Master's degree in Computer Science/Software Engineering or an IT-related discipline;
• 5+ years of experience as a Senior Software Engineer in Test (this is just an indication, your actual skills matter the most);
• Hands-on and strong experience in at least one programming language, preferably Python; 
• Strong knowledge of software QA methodologies, tools and processes;
• Hands-on experience with web browser automation tools such as Selenium or Playwright; 
• Good understanding of all levels of the testing pyramid;
• Experience in defect tracking and test management tools such as JIRA, X-Ray etc
• Experience working closely with product teams to understand requirements and verify/validate they are met;
• Passion for continuous learning, curiosity about how things work and interest in providing quality feedback to improve customer experiences; 
• Excellent written and verbal communication skills in English; 
• General understanding of GenAI and AI technologies;
• Demonstrated AI-first mindset, actively leveraging AI tools and assistants to improve productivity, problem-solving and decision-making. Continuously explores new AI capabilities and champions their practical adoption within teams, using AI as a natural part of day-to-day work rather than a supplementary tool
• Experience testing and evaluating non-deterministic conversational GenAI products using LLMs-as-a-judge for example and AI models (Nice to Have)
• Prior experience with iGaming (nice to have)

Kaizen Gaming Perks

• 🕑 Hybrid way of working;
• 🏃 A buddy will support you with your onboarding;
• 💸 Competitive pay & bonus scheme;
• ⭐Developmental 360° feedback framework;
• 💰 Monthly meal allowance;
• 👩‍⚕️ Private health insurance for you and your family;
• 📚 Unlimited access to Udemy & continuous training;
• 👨‍👩‍👧‍👦 Family Support.