Lead QA Engineer

Location: Pune

Time Type: Full time

Job Description

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!

We are looking for an QA Automation Engineer to join our Big Data Platform team. You will build and maintain automated tests for API-based data access and Spark data processing jobs, working with data engineers to ensure our data pipelines are accurate, reliable, and performant.

Responsibilities

• Build and maintain automated test scripts for REST/API-based data access services
• Test Spark job outputs for correct transformations, aggregations, and schema
• Validate data pipelines end-to-end for completeness, accuracy, and consistency
• Write SQL queries to verify data in databases/data lakes against expected results
• Work with data engineers/PMs to define test scope from pipeline requirements
• Log and track defects (e.g., JIRA) and support root cause analysis
• Debug and analyze logs to identify failure root cause and enable resolution
• Integrate automated tests into CI/CD pipelines
• Maintain deployment pipelines and workloads for QA environments

Qualifications

• 7-9 years of QA/automation experience
• Working knowledge of Python or Java for test scripting
• Exposure to REST API testing (Postman, RestAssured, or requests)
• Basic understanding of big data concepts and Apache Spark (DataFrames, jobs, transformations)
• Good SQL skills for data validation
• Exposure to CI/CD tools (Jenkins/GitLab CI) and Git
• Strong analytical skills and good communication for cross-functional collaboration