Big Data - Automation Engineer

What is the opportunity?
You will be part of our fast paced Finance IT team and will be responsible for Test Implementation and Test Automation oversight on our Big Data Platform using latest technologies like Cloud, Kafka, and Containerization. The project comprises of teams of QE professionals providing Test Services for the applications and programs within Finance IT. Your role will focus on leading the team providing and improving on QE Automation for these groups while implementing test execution. This position provides you opportunity to demonstrate and build technical processes and architecture as well and leadership skills while providing IT solutions to highly volatile business environment.   

What will you do? 

Key Responsibilities:

• Design, develop, and execute automated test scripts for Big Data pipelines, ETL processes, and data validation.

• Perform end-to-end testing of Big Data applications, ensuring data accuracy, integrity, and performance.

• Collaborate with developers, data engineers, and business analysts to understand requirements and define test strategies.

• Validate data transformations, data ingestion, and data processing workflows in distributed systems.

• Identify, document, and track defects, ensuring timely resolution.

• Develop and maintain test automation frameworks for Big Data environments.

• Conduct performance testing to ensure scalability and reliability of Big Data systems.

• Work with tools like Apache Spark, Hadoop, Hive, Kafka, and other Big Data technologies to validate data workflows.

• Ensure compliance with data quality standards and best practices.

• Continuously improve testing processes and automation coverage.

Required Skills and Qualifications:

• 3-4 years of experience in QA with a focus on Big Data testing and automation.

• Hands-on experience with Big Data technologies such as Hadoop, Spark, Hive, Kafka, or similar.

• Proficiency in programming/scripting languages like Python, Java, or Scala for test automation.

• Experience with test automation tools and frameworks (e.g., Selenium, TestNG, JUnit, or custom frameworks for Big Data).

• Strong understanding of ETL processes, data pipelines, and data validation techniques.

• Familiarity with SQL and the ability to write complex queries for data validation.

• Knowledge of version control systems (e.g., Git) and CI/CD pipelines.

• Excellent problem-solving skills and attention to detail.

• Strong communication and collaboration skills to work effectively in a team environment.

Preferred Qualifications:

• Bachelors/master’s in computer science or relates studies

• Experience with cloud platforms like AWS, Azure, or Google Cloud for Big Data solutions.

• Knowledge of containerization tools like Docker and orchestration tools like Kubernetes.

• Familiarity with data visualization tools and reporting frameworks.

• ISTQB or other relevant QA certifications.

What’s in it for you? 

• We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

• Leaders who support your development through coaching and managing opportunities

• Ability to make a difference and lasting impact

• Work in a dynamic, collaborative, progressive, and high-performing team

• A world-class training program in financial services

• Flexible work/life balance options

• Opportunities to do challenging work

• Opportunities to take on progressively greater accountabilities 

• Opportunities to building close relationships with clients

#LI-ASPOST

#TECHPJ

Job Skills

Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Quality Engineering, Software Product Testing, Test Automation

Additional Job Details

RBC CENTRE, 155 WELLINGTON ST W:TORONTOTORONTOCanada37.5Full timeTECHNOLOGY AND OPERATIONSRegularSalaried2025-03-182025-07-22

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.