Lead ML Ops Engineer, GFT

Location: TORONTO, Ontario, Canada

Time Type: Full time

Job Description

What is the opportunity?
Join GFT as a Lead ML Ops Engineer to build and manage CI/CD for ML and agentic AI on OpenShift using GitHub Actions and Airflow. You will partner with machine learning engineers and data engineers to deliver business value with agile practices, maintaining data governance and security. Design scalable pipelines, support data ingestion and feature engineering, and integrate models into APIs and services. Participate in architecture reviews and approvals, set operational standards, and maintain documentation. Own monitoring and incident triage/resolution, optimizing reliability, performance, and cost while enabling teams to safely ship GenAI solutions.

What will you do?

• Build and operate CI/CD for ML and GenAI on OpenShift using GitHub Actions and Airflow.
• Deploy, scale, and manage LLMs and agentic services on OCP and cloud (AWS/Azure).
• Architect and deliver solutions/PoCs for cutting-edge GenAI (RAG, tool-use, agent orchestration).
• Own model lifecycle ops: versioning, registries, feature stores, vector DBs, and GPU environments.
• Build and maintain Model Context Protocol (MCP) integrations (servers/clients and tool adapters) to let LLM agents securely invoke internal APIs, data sources, and actions on OpenShift.
• Define release/rollback procedures; ensure reliable maintenance of deployed models.
• Collaborate with data scientists, ML engineers, and data engineers to integrate models/APIs into microservices and data pipelines.
• Drive platform roadmap, standards, and documentation; enable teams via tooling, templates, and best practices.

What do you need to succeed?

Must Have

• Hands-on MLOps/LLMOps with containers/Kubernetes/OpenShift; CI/CD via GitHub Actions; orchestration with Airflow (good-to-have).
• Production experience with LLMs and agentic AI: RAG, vector search, prompt management, and serving patterns.
• Hands-on with agentic AI and Understanding of MCP: design agent tool-use flows, deploying MCP servers/tools.
• Expert in Python and SQL. Cloud experience (AWS or Azure); designing scalable and secure architectures along with the data architecture team and ML Engineers.
• 3+ years hands on experience
• Proven production experience running ML/GenAI with monitoring and performance tuning.
• Excellent communication and cross-team leadership; BS in CS/Engineering or related (MS/PhD preferred).
• Being able to articulate technical concepts to leadership or key stakeholders
• Foster and drive key innovations within the extended team with emerging technology. 

Nice to Have

• Experience working with Snowflake and SageMaker; model registries/feature stores (MLflow, Feast).
• Guardrails/safety, evaluation methods, and cost optimization for GPU/LLM workloads.
• Understanding of MCP (capability schemas, resources/tools, session management) and telemetry for tool calls (latency/success/cost)
• LLM frameworks and evaluation/guardrails.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
• Leaders who support your development through coaching and managing opportunities
• Ability to make a difference and lasting impact
• Work in a dynamic, collaborative, progressive, and high-performing team
• A world-class training program in financial services
• Opportunities to do challenging work
• Opportunities to take on progressively greater accountabilities 
• Opportunities to building close relationships with clients
• Access to a variety of job opportunities across business and geographies.

#LI-Post

#LI-PK

Job Skills

Additional Job Details

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.