Databricks Platform Engineer (MLOps)

Overview: 

Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new AI-enabled products to optimize the seamless delivery of our services. 

Guidepoint seeks an experienced Databricks Platform Engineer (MLOps) to join the Toronto-based Data/AI team. The Toronto Technology Hub will serve as the base of our new Data/AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to Guidepoint’s vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data products.  

What You’ll Do: 

• Design and implement cloud solutions, build MLOps on cloud (Azure and Databricks) 
• Build CI/CD pipelines orchestration using tools such as Azure DevOps 
• Proficiently use MLFlow and handle model serving and monitoring on Databricks 
• Test, validate, and automate tests for ML models  
• Tune Databricks for spark cluster performance and utilization optimization 
• Provide infrastructure guidance on Databricks capabilities to accommodate business/technical use cases 
• Automate and manage provisioning needs, including Databricks Cluster Policies, Unity Catalog, Secrets Management, Role-Based Access Control model, and permissions 
• Monitor and manage data and processes to control costs and optimize compute spend 
• Configure and manage monitoring/alerting around latency performance on the Databricks platform, including Delta Live Tables and Databricks Workflows and machine learning model performance  
• Coordinate and collaborate with dependent infrastructure teams and Azure services to integrate Databricks securely. 
• Provide technical expertise and troubleshooting as well as support for change management, governance, compliance, internal audits, and remediations 
• Communicate with a team of data scientists, ML engineers, data engineers, and architects, and document the processes 

What You Have: 

• Bachelor’s Degree 
• 2+ years of relevant experience on Databricks, including performance tuning, infrastructure guidance, workflow automation and cost optimization strategies 
• Experience in cloud solutions, preferably on Azure 
• Skills in MLFlow, containerization, and deployment practices (Preferred) 
• Excellent communication and documentation skills to collaborate effectively with cross-functional teams 

What We Offer: 

• Paid Time Off 
• Comprehensive benefits plan 
• Company RRSP Match 
• Development opportunities through the LinkedIn Learning platform 

About Guidepoint: 

Guidepoint is a leading research enablement platform designed to advance understanding and empower our clients’ decision-making process. Powered by innovative technology, real-time data, and hard-to-source expertise, we help our clients to turn answers into action. 

Backed by a network of nearly 1.5 million experts and Guidepoint’s 1,300 employees worldwide, we inform leading organizations’ research by delivering on-demand intelligence and research on request. With Guidepoint, companies and investors can better navigate the abundance of information available today, making it both more useful and more powerful. 

At Guidepoint, our success relies on the diversity of our employees, advisors, and client base, which allows us to create connections that offer a wealth of perspectives. We are committed to upholding policies that contribute to an equitable and welcoming environment for our community, regardless of background, identity, or experience. 

#LI-DH1

#LI-HYRBID