Senior Software Engineer

Microsoft bets on Artificial Intelligence (AI) as the next growth opportunity for the company. OpenAI, Mistral, and other Large language Model (LLM) driven innovations are happening throughout the industry. Azure AI is focused on building a platform that makes it easy for both first party Microsoft teams and third-party customers to build cutting edge applications on top of these large language models

The Back Plane team in Azure Machine Learning is looking for a senior software engineer who loves to build scalable, highly available, and secure microservices that run in Kubernetes. The infrastructure team focuses on managing a large fleet of Azure Kubernetes Services (AKS) that represents the control plane for AzureML

The team focuses on:

• Managing Kubernetes Cluster Deployments at Scale
• Secure Control Plane assets from malicious attacks and unauthorized access using industry standard tools and frameworks
• Automate Monitors and critical alerts using best in class observability tools such as: Azure Monitor, Prometheus, Azure Data Explorer, Grafana
• Automate CI/CD deployments using YAML builds and releases

For the Azure ML platform, we build tools to increase the observability of the applications running in the Kubernetes clusters, improve the speed, security, and reliability of our deployments, secure our supply chain and services, and debug production with ease. We use the best of open source, like Prometheus, Grafana, and NGINX, and build solutions to enable Azure ML to deliver a global service that handles large scale ML training and inferencing workloads

Required Qualifications:

• Object oriented design fundamentals
• Bachelor’s degree in computer science
• 5+ years of experience with coding in one of C#, Python, Go, Rust, Java, C or C++
• Experience with improving service operations or engineering fundamentals
• Excellent collaboration skills, team player, thrive to make a difference
• Excellent architecture and design skills

Preferred Qualifications:

• Prior experience using docker or Kubernetes in building large scale cloud services, distributed systems, or operating systems
• Understanding of Microservices architecture, Docker, K8s, NGINX, Observability (Logs, Metrics, etc..), Network Layer protocols is a plus
• Experience programming GPUs (graphics processing units), CUDA/cuDNN/NCCL - a plus

#IDCAIPlatformHiring

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work

As a Software Engineer on our team, you will drive the design, development, and support of the platform that powers Azure Machine Learning. You’ll work across teams to help make the whole organization successful. Your responsibilities will include the following:

• Design, implement, and support scalable, reliable, high-performance services
• Write clean and concise code with unit tests
• Design, implement, and support new features as well as extend existing systems
• Investigate live site issues and implement and deploy fixes
• Participate in an on-call rotation
• Drive quality engineering via code reviews and design discussions