Senior Software Engineer

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

The AI Platform organization at Microsoft builds the end-to-end Azure AI stack/PaaS and is core to Azure’s innovation and differentiation, as well as all of Microsoft’s flagship products, from Office to Teams, to Xbox. We are the team building Azure OpenAI, Azure ML, Cognitive Services, and the global Azure AI infrastructure for running the largest AI workloads on the planet.

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Within AI Platform, the Azure ML team enables data scientists and developers to quickly and easily build, train, deploy, manage, and consume machine learning models. 


At Microsoft, we're passionate about pushing the boundaries of generative artificial intelligence (AI) and natural language understanding. Our Azure Machine Learning Training and Finetuning Team is at the forefront of this mission, working on groundbreaking projects that shape the future of AI-driven applications. We collaborate closely with research institutions, industry leaders, and organizations worldwide to create innovative solutions that impact millions of users.

Required Qualifications :

• 10+ years of experience writing production code in building internet scale services and distributed systems
• Ability to debug, read code and work on a large and increasing codebase
• Engineering knowledge of machine learning systems and data pipelines
• Experience mentoring other developers, working partners and being a team player.Excellent communication and presentation skills

Preferred/Additional Qualifications:

• Preferred demonstrated experience Deploying, Inferencing machine learning models at scale

#IDCAIPlatformHiring

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

As a (Senior) Software Engineer in our team, you will:

• Work on the architecture, design, and development of the core Training platform powering AzureML to tackle challenging problems in large scale training and fine-tuning of LLMs, LVMs for various tasks such as natural language, text analytics, computer vision, conversational AI, and machine translation using state-of-the-art neural models such as Llama, Falcon, Phi etc
• You will bring knowledge of innovative technologies and collaborate with experts to further it
• As a contributor in a customer-obsessed team, you will collaborate with data scientists and other developers on the team to create the necessary abstractions, infrastructure, interfaces and implement features to train, test, validate for machine learning algorithms including but not limited to data cleaning, model training, hyper parameter tuning at massive, distributed scale. You will also be working on scaling these features for big data using distributed systems. You will drive the incorporation of these customer-inspired innovations into our software. You will take holistic ownership of your features
• Your responsibilities will include contributing to and/or backend stateful services written in C# hosted on Kubernetes clusters and Docker containers to provide meaningful features to the customers. You will also be working on improving Python SDK's existing features, designing new features, implementing them in our distributed, multi-component SDK, and owning the full lifecycle of the features including testing and release