Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and sky is the limit thinking in a cloud-enabled world.
AI is the strategic bet for Microsoft. The Azure AI Platform is right at the forefront of innovation. Our projects involve cutting edge technologies and problems. Joining these projects you will gain knowledge and experience about generative AI, large language models, large scale inference infrastructure, GPU optimization, AI applications, etc.
The Model Scaling Platform team within AI Platform is responsible for managing all the inferencing capacity that powers Microsoft’s AI ambitions. Our team running state-of-the-art Open AI models provides the foundation for Microsoft’s various Copilots and Azure Open AI Service. We manage a vast number of premium AI accelerators and aim to leverage them in the most agile and efficient manner. Our services and the products they power are experiencing incredible growth. As part of this team, you will have opportunities to work across team boundaries and tackle hard system problems which translate to business impact that directly affect Microsoft’s bottom line.
We are looking for a Principal Software Engineer to help build the next wave of capabilities for the inferencing platform. You will have the opportunity to work with a team of talented engineers in a fast-paced environment to lay the foundations for a new set of systems we are building. The successful candidate will possess technical prowess, be highly motivated, and have a methodological approach to problem solving.
We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Required/Minimum Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Other Requirements
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Additional or Preferred Qualifications
- Bachelor's Degree in Computer Science
- OR related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript,
- OR Python
- OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Experience with distributed systems design and implementation.
- Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
- Experience working on large-scale projects or applications.
- Experience with machine learning, artificial intelligence, and data science
- Familiarity with Azure is a plus.
- Familiarity with large language model and generative AI is a plus.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
#MSFTNSBE25
#AIPLATFORM#
- Design and develop large-scale distributed software services and solutions
- Collaborate across teams and discipline to understand requirements and translate into design and solution that stands the test of time
- Evaluate and recommend new technologies, tools, and processes to improve the efficiency and effectiveness of the team.
- Provide technical leadership and guidance to team members, ensuring best practices and high standards of software quality.
- Provide support to online services by investigating and mitigating issues.
- Embody our culture and values

0 applies
2 views
Other Jobs from Microsoft
Senior Machine Learning Engineer – Xbox Games Technology Group – The Coalition
Senior Software Development Engineer
Technology Specialist Internship Opportunities
Data Scientist: Energy System Modeler - PhD - Redmond
Software Engineer II
Software Engineer II
Similar Jobs
Staff Backend Engineer
Software Engineer - Mobile (React Native)
Software Engineer - Mobile (React Native)
Software Engineer - Mobile (React Native)
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say