Senior Software Engineer

The Azure Cloud & AI organization is at the forefront of Microsoft’s AI revolution, driving the integration of Artificial Intelligence into services and applications that empower millions of people daily. Azure AI Core Engineering supports this mission by delivering and operating backend systems that power Azure AI services.

We're a small team within Azure AI Core Engineering responsible for the engines that host the runtime for Azure Open AI large language models.

We're seeking an accomplished Senior Software Engineer to help us with the continuous delivery of cutting edge AI features to first-party and third-party customers.

You will work at the intersection of development and operations. You will play an active role to drive continuous improvements in service quality. You will bring your technical expertise and an open mindset to help the team be more efficient and thrive.

You will also be responsible for the development of features that will require close collaboration with project stakeholders and engineers responsible for other components of the architecture. We believe that this is an exceptional opportunity to play a key role in shaping the future of AI at Microsoft.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Required qualifications:

• Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in Python OR C/C++                                                                                                                                                                                                                        o OR equivalent experience.
• 2+ years technical background and foundation in software engineering principles and architecture design for cloud services.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred qualifications: 

• Experience developing and operating cloud service running on Kubernetes.
• Great attention to details. An ability to diagnose issues in complex systems.
• Effective communication skills (both written and oral)
• Practical experience working on applications that use GPUs, and optimizing their performance

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until December 5, 2024

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

• Be responsible for product features. Develop, test and deploy new runtime capabilities for Azure Open AI. Benchmark new systems to define operational limits. Work closely with partners across Azure AI Core and Microsoft to ensure systems integrate reliably and efficiently.
• Share responsibility for the live site. Participate in on-call rotation to quickly address issues as they occur in the live site. Lead root cause analysis and implement repair work. Help drive continuous improvements (monitoring, self-healing actions to keep humans out of the loop, performance improvements, etc.) to ensure the service beats its operational objectives.  
• Help drive high engineering standards. Ensure that products meet and exceed standards for security and compliance. Drive automation of processes to enhance engineering efficiency within a CI/CD loop.