Microsoft 365 is at the core of Microsoft mission to enable people and organizations to achieve more. Intelligent Data Engineering and Analytics (IDEAs) services handle millions of users and exabytes of data. This is not just some large-scale web service: the implementation ranks among the world’s largest and state of the art distributed systems, spanning across data centers around the world.
Microsoft 365 IDEAs team’s goal is to help customers improve productivity, champion a data-informed culture, and enable the entire Microsoft 365 organization to make more informed decisions through data. We see this effort as a huge opportunity in providing information to both external and internal users that will improve efficiency, empowerment, and helps Microsoft win in the critical cloud business sector.
We are looking for an experienced Senior Software Engineer who will collaborate with Data Scientists, Program Managers, and Platform Engineers to design and implement high-quality end-to-end ML solutions, covering data ingestion, feature engineering, training, scoring, monitoring, and endpoint integration. The candidate should research innovative optimization methods, manage a high-quality feature store, and develop tools for streamlined model onboarding.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Required/Minimum Qualifications:
- Bachelor's Degree in Computer Science or a related technical field AND 4+ years of technical engineering experience with coding in languages such as C, C++, C#, or Python (or equivalent experience).
- 2+ years of experience implementing and optimizing data platforms or machine learning platforms.
- Familiarity with machine learning/AI workflows and models, including but not limited to classical machine learning models, deep learning models, and large language models.
- Solid Python programming skills and proficiency in coding practices (CI/CD, package design, unit testing, etc.).
- Proven track record of optimizing models on various compute types (Spark, etc).
- Experience integrating and processing terabyte-scale data sources into curated feature datasets using batch and streaming methods.
- Experience with orchestration frameworks such as Azure Data Factory, Airflow, or equivalent
- Experience implementing API interfaces for model serving, such as OpenAPI or FastAI.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Knowledge of statistics and experiment design (i.e. A/B testing, causal inference).
- Experience with containerization: Docker, Kubernetes.
- Experience with Azure Machine Learning (or equivalent).
- Experience with ML Ops frameworks like MLFlow, KubeFlow or equivalent.
- Experience with compiled languages: C++, C#, or Java.
- Experience with Microsoft analytic systems: Cosmos, Kusto, Substrate AI, Synapse.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
#M365CORE
- Work closely with Data Scientists, Program Managers, and Platform Engineers to design and implement high-quality end-to-end ML solutions in production (including data ingestion, feature engineering, training, scoring, monitoring, telemetry, and endpoint integration).
- Research innovative ways to optimize all aspects of managing models in production to reduce implementation times and ensure best possible model quality and performance (including algorithms, parameter tuning, compute environments, model management tools, feature selection).
- Onboard feature data from a wide variety of sources and manage a high-quality feature store to support production models and data scientist productivity.
- Build a deep understanding of Microsoft ML platforms and open-source frameworks to guide what capabilities we can adopt in our environment.
- Develop packages and tools to streamline the model onboarding and management.
- Monitor production model performance and health, identify where improvements need to be made, and handle production incidents when they occur.

0 applies
7 views
Other Jobs from Microsoft
Principal Researcher – Generative AI - Microsoft Research AI Frontiers
Software Engineer
Software Engineer
Software Engineer
Senior Software Engineering Manager
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say