Software Engineer 2

The MAI division at Microsoft IDC is on a journey to create amazing AI experiences using LLM applications in the mobile space to offer useful, simple, and on-the-go intelligence. LLMs are creating opportunities that were completely out of reach for technology solutions only a year ago. Our team is capitalizing on this wave of advancement to deliver magical user experiences that were previously only possible with humans in the loop.  

A big part of this job will be focusing on ultimate outcomes / big picture conceptualizing all the way down to ensuring the delivered product exceeds expectations with the feedback mechanisms in place to allow validation and continual improvement.   

Basic Qualifications: 
 

1. A minimum of 1+ year of experience in software and/or product development.
2. Excellent C/C++/Java/Kotlin/JNI design and coding skills 
3. Android skills (platform and app layer) 
4. Data/ML skills/LLM and Cloud AI models 
5. Design/coding/Debugging/Problem solving (Data structures) 
6. Experience with shipping Android based products with AI powered experience 
7. BS in Engineering or equivalent experience 

Additional Qualifications: 

1. Proven track record of designing and directing complex architecture that spans multiple technologies 
2. Proven track record of shipping high volume consumer devices (Windows, Android, Linux) 
3. Data infrastructure - synthetic phone data and pipeline, automation, etc. 
4. DB with vector indexing and Embedding 
5. APPX package for hosting models with encryption / theft protection 
6. Background runners for data processing 
7. LLM prompts and option sets for Sydney to support RAG 
8. Suggestion service prompts 
9. LlamA /AI Runtime (SNPe, QNN or similar) 
10.  Ability to quickly ramp-up on complex and unfamiliar code 
11. Experience with dealing in geographically diverse teams 

1. Ability to handle the debugger well to quickly identify and resolve issues spanning multiple subsystems. 

2. Enthusiastic, motivated and self-driven. 

3. High tolerance to ambiguity and ability make progress in the face of it. 

4. Strong communication skills and ability to work across multiple disciplines and functions (PM, Test, Hardware Engineers, etc.) 

5. Some domestic and international travel will be necessary. 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

We are looking for talented Software Engineer who has experience in working on designing efficient and scalable systems using LLMs for synthetic data generation, human in the loop labelling, automating algorithm validation, building reports and dash boards, etc. Job may also require working on LLM/Cloud AI models.  

 Our colleagues are among the best in the industry and share an intense passion for delivering amazing products. We’re also a team that likes to have fun and continually learn, and we build that attitude into how we work together and what we create. Some domestic and international travel will be necessary.   

The job is highly dynamic and involves working across various disciplines to successfully deliver the platform with great experience and quality.