Senior Software Engineer

Are you interested in building hyper-scale distributed systems?  
 
At the Web Data Platform Team, we build the global web scale Index and the platform that supports it. We are looking for a Senior Software Engineer to help us build the next generation platform in Web Crawler team that is fundamental to all Search and Recommendation scenarios. 
 
Today we crawl tens of Billions URLs/day. This is the go-to service for all web crawling needs across Microsoft, both for consumer and enterprise needs. We are on a journey to containerize the service and build the next version of crawler, which can increase the throughput, reach every URL on the web and is deployed in every region of the world, while being intelligent about minimizing the load on websites being crawled.  
 
The system is expected to maintain a fine balance with discovering the latest pages on the web, maintaining freshness of documents in the Index, while avoiding inundating the web servers with crawl requests. It is a distributed platform scalable with Machine Learning (ML) models aiding effective resource usage. With the advent of Large Language Models (LLMs), web scale data has become critical for training needs, in addition to serving use cases.  
 
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  
 
In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Required Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Preferred Qualifications

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

• Write code that is extensible and maintainable. Understand when the code is ready to be shared and delivered. Always wear scalability and reliability hats. 
• Apply debugging tools and examine logs, telemetry, and other methods to verify assumptions proactively and reactively as issues occur on the platform.  
• Participate in code reviews to ensure coding standards are followed and overall code quality improves over time.
• Build knowledge, share new ideas, identify & resolve any gaps in engineering systems.