Principal Data Engineering Manager

Microsoft’s Cloud business is expanding, and the Cloud Supply Chain (CSCP) organization is responsible for enabling the infrastructure underlying this growth including AI!
CSCP’s vision is to empower customers to achieve more by delivering Cloud Capacity Differentiated at Scale. Our mission is to deliver capacity for all cloud services predictably through intelligent systems driven by continuous learning and a world class organization. The CSCP Organization is responsible for traditional supply chain functions such as Plan, Source, Make, Deliver, but also manages supportability (spares), decommissioning and disposition of Data center assets worldwide. We deliver the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Skype, OneDrive and the Microsoft Azure platform for external customers. Our infrastructure is comprised of a large global portfolio of more than 200 datacenters supporting services for more than 1 billion customers in over 90 countries worldwide.

The DE&I Engineering team is looking for a Principal Data Engineering Mananger to lead the team that is responsible for the design, architecture, and development of CSCP’s Digital Data Platform. The technologist in this role will drive the future state designs and features for the enterprise-wide data platform, evangelize best practice design patterns and lead the implementation agentic AI architecture on the data platform. Working closely with business leadership and engineering teams, this person will have the opportunity to transform CSCP into a data driven organization this role. A successful candidate will have strong technical domain experience, ability to articulate a strategic technology vision, be well versed in the current industry technology landscape including Azure cloud services, AI/ML, and modern data architecture. This person will also be able to influence and shape both short term and future state technology architecture and roadmap. Also vital for success in this role is the ability mentor and grow the careers of the software and data engineers in the team.

Required Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, or data engineering work
  • OR equivalent experience.
• 5 + years of experience Cloud Infrastructure Management of Platform as a service
• 5 + years of of variety of database, analytics and cloud technologies and platforms
• 5 + years of experience mentoring and guiding engineers developing with Spark, Python, APIs, Node.js, UI/UX

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications: 

• Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  OR equivalent experience.
• Big Data Analytics with Spark, Python, Scala
• Streaming Analytics with Kafka or Event Hub
• Data Lake Architecture and Delta Lake
• Machine Learning and Artificial Intelligence
• Application Programming Interfaces Frameworks
• Design and implementation experience of databases, data platforms, and managing production workloads with Extract, Transform, Load, and streaming
• Expertise in Database design, data security, and access controls
• Demonstrated experience managing development of distributed engineering teams

Data Engineering M5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 23, 2024

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

• Manage the Data Platform and Integration team
• Accountable for the architecture and engineering designs of the CSCP Data Platform
• Oversee designs for future road map for Data Platform for AI as a service
• Ensure instrumentation, telemetry, and lineage in the data platform
• Perform design and code reviews to ensure engineering quality of critical deliverables
• Mentor and manage technical leads, engineers and analytical resources and help them with their career trajectory
• Bring an innovative, start-up mentality to the team and push forward in the face of ambiguity
• Embody our Culture and Values