​​Software Engineer II​

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. 
 
Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. 

​​Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We are in the process of integrating our disparate products into Azure Synapse Analytics with a set of experiences that are meant to simplify and accelerate time to value.   ​ 

​​The Azure Intelligence Platform team in Microsoft present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence, and storage. We build reliable, huge scale and high-performance distributed systems for big-data analytics on Azure. Azure HDInsight is one of the widely adopted Big-data PaaS services on Azure that offers popular open-source technologies, such as Spark, Hadoop, Hive, Kafka, HBase, Flink with enterprise grade security and governance. We work closely with the Apache community by both contributing new features to Open Source and adopting the latest from the community.   

​​ 

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served. 

Required/Minimum Qualifications 

​​Academics: B.E./ B.Tech. or equivalent degrees in Computer Science (Masters is a plus).   
 
Overall Experience: 2 - 6 years ​ 

Other Requirements 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: 

• This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

• Preferred/Additional Qualifications 

  ​​Good experience in Big-Data platforms with deep understanding in one of the technologies such as Apache Flink, Kafka and/or HBase. 
   
  Good experience working with Linux based system and debugging it.  
   
  Good experience in building and maintaining any distributed computing data platforms.  
   
  Clean coding habits with proficiency in Java/Scala/C#.  
   
  Big plus if have:  
   
  Good understanding of cloud technologies such as storage, compute, and network.  
   
  Good knowledge in Container Orchestration - automates the deployment, management, scaling, networking using Kubernetes, Basic security understanding in Kubernetes platform. ​ 

#azdat 

#azuredata 

​​#analytics, #hdinsight​ 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

​​As an engineer of Streaming and Store services, you will be part of engineering team that focus on Apache Flink, Kafka and HBase to build containerized, highly scalable, faster performing enterprise ready big-data platforms on Microsoft Azure for supporting data warehousing, machine learning and IoT applications. You will also collaborate with customers to on-board them into HDInsight clusters, understand their use-cases to build features and debug issues on their live/production/test clusters.  
 
Successful candidates will have excellent experience in one or more of these areas:  
 
Delivering Cloud services in an engineering role.  
 
Collaborate with customers and partners across geographies to understand business goals and technical requirements.   
 
Work on modern container frameworks like Azure kubernetes (AKS) to develop OSS platforms. 
 
Enterprise products design and implementation (Java/Scala/C#)   
 
Good exposure to Azure stack including Storage, Compute, Network, Azure Kubernetes Service, Purview, Azure DevOps, ADF, Power BI etc.  
 
Building cloud scale big data analytics products using Azure tools and services with a focus on efficiency, reliability, and security.   
 
Driving the feature development in HDInsight Streaming and Store services end to end, all the way from gathering requirements, development, testing, deployment to ensuring high availability post deployment.   
 
Collaborate with Apache Flink, Kafka, HBase open-source community to drive design discussion and review for new feature development and bug fixes.   
 
Committing or contributing to any Open-Source big data technologies.   
 
Debugging customer issues in their live/production/dev clusters and providing solutions to restore service with minimal disruption to their business. Perform root cause analysis, trend analysis and post-mortems. ​ 

Embody our culture and values