Software Engineer (5-7 Years) Data Platform

Responsibilities:

• Ability to understand, own and make changes to large scale systems that stores and process data at petabyte scale.
• Experience with big data stack applications like Hive, Yarn, Spark, Kafka, Impala,  HDFS, YARN, Map-Reduce, Airflow, Presto
• Build into robust, scalable, and supportable Data Warehouse / Data Mart solutions that work well within the overall system architecture.
• Build abstractions and contracts with separation of concerns for a larger scope. 
• Drive problem-solving skills for high-level business and technical problems. 
• Do high-level design with guidance; functional modeling, break-down of a module. 
• Do incremental changes to architecture: impact analysis of the same. 
• Do performance tuning and improvements in large scale distributed systems 
• Work with broader stakeholders to track the impact of projects/features and proactively iterate to improve them 

Requirements: 

• Extensive and expert programming experience in at least one general programming language (e.g. Java, C, C++) & tech stack to write maintainable, scalable, unit-tested code. 
• Experience with multi-threading and concurrency programming. 
• Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with a huge amount of data. 
• Extensive experience in object-oriented design skills, knowledge of design patterns, and huge passion and ability to design intuitive modules and class-level interfaces. 
• Excellent coding skills – should be able to convert the design into code fluently. 
• Knowledge of Test Driven Development. 
• Good understanding of databases (e.g. MySQL) and NoSQL (e.g. HBase, Elasticsearch, Aerospike, etc). 
• Experience with full life cycle development in any programming language on a Linux platform. 
• Worked in a startups environment with high levels of ownership and commitment. 
• Strong desire to solving complex and interesting real-world problems 
• BTech, MTech, or Ph.D. in Computer Science or related technical discipline (or equivalent). 

Good to have:

• Contribution to open source Big Data applications would be a huge plus.
• Deeper understanding of systems to tune data applications in on-premise or cloud would also be a huge plus
• Understanding of the industry’s coding standards and an ability to create appropriate technical documentation.