Senior Software Engineer - Scala, Spark, Airflow, Python

Responsibilities

• Hands on developer to design, code, and test iteratively to support complex big data applications deployed on Cloud Infrastructure (AWS).
• Plan, develop, execute and maintain automated unit, functional test cases; develop modular, robust, and maintainable automation scripts to integrate with CICD process.
• Must have strong analytical and technical skills with passion to deep dive on data  in troubleshooting, devise techniques for problem resolution.
• Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
• Build platform reusable code and components that could be used by multiple project teams. 
• Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
• Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals

Key skills

• 5+ years of hands-on software development with a bachelor’s degree in computer science, engineering or relevant field
• Must have strong cloud Implementation expertise in cloud architecture.
• Must have very good knowledge of storage, network, AWS(Compute services). Have sound knowledge in multi-zone, region-based designs.
• Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security. 
• Extensive programming experience and desire to write and review code 70% of the time. 
• Experience in software development using programming languages & tools/services: Java(advanced), Python (intermediate) and strong SQL programming (advanced).
• Experience in big data processing tools/languages using Spark.
• Experience with job orchestration tools: Apache Airflow or similar tools.
• Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
• Agile scrum experience in application development is required. 
• Experience with cloud technologies: EC2, EKS, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
• Demonstrates knowledge of CI/CD processes, testing frameworks,  practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, etc.)
• AWS Certification is a plus.