Summary:  

Join a dynamic and innovative educational technology organization and play a pivotal role in developing impactful software solutions. We are seeking a Senior Software Engineer with robust experience in Scala, Spark, database systems, and Big Data technologies. This position emphasizes both individual technical contributions and collaborative efforts within an Agile environment to deliver scalable and efficient solutions that address complex business needs.  

Essential duties/responsibilities:  

• Lead technical initiatives and contribute as a senior team member to achieve project goals and deadlines. 

• Collaborate with team members to design, implement, and optimize software solutions aligned with organizational objectives. 

• Build scalable, efficient, and high-performance pipelines and workflows for processing large amounts of batch and real-time data. 

• Perform multidisciplinary work, supporting real-time streams, ETL pipelines, data warehouses, and reporting services. 

• Recommend and advocate for technology upgrades to company leaders to ensure infrastructure remains robust and competitive. 

• Design and develop microservices and data applications while ensuring seamless integration with other systems. 

• Leverage Big Data technologies like Kafka, AWS S3, EMR, and Spark to handle data ingestion, transformation, and querying. 

• Follow coding best practices, including unit testing, code reviews, code coverage, and maintaining comprehensive documentation. 

• Conduct thorough code reviews to maintain quality, mentor junior team members, and promote continuous learning within the team. 

• Enhance system performance through analysis and capacity planning, ensuring efficient and reliable software releases. 

• Actively bring new and innovative solutions to address challenging software issues that arise throughout the product lifecycle. 

• Implement and promote security protocols and data governance standards across development projects. 

• Actively engage in Agile processes to foster collaboration and innovation within the team. 

Required job skills: 

• Strong software design capabilities with a deep understanding of design patterns and performance optimizations. 

• Proficiency in writing high-quality, well-structured code in Java and Scala. 

• Expertise in SQL and relational databases, with advanced skills in writing efficient, complex queries and optimizing database performance. 

• Expertise in cloud computing infrastructure, particularly AWS (Aurora MySQL, DynamoDB, EMR, Lambda, etc.). 

• Solid experience with Big Data tools such as Apache Spark and Kafka. 

• Ability to clearly document and communicate technical solutions to diverse audiences. 

• Experience mentoring and conducting constructive code reviews to support team development. 

• Familiarity with Agile methodologies and modern development tools. 

Minimum qualifications:  

• 10+ years’ experience in designing and developing enterprise level software solutions 

• 3 years’ experience developing Scala / Java applications and microservices using Spring Boot  

• 7 years’ experience with large volume data processing and big data tools such as Apache Spark, SQL, Scala, and Hadoop technologies 

• 5 years’ experience with SQL and Relational databases 

• 2 year Experience working with the Agile/Scrum methodology 

Preferred qualifications:  

• Educational domain background