Staff Engineer (Cloud Streaming Platform)

Company Description

Discover the Unexpected 

Experian is the world’s leading global information services company. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index. We’re passionate about unlocking the power of data in order to transform lives and create opportunities for consumers, businesses and society. For more than 125 years, we’ve helped businesses grow, consumers and small businesses gain access to financial services, and economies and communities flourish – and we’re not done.

Our 18k amazing employees in 40+ countries believe the possibilities for you, and the world, are growing. We’re investing in the future, through new technologies, talented people and innovation so we can help create a better tomorrow.

To do this we employ the greatest and brightest minds that share our purpose and want to make a difference. Experian Asia Pacific's culture, people and environments are key differentiators. We focus on what truly matters; diversity and inclusion, work/life balance, flexible working, development, equity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. We’re committed to fostering a strong sense of belonging and a place where you can bring your true self to work.

Our uniqueness is that we truly value yours. We’re an award winning organisation due to our strong people first focus. This includes Top Employer™ and Great Place To Work™ accreditations.

Learn more at www.experianplc.com

Job Description

About this role

As a Staff Software Engineer, you must be a messaging expert with extensive, well-rounded background in a diverse set of messaging middleware solutions (commercial, open source, in-house) with in-depth understanding of architectures of such solutions such Kafka. You’ll need an established track record with Kafka technology (administration, configuration, and troubleshooting), with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components such as Kafka Connect, Kafka Streams. Additional responsibilities for this position include:

• Design, develop and implement the Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Attunity, Schema Registry, and other streaming-oriented technology
• Assist in building out the DevOps strategy for hosting and managing our SDP microservice and connector infrastructure in AWS cloud
• Good track record of design/implementing big data technologies around Apache Hadoop, Kafka streaming, No SQL, Java/J2EE and distributed computing platforms in large enterprises where scale and complexity have been tackled.
• Proven experience participating in agile development projects for enterprise-level systems component design and implementation
• Deep understanding and application of enterprise software design for implementation of data services and middleware.

Qualifications

What your background looks like

• Bachelor’s degree in technical discipline; Masters preferred
• Experienced engineer with hands on and good coding skills, preferably with Java, Scala, Python
• Knowledge and experience with Kafka Streaming, Containerized Micro Services
• Experience in monitoring the health of Kafka cluster (data loss and data lagging) and strategy for short TTD (time to detect) of broker failure and fast TTR (time to recover)
• Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra)
• AWS Cloud experience – S3, EFS, MSK, ECS, EMR, etc.
• Knowledge of Hadoop/Spark and various data formats like Parquet, CSV, etc. is a plus
• Great attention to details with analytical/curious mind
• Organizational and communication skills

Additional Information

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here