RTS- Kafka Engineer

Location: Bengaluru, Karnataka, India, Chennai, Tamil Nadu, India

Department: E-001

Workplace: on_site

Description

Job Summary

We are looking for a highly skilled RTS Kafka Engineer to design, build, and maintain scalable real-time streaming platforms. The ideal candidate will have strong hands-on experience with Apache Kafka, cloud-native architectures, and event-driven systems operating in high-throughput environments. This role involves building reliable streaming pipelines, enabling real-time data processing, and supporting cloud-based distributed systems.

Key Responsibilities

• Design, implement, and manage Kafka-based real-time streaming solutions in high-throughput environments.
• Perform Kafka setup, configuration, tuning, and performance optimization.
• Develop and maintain scalable event-driven and streaming architectures.
• Build and manage streaming data pipelines processing large-scale datasets.
• Implement CI/CD pipelines using tools such as Git, Jenkins, ArgoCD, or similar platforms.
• Work with cloud-native applications deployed across AWS, Azure, or OCI environments.
• Automate infrastructure and deployment using cloud automation toolsets.
• Apply GitOps practices for deployment and environment management.
• Ensure system reliability, scalability, and high availability.
• Implement automated unit testing and integration testing for streaming applications.
• Collaborate with DevOps, platform engineering, and application teams to deliver end-to-end real-time solutions.
• Apply software design patterns and best practices in distributed systems development.

Required Skills & Qualifications

• Strong hands-on experience with Apache Kafka setup, configuration, and administration.
• Experience working with high-volume streaming data platforms.
• Solid understanding of event-driven architecture and distributed systems.
• Experience with source control systems (Git).
• Hands-on exposure to CI/CD pipelines (Jenkins, ArgoCD, or similar).
• Experience with at least one public cloud platform:
• AWS
• Microsoft Azure
• Oracle Cloud Infrastructure (OCI)
• Knowledge of cloud automation tools and infrastructure automation.
• Understanding of GitOps methodology.
• Strong knowledge of software design patterns and implementation practices.
• Experience implementing automated testing (unit & integration testing).

Preferred Qualifications

• Experience with Kafka ecosystem tools (Kafka Connect, Schema Registry, ksqlDB).
• Exposure to containerization and orchestration platforms (Docker, Kubernetes, OpenShift).
• Experience with monitoring and observability tools (Prometheus, Grafana, ELK, etc.).
• Background in real-time systems (RTS) or financial transaction platforms is a plus.