Lead Software Engineer - Data Engineer

Location: Hyderabad, Telangana, India

• Build automated, self-healing data operations using agentic frameworks and AI-driven workflows for intelligent monitoring, optimization, and remediation 
• Design and deploy data solutions using AWS services including S3, Lambda, EKS (Elastic Kubernetes Service), and Step Functions 
• Implement Infrastructure as Code (IaC) practices for reproducible and scalable deployments 
• Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
• Build and optimize scalable data ingestion, transformation, and analytics solutions using Apache Spark, AWS Glue, and Apache Iceberg
• Develop and manage both batch and real-time data pipelines leveraging Apache Kafka and Apache Flink for streaming data processing. Implement Data Lake architectures with efficient data organization, partitioning, and governance strategies
• Design and architect end-to-end data solutions from ingestion to analytics, ensuring scalability, reliability, and performance at enterprise scale
• Define data architecture standards and best practices for batch and real-time data processing pipelines