Data Engineer (PySpark)

Location: Bengaluru, Karnataka, India

Workplace: on_site

Description

We are looking for a highly skilled Data Engineer to join the Data Engineering Chapter supporting the Group Operations Team. The ideal candidate will work closely with business and technical stakeholders to understand data requirements, perform impact analysis, and build scalable data pipelines using modern technologies like PySpark.

Key Responsibilities

• Collaborate with the Group Operations Team to gather and analyze data requirements
• Perform impact assessment, technical data mapping, and data profiling
• Design and develop data extraction, transformation, and loading (ETL) pipelines
• Build and optimize data pipelines using PySpark as part of the bank’s modern tech stack
• Develop data solutions aligned with AECB application data models
• Ensure data quality, integrity, and consistency across systems
• Participate in unit testing, deployment, and production support
• Leverage modern AI tools (e.g., Claude) to improve development efficiency and reduce operational errors
• Work in an agile environment and contribute to continuous improvement initiatives

Required Skills & Qualifications

• Strong hands-on experience with PySpark and big data processing
• Expertise in Informatica BDM Development
• Solid understanding of ETL/ELT concepts and data warehousing
• Experience in data mapping, profiling, and impact analysis
• Knowledge of SQL, data modeling, and performance tuning
• Familiarity with banking/financial data systems is a plus
• Exposure to AI-assisted development tools is an added advantage
• Strong problem-solving and analytical skills

Preferred Qualifications

• Experience working in banking or financial services domain
• Familiarity with AECB reporting/data standards
• Experience with cloud platforms (AWS/Azure/GCP) is a plus