Data Engineer (PySpark/Informatica BDM)
Location: Bengaluru, Karnataka, India
Workplace: on_site
Description
We are seeking a skilled Data Engineer to join the Group Risk team, responsible for building and managing robust data pipelines to support IFRS9 reporting. The role involves close collaboration with business stakeholders to understand data requirements, perform impact analysis, and deliver high-quality data solutions using modern data engineering technologies such as PySpark and Informatica BDM.
Key Responsibilities
- Collaborate with the Group Risk Team to gather and understand business and data requirements
- Perform impact assessment and technical data mapping for new and existing data sources
- Conduct data profiling to ensure data quality, consistency, and completeness
- Design, develop, and maintain ETL pipelines using PySpark and Informatica BDM
- Build scalable data transformation workflows aligned with IFRS9 data models
- Ensure accurate data extraction, transformation, and loading (ETL) into reporting systems
- Participate in unit testing, validation, and deployment of data pipelines
- Optimize data processing performance and troubleshoot production issues
- Adopt modern tools (e.g., AI-assisted tools like Claude) to improve productivity, reduce errors, and enhance development workflows
- Maintain proper documentation for data flows, mappings, and processes
Required Skills & Qualifications
- Strong experience in PySpark for large-scale data processing
- Hands-on experience with Informatica BDM (Big Data Management)
- Solid understanding of ETL concepts, data warehousing, and data modeling
- Experience with data profiling, data mapping, and impact analysis
- Knowledge of IFRS9 or Risk/Banking domain is highly preferred
- Familiarity with distributed data processing frameworks and big data ecosystems
- Strong SQL skills and experience working with relational databases
- Good understanding of data quality and governance principles
Preferred Skills
- Exposure to cloud platforms (AWS / Azure / GCP)
- Experience with AI-assisted development tools (e.g., Claude, GitHub Copilot)
- Knowledge of CI/CD pipelines in data engineering workflows
Soft Skills
- Strong analytical and problem-solving skills
- Excellent communication and stakeholder management abilities
- Ability to work in a fast-paced, collaborative environment
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say