Description
Senior Data Engineer – Financial Services
Location: Mumbai
Experience: 15+ years
Job Title: Senior Data Engineer – Financial Services (Data Lakehouse & Real-Time Systems)
About the Role
We are seeking seasoned Data Engineering and architecture leaders to architect and deliver a next-generation data lake/house platform for a leading financial services client. This engagement will involve thorough data architecture and engineering components, analysis of complex data and its ecosystem and integrating real-time trade, crypto, securities and fixed income data, analytics, and risk systems for various use-cases. The ideal candidate combines deep domain experience in retail brokerage with hands-on expertise in AWS, MS- Azure Databricks, Spark, and modern data lake/house architectures, and can balance delivery under pressure with architectural foresight and team mentorship. This role requires a deep skill-set in real-time architectural systems and pipelines, adept with financial services specifically, investment domain and a hands-on engineer with a knack of innovative insight on integration of various data architecture/s within the cloud ecosystem.
Key Responsibilities
• Architect and lead the design, implementation, and optimization of large-scale data lake/house systems on Azure Databricks using Spark, Delta Lake, and Python. (advanced)
• Build and optimize streaming pipelines for real-time ingestion, processing, and analytics of trade and market data across asset classes (FX, equities, futures, options, bonds, and crypto). (intermediate)
• Collaborate closely with the CTO and data architects to evolve the end-to-end application architecture for scalability, resilience, and low-latency performance. (advanced)
• Mentor and guide junior and mid-level engineers, establishing best practices in data modelling, orchestration, and operational monitoring.
• Ensure data integrity, lineage, and governance within regulatory and compliance frameworks. (advanced)
• Partner cross-functionally with business and technology teams to align data infrastructure with business KPIs and capital markets product goals.
• Drive automation and CI/CD for data pipelines using Terraform, GitHub Actions, and cloud-native DevOps practices. (advanced)
• Deliver under tight timelines, managing sprint-level execution and ensuring production readiness within a short time-line for GO-LIVE.
Required Skills and Qualifications:
• 15+ years of professional experience, with at least 10 years in financial services and 8+ years in data engineering leadership roles.
• Proven track record building real-time, high-throughput data platforms at enterprise scale.
• Strong proficiency in Azure Databricks, Apache Spark, and Python (PySpark, Panda).
• Solid experience with streaming technologies (Kafka, Kinesis, Event Hubs, or Flink).
• Deep understanding of data lake/house design principles (Cloud Engineering and architecture, AWS, Delta Lake, Iceberg, or Hudi) and data modelling for analytics and ML pipelines.
• Strong background in retail brokerage and trading systems, including exposure to FX, equities, futures, options, bonds, and crypto.
• Experience building or integrating risk management systems, trade surveillance, or crypto exchanges.
• Practical knowledge of data governance, lineage, and metadata management tools (e.g., Azure Purview).
• Proven ability to design scalable, cost-efficient pipelines on Azure using Data Factory, Synapse, and related services.
• Excellent communication, collaboration, and documentation skills, with the ability to influence senior stakeholders.
Preferred Qualifications
• Experience working with microservices-based or event-driven architectures supporting capital markets workloads.
• Familiarity with machine learning pipelines for predictive risk and trading analytics.
• Exposure to Shopify-like multi-tenant or marketplace data architectures.
• Cloud certifications: Microsoft Certified: Azure Data Engineer Associate or equivalent.
• Previous experience in start-up or fast-paced delivery environments with adaptability and velocity.
Core Attributes
• Strong sense of ownership, reliability, and confidentiality in managing critical financial data.
• Ability to balance delivery urgency with architectural integrity.
• A collaborative mentor who uplifts engineering standards across the team.
• Strategic mindset with hands-on execution capability.
Engagement Details
• Number of Positions: 3
• Location: Mumbai
• Engagement Type: Full-Time / Contract-to-Hire
• Timeline: Immediate start; production launch targeted for January
• Reports To: Engagement Lead in conjunction with Client CTO.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say