State Street

Data Platform Engineering Lead

Bangalore, India
Python SQL Spark Snowflake Databricks AWS Java Scala Apache Iceberg
Description

Data Platform Engineering Lead - Vice President

Location: Bangalore, India

Time Type: Full time

Job Description

VP - Data Platform – Capability Engineer

Role Summary

State Street Investment Management’s Data, Analytics & AI Services (DAAIS) team is seeking a Senior Data Platform & Software Engineering Principal (Vice President) for our Bangalore, India office. This leadership role is accountable for the architecture, delivery, and operational excellence of modern data platform and software capabilities that power the investment management business. The role partners with global teams and stakeholders across regions and time zones to align priorities and execute consistently. The successful candidate brings deep hands-on expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture, and will hire, build, and mentor a high-performing engineering team.

Key Responsibilities

  • Support the execution of the target architecture and roadmap for a cloud-native data platform across ingestion, transformation, storage, governance, and secure access.
  • Implement and enhance shared platform capabilities for data ingestion, transformation, governance, job orchestration, and metadata management with a focus on reliability, scalability, and operability.
  • Design and optimize Apache Iceberg tables, including partitioning, compaction, and metadata management, to support reliable performance across compute engines.
  • Apply and uphold engineering standards for CI/CD, IaC, automated testing, schema/versioning, data quality, and observability across the team’s deliverables.
  • Partner with Product, Analytics, ML, and SMEs to implement data semantics and data product contracts (schemas, SLAs, documentation, versioning) for assigned platform capabilities while meeting governance and compliance requirements.
  • Build curated semantic models (marts/serving models) and deliver governed BI endpoints and consumption APIs for priority business and platform use cases.
  • Optimize pipeline and query performance using partitioning/clustering, caching, archiving, and lifecycle management (retention/purge).
  • Lead day-to-day platform operations for owned services, including incident response, backfills, root-cause analysis, and reliability improvements.
  • Lead and mentor a team of engineers or a platform pod, driving technical execution, delivery quality, and operational discipline.
  • Coordinate with outsourcing partners on assigned deliverables, track capacity, and support milestone-based execution.

Required Qualifications

  • 15+ years in software/data engineering, including technical leadership for large-scale data platforms; BS/MS in Computer Science/Engineering (or equivalent experience).
  • Demonstrate strong communication and stakeholder management; influence architecture decisions across engineering, product, security, and enterprise architecture.
  • Demonstrate experience leading a multi-team engineering organization with end-to-end accountability for delivery, quality, and operations.
  • Write production-grade Python and SQL (Java/Scala a plus); design, debug, and optimize distributed data processing.
  • Tune and troubleshoot Spark (batch and streaming), including performance and cost optimization.
  • Build and operate lakehouse platforms using Snowflake and Databricks on AWS (GCP or Azure acceptable) for high-concurrency analytics.

Preferred Qualifications

  • Bring prior data platform engineering experience in a financial institution (asset management preferred).
  • Work with structured and alternative/unstructured data sources and their processing patterns (batch, streaming, and event-driven).
  • Leverage AI-assisted coding tools (e.g., GitHub Copilot, Claude Code) to improve developer productivity while maintaining code quality.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

State Street
State Street

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say