Description
Lead Data Engineer
Location: South Carolina, South Carolina, United States
Workplace: hybrid
Employment Type: full
Description
Senior/ Lead Data Engineer (AWS) – Wealth Management
Location: Fort Mill, NC (Hybrid)
Employment Type: Full-Time
Role Overview
We are seeking a Senior Data Lead Engineer with deep expertise in wealth management / financial services and strong hands-on skills in Python based data engineering. This role will lead the design, development, and optimization of enterprise-scale data platforms supporting portfolio management, client reporting, risk analytics, and regulatory compliance. You will act as a technical leader, driving modern data architecture, mentoring teams, and partnering with business stakeholders to deliver high-impact data solutions.
Key Responsibilities
Data Engineering & Architecture
- Design and build scalable data pipelines using Python (PySpark, Pandas, Airflow).
- Architect data lakes / warehouses (Snowflake, Redshift, or similar).
- Implement real-time and batch data processing frameworks.
- Optimize data models for analytics, reporting, and ML use cases.
Wealth Management Domain
- Work with datasets across:
- Portfolio & asset management
- Trade lifecycle & transaction data
- Client onboarding & KYC
- Performance reporting & attribution
- Build systems supporting investment analytics, risk, and regulatory reporting.
Leadership & Strategy
- Lead a team of data engineers; provide technical guidance and code reviews.
- Define data engineering best practices, governance, and standards.
- Collaborate with Product, Analytics, and Business teams.
- Drive data quality, lineage, and observability frameworks.
Cloud & Platform Engineering
- Develop solutions on AWS:
- S3, Glue, Lambda, EMR, Redshift
- Implement CI/CD pipelines and infrastructure-as-code (Terraform/CloudFormation).
- Ensure security and compliance (FINRA, SEC considerations).
Required Qualifications
- 10+ years of experience in data engineering / data platform development
- 3+ years in a lead or architect role
- Strong programming expertise in Python
- Hands-on experience with:
- PySpark / Spark
- SQL & data modeling
- Workflow orchestration (Airflow, Prefect)
- Experience in wealth management / asset management / financial services
- Strong understanding of:
- Investment data models
- Market data & financial instruments
- Experience with cloud-native data platforms (AWS)
Preferred Qualifications
- Experience with Snowflake / Databricks
- Knowledge of machine learning pipelines
- Familiarity with data governance tools (Collibra, Alation)
- Exposure to real-time streaming (Kafka, Kinesis)
- Certifications in AWS or Data Engineering
Key Skills
- Python (Advanced)
- Data Architecture & Modeling
- Financial / Wealth Management Domain
- Cloud Data Engineering (AWS)
- Leadership & Stakeholder Management
- ETL / ELT Pipelines
- Big Data Technologies
What Success Looks Like
- Scalable, high-performance data pipelines supporting critical investment workflows
- High data quality, governance, and compliance adherence
- Strong collaboration across business and technology teams
- Mentored and high-performing data engineering team
Why Join Us
- Work on mission-critical financial data platforms
- High visibility with business and executive stakeholders
- Opportunity to shape next-gen data architecture in wealth management
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say