Plaid

Experienced Data Engineer - Data Engineering Technical Leader

San Francisco, CA Remote Hybrid
USD 204k - 360k
Spark Kafka SQL Python Go
Description
Data Engineering is a cornerstone of Plaid's data-focused vision, playing a pivotal role in fostering a data-driven culture and advancing our vision of delivering trustworthy, truly differentiated data products powered by the largest network of user financial profiles. To support our data-focused vision, we need to scale our data systems while maintaining correct and complete data. We provide golden datasets and tooling to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. In addition, Plaid will not be successful if we can't move quickly. We build the data systems and tools that enable everyone at Plaid to be data-driven, making analytics easy, obvious, and proactive across the company.

Data Engineers heavily leverage SQL and Python to build data workflows that integrate with our Golang applications. We use tools like DBT, Airflow, Redshift, Atlan, and Retool to orchestrate data pipelines and define workflows. We work with data scientists, product analytics, business intelligence, software engineers, product managers, and many other teams to build Plaid's data strategy and a data-first mindset. Our engineering culture is IC-driven -- we favor bottom-up ideation and empowerment of our incredibly talented team. We are looking for engineers and technical leaders who are motivated by creating impact for our consumers and customers, growing together as a team, shipping the MVP, and leaving things better than we found them.

Drive Data Standards and Culture @ Plaid: You will play a high-impact role in defining and promoting data standards and fostering a strong data-driven culture across Plaid.
Deliver and Scale Golden Datasets: You will own the creation and future iterations of Golden Datasets for all major Plaid data models, driving their adoption across key data use cases to empower teams with reliable and actionable insights
Shape Unified Data Architecture: You will collaborate with other data practitioners and leaders to design a unified data architecture and conventions, making data at Plaid more accessible and intuitive. You’ll also enhance data exploration tools to enable efficient and effective usage of data across the organization.
Mentor and Build Technical Excellence: You will mentor junior engineers on the team, providing guidance on designs and implementations. You’ll play a key role in fostering a strong technical culture, empowering the team to deliver high-quality, scalable solutions.

Responsibilities

  • Serving as the primary technical DRI, defining and executing the long-term technical roadmap to build and sustain a data-driven culture at Plaid.
  • Working closely with senior leadership and executives to shape Plaid’s data engineering strategy and roadmap, ensuring alignment with the company’s data-focused product goals and overall vision.
  • Deep understanding of Plaid's products and strategy in order to inform the design of Golden Datasets, set data usage principles, and ensure data is structured for maximum impact and usability.
  • Focus on delivering well-documented datasets with clearly defined quality metrics, uptime guarantees, and demonstrable usefulness.
  • Leading critical data engineering projects that foster collaboration across teams, driving innovation and efficiency throughout the company.
  • Mentoring engineers, operations, and data practitioners on best practices for data organization.
  • Advocating for the adoption of emerging industry tools and practices, evaluating their fit and implementing them at the right time to keep Plaid at the forefront of data engineering.
  • Owning core SQL and Python data pipelines that power our data lake and data warehouse, ensuring their reliability, scalability, and efficiency.
  • Upholding Plaid’s commitment to data quality and privacy, embedding these principles into every aspect of data work.

Qualifications

  • 10+ years of experience in data engineering, with a proven track record of building scalable data systems and pipelines.
  • Experience working with massive datasets (500TB to petabytes) and developing robust data models and pipelines on top of them
  • Lead major data modeling, schema design, and data architecture efforts in past roles
  • Deep appreciation for schema design and the ability to evolve analytics schemas on top of unstructured data.
  • Advanced knowledge of SQL as a flexible, extensible tool and experience with modern orchestration tools like DBT, Mode, and Airflow.
  • Hands-on experience with performant data warehouses and lakes such as Redshift, Snowflake, and Databricks.
  • Building and maintaining both batch and real-time pipelines using technologies like Spark and Kafka.
  • Excited about exploring new technologies and building proof-of-concepts that balance technical innovation with user experience and adoption.
  • Enjoy getting into the technical details to manage, deploy, and optimize low-level data infrastructure.
  • Champion for data privacy and integrity, and always act in the best interest of consumers.
Plaid
Plaid
Finance Financial Services FinTech

0 applies

8 views

Similar Jobs

Data Engineer Team Lead

Tel Aviv, Israel

Senior Engineer II

Bengaluru, India Remote Hybrid

Data Engineer (L09)

Remote Hyderabad, India

Machine Learning Engineer I

Remote Beaverton, OR

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say