Windfall

Lead Data Engineer

San Francisco, CA Denver, CO
USD 120k - 200k
GCP Java Python Kotlin PostgreSQL Cassandra Spark Machine Learning
Description
Windfall is seeking a Lead Data Engineer to join our core data team. As a Lead Data Engineer on our core data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use.

We’re on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Make a difference every day; and (5) Act with integrity and trust.

Responsibilities:

  • Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
  • Work closely with our data science team to run ML models on top of billions of data points
  • Build supporting data services and applications to orchestrate and monitor our data systems

Some technology you will use:

  • Cloud platform - GCP
  • Programming languages - Java, Python, and Kotlin
  • Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra
  • Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
  • Orchestration - Airflow

Requirements:

  • 8+ years of professional data engineering experience
  • Significant experience working with Apache Beam/Spark/Flink or MapReduce
  • Strong Object-oriented programming ability
  • Expert knowledge of distributed data processing
  • Familiarity with different datastores, their differences, and appropriate usages
  • Experience at a sub-200 person company
  • You communicate as well as you code
  • You can simplify complex problems into simple solutions
  • You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
  • You are comfortable making trade-offs between quality, complexity, and speed-of-delivery

Preferred Qualifications:

  • Previous experience in a player-coach role
  • Proven experience taking a large project from ideation to production
  • Experience leading greenfield projects
  • Working knowledge of cloud-native data engineering infrastructure
Additional Information:
The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site.

California: Salary range is $140k - $200k
Colorado: Salary range is $120k - $200k

About Windfall
Windfall is a people intelligence and AI company that gives go-to-market teams actionable insights. By democratizing access to people data, organizations can intelligently prioritize go-to-market resources to drive greater business outcomes. Powered by best-in-class machine learning and propensity modeling, Windfall activates insights into workflows that engage the right people for each respective organization. More than 850 data-driven organizations use Windfall to power their business.

We comply with CCPA. For more information on how we comply, review our privacy notice.
Windfall
Windfall
Analytics Computer Financial Services Software

0 applies

53 views

Other Jobs from Windfall

Sr. Backend Engineer

San Francisco, CA Denver, CO

Backend Engineer

San Francisco, CA Denver, CO

Principal Data Scientist - Foundational Models

San Francisco, CA Remote Hybrid

Sr. Data Engineer

Denver, CO San Francisco, CA

Data Analyst

San Francisco, CA

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say