Senior Data Engineer

The Community You Will Join:

We are currently hiring for the following teams: 

Marketing Technology: Our mission is to provide a state-of-the-art platform and measurement capabilities to enable marketing and product teams to engage with our customers effectively. Everyday millions of Airbnb customers are reached via our streamlined platform over comprehensive channels, such as Email, Push, SMS, and external Ads Platforms (e.g., Google, Facebook, etc). We deliver substantial business impact by enabling numerous stakeholders across the company, including Marketing (Brand and Performance), Guest/Host, Policy, and more.

Payments: We are building a world-class payments platform — one that currently supports 190+ countries and regions, 70+ currencies, connects dozens of payment providers and banks, and processes multiple billions of dollars.  As the platform grows, we’ll be adding new payment partners, global licenses, and building new payment experiences for our guests and hosts.  The Payments team builds a scalable foundation to support global scale, helps the company grow by bringing new markets and demographics to the platform, and enables new business initiatives to thrive by providing easy to use payment services.

Marketplaces & Intelligence Data & AI: The team provides rich, high-quality data assets to power insights that enable Airbnb and our hosts to be competitive in our marketplaces. The team is composed of Engineers specializing in Data, Analytics, Backend and Machine Learning, and we work closely with a wide range of teams across the company, including Data Science, Strategic Finance, and Sales Operations, and Product Engineering in order to see our work through to business impact.

The Difference You Will Make:

Marketing Technology: Our data engineering team provides a state-of-the-art platform with measurement capabilities to enable marketing and product teams to engage with our customers effectively. Everyday millions of Airbnb customers are reached over comprehensive channels, such as Email, Push, SMS, and external Ads Platforms (e.g., Google, Facebook, etc). As the data team, we establish a solid data foundation that serves as the backbone of our marketing channels and enables us to make informed strategic decisions by providing a comprehensive measurement framework. By collaborating with cross-functional teams, you will have the opportunity to drive significant business impact.

Payments: As Airbnb expands its presence, it faces a host of unique challenges: managing this large volume of data, deriving information and insights from it, using it to make informed business decisions, and creating data-powered products. We also want to ensure that our financial data has high fidelity, is available in a timely fashion, is comprehensive, is organized in a way that is easy to understand, and is easily discoverable. This problem is more relevant today, as our entire payments infrastructure is undergoing a major overhaul, with systems being redesigned in a service-oriented architecture.

Marketplaces & Intelligence Data & AI: You will work in a team of engineers with diverse expertise to build foundational data sets that power insights for the company and our host community. You will play an end-to-end role in scoping new functionality, aligning with stakeholders on technical requirements, and implementation of these features.

A Typical Day:

• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.

• Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.

• Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework

• Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.

• Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity

• Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues

Your Expertise:

• 5-9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD

• Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)

• Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions

• Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks

• Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)

• Excellent written and verbal communication skills

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. Airbnb, Inc. can employ in states where we have registered entities. Currently, employees can not be located in: Alaska, Indiana, Nebraska, North Dakota, Ohio, South Dakota, Wisconsin, Alabama, Mississippi, Oklahoma, Delaware or Rhode Island. As this list is continuously evolving and being updated, please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the best and brightest people from the broadest talent pool possible. We believe a diversity of ideas foster innovation and engagement, allow us to attract the best people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply. If you need assistance or a reasonable accommodation during the application and recruiting process, please contact us at: reasonableaccommodations@airbnb.com.