Senior Data Engineer

The Community You Will Join:

At Airbnb, we need to ensure every area of the business has trustworthy data to fuel insight and innovation. Understanding the business need, securing the right data sources, designing usable data models, and building robust & dependable data pipelines are essential skills to meet this goal. 

The Difference You Will Make:

We are currently hiring for the following teams:

Community Support Data Platform Team: 

Communication and Connectivity Team: We build systems and tools for stays, experiences, and beyond that support first class rich communications and connections among all members of the Airbnb community. We create scalable and intelligent communication tools, including messaging and notifications. The data team utilizes industry-leading tools, builds scalable data systems and applies AI models to provide insights and support all products in CnC.

Listing & Structure Data, Data and AI team:

The Listing & Structure Data team is composed of ML engineers, data engineers, and analytics engineers who use data and machine learning solutions to uncover valuable insights from listing data. We specialize in understanding listings, transforming unstructured information—such as photos and reviews/messages—into structured, actionable data, and creating foundational datasets. This core data supports various applications, including host tools, product detail page merchandising, and listing quality systems.

ULM - Quality and Merchandising Team:

Airbnb is powered by our Host and Guest communities. Within the central of this community vision, our team is responsible for building world class data driven intelligence platforms that power high quality listings and help host better merchandising them to guests. This includes listing and host level quality signal understanding, generating insights so hosts can take actions when merchandising their listings or authorize quality data for cross org usages etc.

A Typical Day:

• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.

• Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.

• Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework

• Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.

• Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity 

• Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues

Your Expertise:

• 5-9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD

• Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)

• Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions

• Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks

• Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)

• Excellent written and verbal communication skills

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. Airbnb, Inc. can employ in states where we have registered entities. Currently, employees can not be located in: Alaska, Indiana, Nebraska, North Dakota, Ohio, South Dakota, Wisconsin, Alabama, Mississippi, Oklahoma, Delaware or Rhode Island. As this list is continuously evolving and being updated, please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the best and brightest people from the broadest talent pool possible. We believe a diversity of ideas foster innovation and engagement, allow us to attract the best people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply. If you need assistance or a reasonable accommodation during the application and recruiting process, please contact us at: [email protected].