On Spark, Hive, and Small Files: An In-Depth Look at Spark Partitioning Strategies

Author: Zachary Ennenga Airbnb’s new office building, 650 Townsend Background At Airbnb, our offline data processing ecosystem contains many mission-critical, time-sensitive jobs — it is essential for us to maximize the stability and efficiency of our data pipeline infrastructure. So, when a few months back, we encountered a recurring issue that caused significant outages of our data…

Continuing Our Support of Lottie Open Source Community

After years of working with open source contributors to create new features, fix bugs, and maintain the issue…

A Deep Dive into Airbnb’s Server-Driven UI System

By Ryan Brooks Background: Server-Driven UI Before we dive into Airbnb’s implementation of server-driven UI (SDUI), it’s important to understand the general idea of SDUI and how it provides an advantage over traditional client-driven…

Introducing AloeStackView for iOS

Some of the ~200 screens in the Airbnb iOS app built using AloeStackView. At Airbnb, we’re always looking for ways to improve the efficiency of building products. Over the past few years, our mobile development efforts have increased at a dramatic rate. In the past year alone, we’ve added more than 260 screens to our iOS app. At the same time, more and…

Introducing Epoxy for iOS

Epoxy’s story on iOS began in 2016. Swift was still a very new language, and we had recently started to broadly adopt it across our codebase. With the new language, we were still experimenting with how to best build UI. …

Introducing MvRx: Android on Autopilot

Havana Vieja, a great place to hang out at Airbnb HQ when you want to… At Airbnb, we are moving at a faster pace than ever. Each year, more and more people are using Airbnb to travel. This year alone, we have already launched Airbnb Plus and we have countless other projects underway that we can’t wait to share. On the Android side of things…

Contextualizing Airbnb by Building Knowledge Graph

By Xiaoya Wei and Yizheng Liao A riverfront, all-bamboo house on Airbnb in Bali. Imagine you are planning a trip to Los Angeles. The first step is to visit Airbnb.com and search for “Los Angeles.” On the backend, the query “Los Angeles” is translated into a block on the map; available Homes within this block are returned in…

Supercharging Apache Superset

By: Erik Ritter, Grace Guo, Jesse Yang, John Bodley, and Zuzana Vejrazkova Introduction At Airbnb, many employees rely on data every day to do their jobs. While several different tools are used for analysis, at the core of Airbnb’s self-serve business intelligence (BI) solution is Apache Superset™ (“Superset”). Superset is…

React Native at Airbnb: The Technology

This is the second in a series of blog posts in which we outline our experience with React Native and what is next for mobile at Airbnb. React Native itself is a relatively new and fast-moving platform in the cross-section of Android, iOS, web, and cross-platform frameworks. After two years…

Learning Market Dynamics for Optimal Pricing

How do you think market dynamics influences this beautiful home in Cape Town? Market dynamics plays a key role in matching guests with hosts in two-sided marketplaces such as Airbnb. Supply and demand vary drastically across different locations, different check in dates and different lead times until check-in. It is important for us to understand and forecast these spatial and temporal trends in…

How We Enable Airbnb Team Members to Code Like a Mobile Engineer

Intro As part of the TechEd team, our team’s goal is to enable our technical talent through continuous learning programs. One of the most common programs we work on is new employee onboarding for Engineering and Data Science teams. However…

Amenity Detection and Beyond — New Frontiers of Computer Vision at Airbnb

Authors: Shijing Yao, Dapeng Li, Shawn Chen What amenities are there in this image? Can an algorithm detect them all? How can we train the algorithm effectively? If you are interested in the answers, please read on! Introduction In 2018, we published a blog post titled Categorizing Listing Photos at Airbnb…

Scaling Knowledge Access and Retrieval at Airbnb

Cherry blossoms in full bloom in Tokyo Imagine you’re finally getting to take that vacation you’ve dreamed of — three countries, seven cities, thousands of miles. It’s everything you could want and more, right? But where do you start? How do you know what to eat, where to visit, how to experience what makes your destination truly…

Contextual Calendar Reminders

By Tao Cui and Yuting Gu Airbnb’s mission is to create a world where anyone can belong anywhere. So when hosts forget to update their calendars and are booked by guests on dates that don’t work, the host has to cancel the reservation. This definitely does not make the guests…

Listing Embeddings in Search Ranking

By Mihajlo Grbovic, Haibin Cheng, Qing Zhang, Lynn Yang, Phillippe Siclait and Matt Jones Airbnb’s marketplace contains millions of diverse listings which potential guests explore through search results generated from a sophisticated Machine Learning model that uses more than hundred signals to decide how to rank a particular listing…

Sunsetting React Native

This is the fourth in a series of blog posts in which we outline our experience with React Native and what is next for mobile at Airbnb.Where are we today? Although many teams relied on React Native and had planned on using it for the foreseeable future, we were ultimately…

Building Services at Airbnb, Part 4

By Junjie Guan, Rui Dai and Xing An Intro In Part 1, Part 2, and Part 3 of our Building Services at Airbnb series, we shared how…

Building Services at Airbnb, Part 2

By Liang Guo and Frank Lin Vittoria is treating his guests to a tour of the Limoncello factory, where family makes… Airbnb is moving its infrastructure towards SOA. A reliable, performant, and developer-friendly service platform is essential in an architectural evolution. In a previous post, we shared a bird’s-eye view of what we have designed and built to scale the development of services and gave…

Better Android Testing at Airbnb

A seven part series on Android Test Frameworks we’ve built at Airbnb — this first part looks at our philosophy on testing, and the mocking system that lays the foundation for all our tests. Automated testing for Android development has historically been challenging at Airbnb, due to both technical and…

Inside Connect: Airbnb’s Engineering Apprenticeship Program

by Beti Gathegi & Jacqui Watts Hello! We’re excited that you’re here to learn more about the Connect program. Before we share details, though, we’d like to introduce ourselves. We’re Beti Gathegi and Jacqui Watts — a team of two whose purpose at Airbnb is to help bring this program…

The Smart Instant Book Filter

By Yi Hou, Li Fan & Tao Cui People like it when things are fast. We want our deliveries within an hour, our downloads within a minute, and our news in an instant. That is why we need to help our Airbnb community to book listings they want instantly. Instant…

Building a Cross-Platform Mobile Team

This is the third in a series of blog posts in which we outline our experience with React Native and what is next for mobile at Airbnb. In addition to the countless technical pros and cons of React Native, we learned a ton about what React Native means for an…

Moving Lottie Swiftly into the Future

Come and join us in working on Swift development in our gorgeous office! Lottie is a library for Android, iOS, Web, and Windows that parses Adobe After Effects animations exported as JSON with Bodymovin and renders them natively on mobile and on the web. If you haven’t already read Brandon’s post about the Swift rewrite of Lottie on iOS, check it out! We’d…

Better Android Testing at Airbnb

Interaction Testing Part two of this series covered our screenshot testing approach. As our first integration tests, screenshots filled a gaping hole in our testing strategy and were immediately…

Measuring Transactional Integrity in Airbnb’s Distributed Payment Ecosystem

By Ninad Khisti and William Betz In a distributed payment ecosystem, it is critical to accurately measure and track a transaction’s end to end state and contents to ensure consistency throughout the payment cycle. Without robust tracking, data leakage and errors can occur, resulting in either lost revenue or increased…