Real-time Personalization using Embeddings for Search Ranking at Airbnb

Search Ranking and Recommendations are fundamental problems of crucial interest to major Internet companies, including web search engines, content publishing websites and marketplaces. However, despite sharing some common characteristics a one-size-fits-all solution does not exist in this space. Given a large difference in content that needs to be ranked, personalized and recommended, each marketplace has a somewhat unique challenge. Correspondingly, at Airbnb, a short-term rental marketplace, search and recommendation problems are quite unique, being a two-sided marketplace in which one needs to optimize for host and guest preferences, in a world where a user rarely consumes the same item twice and one listing can accept only one guest for a certain set of dates. In this paper we describe Listing and User Embedding techniques we developed and deployed for purposes of Real-time Personalization in Search Ranking and Similar Listing Recommendations, two channels that drive 99% of conversions. The embedding models were specifically tailored for Airbnb marketplace, and are able to capture guest's short-term and long-term interests, delivering effective home listing recommendations. We conducted rigorous offline testing of the embedding models, followed by successful online tests before fully deploying them into production.

[1]  Mirella Lapata,et al.  Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics , 1999, ACL 1999.

[2]  Quoc V. Le,et al.  Learning to Rank with Nonsmooth Cost Functions , 2006, NIPS.

[3]  Yoshua Bengio,et al.  Word Representations: A Simple and General Method for Semi-Supervised Learning , 2010, ACL.

[4]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[5]  Jason Weston,et al.  Nonlinear latent factorization by embedding multiple user interests , 2013, RecSys.

[6]  Nemanja Djuric,et al.  Hidden Conditional Random Fields with Distributed User Embeddings for Ad Targeting , 2014 .

[7]  Nemanja Djuric,et al.  Hidden Conditional Random Fields with Deep User Embeddings for Ad Targeting , 2014, 2014 IEEE International Conference on Data Mining.

[8]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[9]  Maciej Kula,et al.  Metadata Embeddings for User and Item Cold-start Recommendations , 2015, CBRecSys@RecSys.

[10]  Fabrizio Silvestri,et al.  Context- and Content-aware Embeddings for Query Rewriting in Sponsored Search , 2015, SIGIR.

[11]  Nemanja Djuric,et al.  Gender and Interest Targeting for Sponsored Post Advertising at Tumblr , 2015, KDD.

[12]  Nemanja Djuric,et al.  E-commerce in Your Inbox: Product Recommendations at Scale , 2015, KDD.

[13]  Hao Wu,et al.  Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content , 2015, WWW.

[14]  Yukihiro Tagami,et al.  Modeling User Activities on the Web using Paragraph Vector , 2015, WWW.

[15]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[16]  Hongbo Deng,et al.  Ranking Relevance in Yahoo Search , 2016, KDD.

[17]  Ricardo Baeza-Yates,et al.  Scalable Semantic Matching of Queries to Ads in Sponsored Search Advertising , 2016, SIGIR.

[18]  Oren Barkan,et al.  ITEM2VEC: Neural item embedding for collaborative filtering , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[19]  Xin Zhang,et al.  Learning Music Embedding with Metadata for Context Aware Recommendation , 2016, ICMR.

[20]  Nemanja Djuric,et al.  Smartphone App Categorization for Interest Targeting in Advertising Marketplace , 2016, WWW.

[21]  Ganesh Venkataraman,et al.  Personalized Job Recommendation System at LinkedIn: Practical Challenges and Lessons Learned , 2017, RecSys.

[22]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[23]  Yizhou Sun,et al.  Embedding for Personalized Content-based Recommendation , 2017 .

[24]  Michèle Sebag,et al.  Language Modelling for Collaborative Filtering: Application to Job Applicant Matching , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[25]  Thomas Nedelec,et al.  Specializing Joint Representations for the task of Product Recommendation , 2017, DLRS@RecSys.

[26]  Thomas Nedelec,et al.  CONTENT2VEC: SPECIALIZING JOINT REPRESENTATIONS OF PRODUCT IMAGES AND TEXT FOR THE TASK OF PRODUCT RECOMMENDATION , 2017 .

[27]  Liangjie Hong,et al.  An Ensemble-based Approach to Click-Through Rate Prediction for Promoted Listings at Etsy , 2017, ADKDD@KDD.

[28]  Jason Weston,et al.  StarSpace: Embed All The Things! , 2017, AAAI.