Why Do People Buy Seemingly Irrelevant Items in Voice Product Search?: On the Relation between Product Relevance and Customer Satisfaction in eCommerce

One emerging benefit of voice assistants is to facilitate product search experience, allowing users to express orally which products they seek, and taking actions on retrieved results such as adding them to their cart or sending the product details to their mobile phone for further examination. Looking at users' behavior in product search, supported by a digital voice assistant, we have observed an interesting phenomenon where users purchase or engage with search results that are objectively judged irrelevant to their queries. In this work, we analyze and characterize this phenomenon. We provide several hypotheses as to the reasons behind it, including users' personalized preferences, the product's popularity, the product's indirect relation with the query, the user's tolerance level, the query intent, and the product price. We address each hypothesis by conducting thorough data analyses and offer some insights with respect to users' purchase and engagement behavior with seemingly irrelevant results. We conclude with a discussion on how this analysis can be used to improve voice product search services.

[1]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[2]  Beibei Li,et al.  Towards a theory model for product search , 2011, WWW.

[3]  Nemanja Djuric,et al.  E-commerce in Your Inbox: Product Recommendations at Scale , 2015, KDD.

[4]  Ido Guy,et al.  Searching by Talking: Analysis of Voice Queries on Mobile Web Search , 2016, SIGIR.

[5]  Huan Liu,et al.  Turning Clicks into Purchases: Revenue Optimization for Product Search in E-Commerce , 2018, SIGIR.

[6]  M. de Rijke,et al.  Mix 'n Match: Integrating Text Matching and Product Substitutability within Product Search , 2018, CIKM.

[7]  W. Bruce Croft,et al.  Learning a Hierarchical Embedding Model for Personalized Product Search , 2017, SIGIR.

[8]  José Luis Vicedo González,et al.  TREC: Experiment and evaluation in information retrieval , 2007, J. Assoc. Inf. Sci. Technol..

[9]  Ellen M. Voorhees,et al.  TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing) , 2005 .

[10]  Shubhra Kanti Karmaker Santu,et al.  On Application of Learning to Rank for E-Commerce Search , 2017, SIGIR.

[11]  Mohit Sharma,et al.  A Taxonomy of Queries for E-commerce Search , 2018, SIGIR.

[12]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[13]  Yiqun Liu,et al.  User Intent, Behaviour, and Perceived Satisfaction in Product Search , 2018, WSDM.

[14]  Jiang Bian,et al.  Enhancing product search by best-selling prediction in e-commerce , 2012, CIKM.

[15]  Jun Zhao,et al.  End-to-End Neural Ranking for eCommerce Product Search: an Application of Task Models and Textual Embeddings , 2018, eCOM@SIGIR.

[16]  Mohan S. Kankanhalli,et al.  Attentive Long Short-Term Preference Modeling for Personalized Product Search , 2018, ACM Trans. Inf. Syst..

[17]  Qiang Wu,et al.  Adapting boosting for information retrieval measures , 2010, Information Retrieval.

[18]  Christos Faloutsos,et al.  Did We Get It Right? Predicting Query Performance in e-Commerce Search , 2018, eCOM@SIGIR.

[19]  Prasant Mohapatra,et al.  Towards Optimization of e-Commerce Search and Discovery , 2018, eCOM@SIGIR.

[20]  Maksims Volkovs,et al.  Learning to rank with multiple objective functions , 2011, WWW.

[21]  Yi Sun,et al.  Multi-objective Relevance Ranking , 2019, eCOM@SIGIR.

[22]  Omar Alonso,et al.  Relevance criteria for e-commerce: a crowdsourcing-based experimental analysis , 2009, SIGIR.