Learning to Ask: Question-based Sequential Bayesian Product Search

Product search is generally recognized as the first and foremost stage of online shopping and thus significant for users and retailers of e-commerce. Most of the traditional retrieval methods use some similarity functions to match the user's query and the document that describes a product, either directly or in a latent vector space. However, user queries are often too general to capture the minute details of the specific product that a user is looking for. In this paper, we propose a novel interactive method to effectively locate the best matching product. The method is based on the assumption that there is a set of candidate questions for each product to be asked. In this work, we instantiate this candidate set by making the hypothesis that products can be discriminated by the entities that appear in the documents associated with them. We propose a Question-based Sequential Bayesian Product Search method, QSBPS, which directly queries users on the expected presence of entities in the relevant product documents. The method learns the product relevance as well as the reward of the potential questions to be asked to the user by being trained on the search history and purchase behavior of a specific user together with that of other users. The experimental results show that the proposed method can greatly improve the performance of product search compared to the state-of-the-art baselines.

[1]  Paolo Ferragina,et al.  TAGME: on-the-fly annotation of short text fragments (by wikipedia entities) , 2010, CIKM.

[2]  Ling Xu,et al.  Automated Duplicate Bug Report Detection Using Multi-Factor Analysis , 2016, IEICE Trans. Inf. Syst..

[3]  Ling Xu,et al.  Towards comprehending the non-functional requirements through Developers' eyes: An exploration of Stack Overflow using topic analysis , 2017, Inf. Softw. Technol..

[4]  Maura R. Grossman,et al.  Autonomy and Reliability of Continuous Active Learning for Technology-Assisted Review , 2015, ArXiv.

[5]  Mohan S. Kankanhalli,et al.  Attentive Long Short-Term Preference Modeling for Personalized Product Search , 2018, ACM Trans. Inf. Syst..

[6]  Tie-Yan Liu,et al.  Word-Entity Duet Representations for Document Ranking , 2017, SIGIR.

[7]  ChengXiang Zhai,et al.  A probabilistic mixture model for mining and analyzing product search log , 2013, CIKM.

[8]  Katja Hofmann,et al.  Information Retrieval manuscript No. (will be inserted by the editor) Balancing Exploration and Exploitation in Listwise and Pairwise Online Learning to Rank for Information Retrieval , 2022 .

[9]  James P. Callan,et al.  EsdRank: Connecting Query and Documents through External Semi-Structured Data , 2015, CIKM.

[10]  Flavius Frasincar,et al.  Faceted product search powered by the Semantic Web , 2012, Decis. Support Syst..

[11]  Evangelos Kanoulas,et al.  Technology Assisted Reviews: Finding the Last Few Relevant Documents by Asking Yes/No Questions to Reviewers , 2018, SIGIR.

[12]  W. Bruce Croft,et al.  Joint Modeling and Optimization of Search and Recommendation , 2018, DESIRES.

[13]  Zheng Wen,et al.  Sequential Bayesian Search , 2013, ICML.

[14]  Maura R. Grossman,et al.  Evaluation of machine-learning protocols for technology-assisted review in electronic discovery , 2014, SIGIR.

[15]  Mohan S. Kankanhalli,et al.  Multi-modal Preference Modeling for Product Search , 2018, ACM Multimedia.

[16]  M. de Rijke,et al.  Learning Latent Vector Spaces for Product Search , 2016, CIKM.

[17]  ChengXiang Zhai,et al.  Adaptive relevance feedback in information retrieval , 2009, CIKM.

[18]  Yue Wang,et al.  Learning-to-Ask: Knowledge Acquisition via 20 Questions , 2018, KDD.

[19]  W. B. Lee,et al.  Multi-facet product information search and retrieval using semantically annotated product family ontology , 2010, Inf. Process. Manag..

[20]  Xu Chen,et al.  Towards Conversational Search and Recommendation: System Ask, User Respond , 2018, CIKM.

[21]  Oren Kurland,et al.  Document Retrieval Using Entity-Based Language Models , 2016, SIGIR.

[22]  Uzay Kaymak,et al.  Facet selection algorithms for web product search , 2013, CIKM.

[23]  ChengXiang Zhai,et al.  Supporting Keyword Search in Product Database: A Probabilistic Approach , 2013, Proc. VLDB Endow..

[24]  W. Bruce Croft,et al.  Learning a Hierarchical Embedding Model for Personalized Product Search , 2017, SIGIR.

[25]  J. Rowley Product search in e‐shopping: a review and research propositions , 2000 .

[26]  Jure Leskovec,et al.  Inferring Networks of Substitutable and Complementary Products , 2015, KDD.

[27]  Yi Zhang,et al.  Conversational Recommender System , 2018, SIGIR.

[28]  Mitesh M. Khapra,et al.  Generating Natural Language Question-Answer Pairs from a Knowledge Graph Using a RNN Based Question Generation Model , 2017, EACL.

[29]  R. Nowak,et al.  Generalized binary search , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[30]  Ling Xu,et al.  Duplication Detection for Software Bug Reports based on Topic Model , 2016, 2016 9th International Conference on Service Science (ICSS).

[31]  Ricardo Campos,et al.  A Text Feature Based Automatic Keyword Extraction Method for Single Documents , 2018, ECIR.

[32]  Huang Hu,et al.  Playing 20 Question Game with Policy-Based Reinforcement Learning , 2018, EMNLP.