Blending Vertical and Web Results - A Case Study Using Video Intent

Modern search engines aggregate results from specialized verticals into the Web search results. We study a setting where vertical and Web results are blended into a single result list, a setting that has not been studied before. We focus on video intent and present a detailed observational study of Yandex's two video content sources i.e., the specialized vertical and a subset of the general web index thus providing insights into their complementary character. By investigating how to blend results from these sources, we contrast traditional federated search and fusion-based approaches with newly proposed approaches that significantly outperform the baseline methods.

[1]  Mounia Lalmas,et al.  Aggregated Search , 2011, Advanced Topics in Information Retrieval.

[2]  Milad Shokouhi,et al.  Federated Search , 2011, Found. Trends Inf. Retr..

[3]  J. Friedman.  Greedy function approximation: A gradient boosting machine. , 2001 .

[4]  Fernando Diaz,et al.  Classification-based resource selection , 2009, CIKM.

[5]  Milad Shokouhi,et al.  LambdaMerge: merging the results of query reformulations , 2011, WSDM '11.

[6]  Andrey Gulin,et al.  Winning The Transfer Learning Track of Yahoo!'s Learning To Rank Challenge with YetiRank , 2010, Yahoo! Learning to Rank Challenge.

[7]  Fernando Diaz,et al.  Sources of evidence for vertical selection , 2009, SIGIR.

[8]  Tapas Kanungo,et al.  On composition of a federated web search result page: using online users to provide pairwise preference for heterogeneous verticals , 2011, WSDM '11.

[9]  Milad Shokouhi,et al.  Robust result merging using sample-based score estimates , 2009, TOIS.

[10]  Susan T. Dumais,et al.  Optimizing search by showing results in context , 2001, CHI.

[11]  Ellen M. Voorhees,et al.  Learning collection fusion strategies , 1995, SIGIR '95.

[12]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[13]  Kui-Lam Kwok,et al.  TREC-3 Ad-Hoc, Routing Retrieval and Thresholding Experiments using PIRCS , 1994, TREC.

[14]  Djoerd Hiemstra,et al.  Learning to merge search results for efficient Distributed Information Retrieval , 2010 .

[15]  Oren Kurland,et al.  Predicting query performance for fusion-based retrieval , 2012, CIKM.

[16]  Jacques Savoy,et al.  Approaches to collection selection and results merging for distributed information retrieval , 2001, CIKM '01.

[17]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[18]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.

[19]  Ingemar J. Cox,et al.  On ranking the effectiveness of searches , 2006, SIGIR.

[20]  W. Bruce Croft,et al.  Searching distributed collections with inference networks , 1995, SIGIR '95.

[21]  Fernando Diaz,et al.  Learning to aggregate vertical results into web search results , 2011, CIKM '11.