Faceted exploration of image search results

This paper describes MediaFaces, a system that enables faceted exploration of media collections. The system processes semi-structured information sources to extract objects and facets, e.g. the relationships between two objects. Next, we rank the facets based on a statistical analysis of image search query logs, and the tagging behaviour of users annotating photos in Flickr. For a given object of interest, we can then retrieve the top-k most relevant facets and present them to the user. The system is currently deployed in production by Yahoo!'s image search engine1. We present the system architecture, its main components, and the application of the system as part of the image search experience.

[1]  Jonathon S. Hare,et al.  Semantic facets: an in-depth analysis of a semantic image retrieval system , 2007, CIVR '07.

[2]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[3]  Berthier A. Ribeiro-Neto,et al.  Concept-based interactive query expansion , 2005, CIKM '05.

[4]  Sreenivas Gollapudi,et al.  Diversifying search results , 2009, WSDM '09.

[5]  Kilian Q. Weinberger,et al.  Resolving tag ambiguity , 2008, ACM Multimedia.

[6]  Stefan Rüger,et al.  NNk networks and automated annotation for browsing large image collections from the world wide web , 2006, MM '06.

[7]  W. Bruce Croft,et al.  Analysis of long queries in a large scale search log , 2009, WSCD '09.

[8]  Marti A. Hearst.  Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[9]  Reiner Kraft,et al.  Mining anchor text for query refinement , 2004, WWW '04.

[10]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[11]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[12]  Roelof van Zwol,et al.  Diversifying image search with user generated content , 2008, MIR '08.

[13]  Daniel Heesch,et al.  A survey of browsing models for content based image retrieval , 2008, Multimedia Tools and Applications.

[14]  Gregory Scott,et al.  Idea navigation: structured browsing for unstructured text , 2008, CHI.

[15]  Kristian J. Hammond,et al.  Knowledge-Based Navigation of Complex Information Spaces , 1996, AAAI/IAAI, Vol. 1.

[16]  Gary Marchionini,et al.  Evaluation and evolution of a browse and search interface: relation browser , 2005, DG.O.

[17]  Peter G. Anick,et al.  The paraphrase search assistant: terminological feedback for iterative information seeking , 1999, SIGIR '99.

[18]  Gary Marchionini,et al.  Effects of structure and interaction style on distinct search tasks , 2007, JCDL '07.

[19]  Hideo Joho,et al.  Hierarchical presentation of expansion terms , 2002, SAC '02.

[20]  Ximena Olivares,et al.  Visual diversification of image search results , 2009, WWW '09.