EnjoyPhoto: a vertical image search engine for enjoying high-quality photos

In this paper, we propose building a vertical image search engine called EnjoyPhoto that leverages rich metadata from various photo forum web sites to meet users' requirements for enjoying high-quality photos, which is virtually impossible in traditional image search engines. To solve the ranking problem when aggregating multiple photo forums, we propose a novel rank fusion algorithm that uses duplicate photos to normalize rating scores. To further improve user experiences in enjoying photos, we design an in-place image browsing interface, and compare it with several other interfaces in a user study. With rich metadata and rating information, more attractive user interfaces are enabled, including slideshow authoring and photo recommendations. We conducted experiments and user studies on a 2.5-million image database to evaluate the proposed rank fusion algorithm, investigate the rationale behind building a vertical image search engine, and study user interfaces and preferences for the purpose of enjoying high-quality photos. The experimental results demonstrate the effectiveness of the proposed ranking algorithm. The results also show that the 2.5-million high-quality image database in EnjoyPhoto performs comparably with Google's 1- billion image database for queries related to location, nature, and daily life categories. Finally, our results show that the in-place browsing interface-called Force-Transfer view-is much more convenient for users than traditional interfaces.

[1]  Wei-Ying Ma,et al.  Object-level ranking: bringing order to Web objects , 2005, WWW '05.

[2]  Gregory N. Hullender,et al.  Learning to rank using gradient descent , 2005, ICML.

[3]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[4]  G. Clark,et al.  Reference , 2008 .

[5]  Wei-Ying Ma,et al.  Grouping WWW Image Search Results by Novel Inhomogeneous Clustering Method , 2005, 11th International Multimedia Modelling Conference.

[6]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[7]  Stephen E. Robertson,et al.  Okapi at TREC-3 , 1994, TREC.

[8]  Bin Wang,et al.  Large-Scale Duplicate Detection for Web Image Search , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Xiaodi Huang,et al.  Force-Transfer: A New Approach to Removing Overlapping Nodes in Graph Layout , 2003, ACSC.

[10]  Ronald Fagin,et al.  Comparing top k lists , 2003, SODA '03.

[11]  Michael J. Swain,et al.  WebSeer: An Image Search Engine for the World Wide Web , 1996 .

[12]  Xing Xie,et al.  Effective browsing of web image search results , 2004, MIR '04.

[13]  Stephen E. Robertson,et al.  GatfordCentre for Interactive Systems ResearchDepartment of Information , 1996 .

[14]  Andreas E. Savakis,et al.  Evaluation of image appeal in consumer photography , 2000, Electronic Imaging.

[15]  Jingrui He,et al.  Classification of Digital Photos Taken by Photographers or Home Users , 2004, PCM.

[16]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[17]  Yoram Singer,et al.  An Efficient Boosting Algorithm for Combining Preferences by , 2013 .

[18]  Manojit Sarkar,et al.  Graphical fisheye views , 1994, CACM.

[19]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[20]  Stefan Winkler,et al.  Color image quality on the Internet , 2003, IS&T/SPIE Electronic Imaging.

[21]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[22]  Mingjing Li,et al.  iFind: a web image search engine , 2001, SIGIR '01.

[23]  Marco La Cascia,et al.  Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web , 1999, Comput. Vis. Image Underst..