Clustering-Based Navigation of Image Search Results on Mobile Devices

With the Internet information explosion as well as the rapid increasing of mobile users, web image search and browsing on mobile devices will become a big application in foreseeable future. Since mobile devices generally suffer from limited resources, like small screen factor and interaction facilities, etc, the interface provided by current image search engine is not suitable for search results navigation on mobile devices. In this paper, we propose a new method to increase user's experience on search results browsing and navigation. By clustering result images based on visual and semantic cues, user can catch the overview of the search results with only a few clicks; by using an optimal layout algorithm, the summary of each cluster can be presented on small screen with maximum scaling ratio; by employing the smart thumbnail of the presentation image, more information can be shown to users on limited screen. The navigation operations are designed to make the new interface easy to learn and simple to use. Experiment results demonstrate the effectiveness of the new presentation method.

[1]  Ed H. Chi,et al.  Using information scent to model user information needs and actions and the Web , 2001, CHI.

[2]  Mingjing Li,et al.  Automated annotation of human faces in family albums , 2003, MULTIMEDIA '03.

[3]  Xing Xie,et al.  Attention model based progressive image transmission , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[4]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[5]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[6]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[7]  Andreas Girgensohn,et al.  Stained-glass visualization for highly condensed video summaries , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[8]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[9]  Aya Soffer,et al.  PicASHOW: pictorial authority search by hyperlinks on the Web , 2001, WWW '01.

[10]  Mingjing Li,et al.  Color texture moments for content-based image retrieval , 2002, Proceedings. International Conference on Image Processing.

[11]  Konrad Tollmar,et al.  Searching the Web with mobile images for location recognition , 2004, CVPR 2004.

[12]  Wei-Ying Ma,et al.  Data-driven approach for bridging the cognitive gap in image retrieval , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[13]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[14]  H. Intraub,et al.  Boundary Extension for Briefly Glimpsed Photographs: Do Common Perceptual Processes Result in Unexpected Memory Distortions? , 1996 .

[15]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[16]  Wei-Ying Ma,et al.  Grouping web image search result , 2004, MULTIMEDIA '04.

[17]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[18]  Xing Xie,et al.  Effective browsing of web image search results , 2004, MIR '04.

[19]  Wei-Ying Ma,et al.  Learning to cluster web search results , 2004, SIGIR '04.

[20]  Wei-Ying Ma,et al.  Learning To Cluster Search Results , 2004 .

[21]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.