Image retrieval: Research and use in the information explosion

We surveyed the current research on the retrieval and utilization of images. This paper provides an overview of the difficulties and possibilities of technological or technology-related research topics resulting from the huge amount of images currently available and highlights some of the important research topics. We looked at the ongoing research activities and analyzed them from four aspects, information access and organization technology, the computing infrastructure that enables access to large-scale image resources, issues in human-system interaction and human factors related to using images, and the social aspect of image media. On the technical side, we noticed that as the number of digital images increases, so does the importance of the accuracy and scalability in relation to the image retrieval. The accuracy and scalability are in fact needed to cope with the current explosion in digital images. On the social side, not so long ago, image retrieval technologies were only experimental tools or used by experts within a limited domain. However, now the general public has access to a wide range of digital images, which means that image retrieval technologies are being used by various users in a large diversity of social contexts. Thus, as we show in this paper, the accuracy and scalability are not the only important factors in the era of information explosion, but that researchers must also be concerned with the social aspects of these technologies.

[1]  Shin'ichi Satoh,et al.  Examination and enhancement of a ring-structured graphical search interface based on usability testing , 2005, SIGIR '05.

[2]  Thierry Pun,et al.  The Truth about Corel - Evaluation in Image Retrieval , 2002, CIVR.

[3]  Masashi Inoue.  Difficulties in Image Retrieval , 2008, Contextual and Social Media Understanding and Usage.

[4]  John J. Leggett,et al.  Collection understanding , 2004, JCDL.

[5]  Pankoo Kim,et al.  An Efficient Retrieval of Annotated Images based on WordNet , 2007, The 9th International Conference on Advanced Communication Technology.

[6]  Daniel Gatica-Perez,et al.  Analyzing Flickr groups , 2008, CIVR '08.

[7]  Paul Clough,et al.  Creating a test collection to evaluate diversity in image retrieval , 2008, SIGIR 2008.

[8]  Biljana Scott,et al.  PICTURING IRONY: the subversive power of photography , 2011 .

[9]  Naonori Ueda,et al.  Retrieving lightly annotated images using image similarities , 2005, SAC '05.

[10]  Marin Ferecatu,et al.  Semantic interactive image retrieval combining visual and conceptual content description , 2007, Multimedia Systems.

[11]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[12]  Trevor Darrell,et al.  Photo-based question answering , 2008, ACM Multimedia.

[13]  ShneidermanBen,et al.  Find that photo , 2006 .

[14]  Anton Nijholt,et al.  Questions, pictures, answers : Introducing pictures in question-answering systems , 2007 .

[15]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Paul Clough,et al.  The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems , 2006 .

[17]  Tetsuya Ishikawa,et al.  Image Retrieval and Disambiguation for Encyclopedic Web Search , 2005, IJCAI.

[18]  Andreas Henrich,et al.  Retrieval of technical drawings in DXF format - concepts and problems , 2007, LWA.

[19]  Joo-Hwee Lim,et al.  Latent semantic fusion model for image retrieval and annotation , 2007, CIKM '07.

[20]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[21]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[22]  Bronwen Brown.  Introduction to Art Image Access: Issues, Tools, Standards, Strategies , 2003 .

[23]  Peter G. B. Enser,et al.  The evolution of visual information retrieval , 2008, J. Inf. Sci..

[24]  Eero Sormunen,et al.  End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive , 2004, Information Retrieval.

[25]  Keiji Yanai,et al.  Image region entropy: a measure of "visualness" of web images associated with one concept , 2005, MULTIMEDIA '05.

[26]  Kai Song,et al.  Diversifying the image retrieval results , 2006, MM '06.

[27]  Paul D. Clough,et al.  Multilingual interactive experiments with Flickr , 2006 .

[28]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[29]  Daisuke Okabe.  Social practice of Camera Phone in Japan , 2005 .

[30]  Nuno Vasconcelos,et al.  From Pixels to Semantic Spaces: Advances in Content-Based Image Retrieval , 2007, Computer.

[31]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[32]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[34]  Wolfgang Müller,et al.  Fast retrieval of high-dimensional feature vectors in P2P networks using compact peer data summaries , 2003, MIR '03.

[35]  Masashi Inoue.  On the need for annotation-based image retrieval , 2004 .

[36]  A. Stamps.  Entropy, Visual Diversity, and Preference , 2002, The Journal of general psychology.

[37]  Biljana Scott,et al.  Picturing irony: The subversive power of photography1 , 2004 .

[38]  Abigail Sellen,et al.  Understanding photowork , 2006, CHI.

[39]  Masashi Inoue.  Mining Visual Knowledge for Multi-Lingual Image Retrieval , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[40]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[41]  N. R. Howe,et al.  Using artificial queries to evaluate image retrieval , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[42]  Jonathon S. Hare,et al.  Facing the reality of semantic image retrieval , 2007, J. Documentation.

[43]  Raya Fidel,et al.  Challenges in Indexing Electronic Text and Images , 1994 .

[44]  Jennifer Marlow,et al.  Flickr: a first look at user behaviour in the context of photography as serious leisure , 2008, Inf. Res..

[45]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[46]  Bernard J. Jansen.  Searching for digital images on the web , 2008, J. Documentation.

[47]  Svetha Venkatesh,et al.  Sensing and using social context , 2008, TOMCCAP.

[48]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[49]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[50]  Samantha Kelly Hastings,et al.  Query Categories in a Study of Intellectual Access to Digitized Art Images. , 1995 .

[51]  Fabio Ciravegna,et al.  Exploring multimedia in a keyword space , 2008, ACM Multimedia.

[52]  Ben Shneiderman,et al.  Find that photo! , 2006, Commun. ACM.

[53]  Thierry Pun,et al.  A Framework for Benchmarking in CBIR , 2003, Multimedia Tools and Applications.

[54]  Toyoaki Nishida,et al.  Photochat: communication support system based on sharing photos and notes , 2008, CHI Extended Abstracts.

[55]  Patrick Baudisch,et al.  Time quilt: scaling up zoomable photo browsers for large, unstructured photo collections , 2005, CHI EA '05.

[56]  Edie M. Rasmussen,et al.  Searching for images: The analysis of users' queries for image retrieval in American history , 2003, J. Assoc. Inf. Sci. Technol..