Categorical and specificity differences between user-supplied tags and search query terms for images. An analysis of Flickr tags and Web image search queries

Introduction. The purpose of this study is to compare characteristics and features of user-supplied tags and search query terms for images on the Flickr Website in terms of categories of pictorial meanings and level of term specificity. Method. This study focuses on comparisons between tags and search queries using Shatford's categorization schemes and the level of specificity based on the basic level theory. Analysis. Frequency distributions and chi-squared analyses were performed on the data. The results of statistical analyses demonstrated that there were significant differences in categories among tags and different stages of search query terms. The overall distributions of the levels of term specificity also had similar pattern in both tags and search query terms, but statistically significant differences were found between tags and search query terms. Results. The results of this study demonstrated that Flickr tags have their own unique features compared to users' queries for image searching. The findings suggest that image tags should not be generally applied to other image collections although they have been considered as useful data in developing a user-centered indexing system. Conclusions. When utilizing user-supplied tags for user-centered indexing systems, it is desirable to consider the functions and users' tasks applied in tags rather than depending on statistical features merely obtained from the tag analysis.

[1]  Corinne Jörgensen,et al.  Attributes of Images in Describing Tasks , 1998, Inf. Process. Manag..

[2]  Sethuraman Panchanathan,et al.  Indexing natural images for retrieval based on Kansei factors , 2004, IS&T/SPIE Electronic Imaging.

[3]  Peter G. B. Enser Image Retrieval: Theory and Research , 2004, J. Documentation.

[4]  Marieke Guy,et al.  Folksonomies: Tidying Up Tags? , 2006, D Lib Mag..

[5]  Mor Naaman,et al.  Why do tagging systems work? , 2006, CHI Extended Abstracts.

[6]  Samantha Kelly Hastings,et al.  Query Categories in a Study of Intellectual Access to Digitized Art Images. , 1995 .

[7]  SpinkAmanda,et al.  How are we searching the world wide web , 2006 .

[8]  Amanda Spink,et al.  From E-Sex to E-Commerce: Web Search Changes , 2002, Computer.

[9]  Rebecca Green Vocabulary Alignment via Basic Level Concepts , 2006 .

[10]  Amanda Spink,et al.  Searching for multimedia: analysis of audio, video and image Web queries , 2000, World Wide Web.

[11]  Corinne Jörgensen,et al.  Image Access, the Semantic Gap, and Social Tagging as a Paradigm Shift , 2007 .

[12]  Sara Shatford,et al.  Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[13]  Raya Fidel,et al.  The image retrieval task: implications for the design and evaluation of image databases , 1997, New Rev. Hypermedia Multim..

[14]  Bernardo A. Huberman,et al.  Usage patterns of collaborative tagging systems , 2006, J. Inf. Sci..

[15]  Brian C. O'Connor Explorations in Indexing and Abstracting: Pointing, Virtue, and Power , 1996 .

[16]  Jonathon S. Hare,et al.  Facing the reality of semantic image retrieval , 2007, J. Documentation.

[17]  P. Kay Basic Color Terms: Their Universality and Evolution , 1969 .

[18]  JungWon Yoon,et al.  Towards a user-oriented thesaurus for non-domain-specific image collections , 2009, Inf. Process. Manag..

[19]  Hemalata Iyer,et al.  Theories of cognition and image categorization: What category labels reveal about basic level theory , 2008, J. Assoc. Inf. Sci. Technol..

[20]  P. Schmitz,et al.  Inducing Ontology from Flickr Tags , 2006 .

[21]  Raya Fidel,et al.  User-Centered Indexing , 1994, J. Am. Soc. Inf. Sci..

[22]  P. Jason Morrison,et al.  Tagging and searching: Search retrieval effectiveness of folksonomies on the World Wide Web , 2008, Inf. Process. Manag..

[23]  Bernard J. Jansen,et al.  Coverage, relevance, and ranking: The impact of query operators on Web search engine results , 2003, TOIS.

[24]  Luc Steels,et al.  Integrating Collaborative Tagging and Emergent Semantics for Image Retrieval , 2006 .

[25]  Corinne Jörgensen Classifying Images: Criteria for Grouping as Revealed in a Sorting Task , 1995 .

[26]  Besiki Stvilia,et al.  End-user collection building behavior in Flickr , 2008, ASIST.

[27]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[28]  Jennifer Trant,et al.  Exploring the potential for social tagging and folksonomy in art museums: Proof of concept , 2006, New Rev. Hypermedia Multim..

[29]  Amanda Spink,et al.  Image searching on the Excite Web search engine , 2001, Inf. Process. Manag..

[30]  Karen Collins Providing subject access to images : A study of user queries , 2009 .

[31]  Edie M. Rasmussen,et al.  Searching for images: The analysis of users' queries for image retrieval in American history , 2003, J. Assoc. Inf. Sci. Technol..

[32]  SpinkAmanda,et al.  From E-Sex to E-Commerce , 2002 .

[33]  Antonio C. Siochi,et al.  A State Transition Analysis of Image Search Patterns on the web , 2003, CIVR.

[34]  Megan A. Winget,et al.  USER-DEFINED CLASSIFICATION ON THE ONLINE PHOTO SHARING SITE FLICKR…OR, HOW I LEARNED TO STOP WORRYING AND LOVE THE MILLION TYPING MONKEYS , 2006 .

[35]  Amanda Spink,et al.  How are we searching the World Wide Web? A comparison of nine search engine transaction logs , 2006, Inf. Process. Manag..

[36]  Hsin-Liang Chen,et al.  An analysis of image retrieval tasks in the field of art history , 2001, Inf. Process. Manag..

[37]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[38]  Marcia J. Bates,et al.  Indexing and Access for Digital Libraries and the Internet: Human, Database, and Domain Factors , 1998, J. Am. Soc. Inf. Sci..

[39]  S. Batley Visual information retrieval : browsing strategies in pictorial databases , 1988 .

[40]  Abebe Rorissa,et al.  User-generated descriptions of individual images versus labels of groups of images: A comparison using basic level theory , 2008, Inf. Process. Manag..

[41]  Dagobert Soergel,et al.  Organizing information - principles of data base and retrieval systems , 1985 .

[42]  Bella Hass Weinberg Explorations in indexing and abstracting: Pointing, virtue, and power , 1997 .

[43]  M. Naaman,et al.  Position Paper, Tagging, Taxonomy, Flickr, Article, ToRead , 2006 .

[44]  David Bearman,et al.  Social Terminology Enhancement through Vernacular Engagement: Exploring Collaborative Annotation to Encourage Interaction with Museum Collections , 2005, D Lib Mag..

[45]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[46]  Krystyna K. Matusiak Towards user-centered indexing in digital image collections , 2006, OCLC Syst. Serv..

[47]  Brian C. O'Connor,et al.  Modelling what users see when they look at images: a cognitive viewpoint , 2002, J. Documentation.