Searching for an image conveying connotative meanings: An exploratory cross-cultural study

On the basis of the semiotics premise, this exploratory study examined cultural influences that pertain to the image search process when users have connotative needs. The study used the Semantic Differential, a quantitative tool for measuring affective reactions, as well as word-based analysis, to analyze responses to a survey questionnaire administered to twelve Korean and twelve American students. The results demonstrated that even when completing the same task, participants from different backgrounds have different tendencies in expecting and selecting a relevant image. The results supported the semiotics assertion that cultural context results in variations in interpreting the connotative messages of an image, and these variations are restricted by cultural boundaries. The study underlined the potential of using the Semantic Differential to enhance accessibility to connotative messages during the image retrieval process. Based on the findings, some suggestions for image retrieval system design were discussed. This study will broaden understanding of connotative messages in terms of image retrieval and user behaviors. The conclusions will contribute to designing a practical image retrieval system that can provide subject access to connotative messages.

[1]  Brian C. O'Connor.  Explorations in Indexing and Abstracting: Pointing, Virtue, and Power , 1996 .

[2]  Brian C. O'Connor,et al.  Modelling what users see when they look at images: a cognitive viewpoint , 2002, J. Documentation.

[3]  K. Markey.  Access to iconographic research collections , 1988 .

[4]  Corinne Jörgensen.  Image Retrieval: Theory and Research , 2003 .

[5]  Edie M. Rasmussen,et al.  Searching for images: The analysis of users' queries for image retrieval in American history , 2003, J. Assoc. Inf. Sci. Technol..

[6]  Sara Shatford Layne.  Some issues in the indexing of images , 1994 .

[7]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[8]  Sara Shatford,et al.  Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[9]  JungWon Yoon.  Improving Recall of Browsing Sets in Image Retrieval from a Semiotics Perspective , 2006 .

[10]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[11]  R. Barthes,et al.  Image-Music-Text , 1977 .

[12]  Karen Markey.  Access to Iconographical Research Collections. , 1988 .

[13]  Umberto Eco,et al.  A theory of semiotics , 1976, Advances in semiotics.

[14]  June Abbas,et al.  User Reactions as Access Mechanism: An Exploration Based on Captions for Images , 1999, J. Am. Soc. Inf. Sci..

[15]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[16]  James M. Turner.  Comparing User-Assigned Terms with Indexer-Assigned Terms for Storage and Retrieval of Moving Images: Research Results. , 1995 .

[17]  Jonathon S. Hare,et al.  Semantic facets: an in-depth analysis of a semantic image retrieval system , 2007, CIVR '07.

[18]  Karen Collins.  Providing subject access to images : A study of user queries , 2009 .

[19]  Robert E. Innis,et al.  Semiotics: An Introductory Anthology , 1985 .

[20]  J. Deręgowski.  Pictorial perception: individual and group differences within the human species , 1999 .

[21]  Raya Fidel,et al.  The image retrieval task: implications for the design and evaluation of image databases , 1997, New Rev. Hypermedia Multim..

[22]  Hugh Griffin,et al.  The democratic indexing of images , 1996, New Rev. Hypermedia Multim..

[23]  Hsin-Liang Chen.  An analysis of image queries in the field of art history , 2001 .

[24]  M. Krause.  Intellectual problems of indexing picture collections , 1988 .

[25]  Corinne Jörgensen.  Image attributes: an investigation , 1995 .

[26]  Karen Markey.  Subject access to visual resources collections: a model for computer construction of thematic catalogs , 1986 .