An Empirical Study on the Role of Perceptual Similarity in Visual Metaphors and Creativity

We investigate the role of perceptual similarity in visual metaphor comprehension process. In visual metaphors, perceptual features of the source and the target are objectively present as images. Moreover, to determine perceptual similarity, we use an image-based search system that computes similarity based on low-level perceptual features. We hypothesize that perceptual similarity at the level of color, shape, texture, orientation, and the like, between the source and the target image facilitates metaphorical comprehension and aids creative interpretation. We present three experiments, two of which are eye-movement studies, to demonstrate that in the interpretation and generation of visual metaphors, perceptual similarity between the two images is recognized at a subconscious level, and facilitates the search for creative conceptual associations in terms of emergent features. We argue that the capacity to recognize perceptual similarity—considered to be a hallmark of creativity—plays a major role in the creative understanding of metaphors.

[1]  J. Faries,et al.  The Effect of Similarity on Memory for Prior Problems , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[2]  R. Gibbs,et al.  Mental Imagery in Interpreting Poetic Metaphor , 1999 .

[3]  J M Kennedy,et al.  Are Metaphors Elliptical Similes? , 2000, Journal of psycholinguistic research.

[4]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[5]  D. Gentner,et al.  Making a silk purse out of two sow's ears: young children's use of comparison in category learning. , 2002, Journal of experimental psychology. General.

[6]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[7]  Bipin Indurkhya,et al.  On the Role of Metaphor in Creative Cognition , 2010, ICCC.

[8]  Mutsumi Imai,et al.  Children's Theories of Word Meaning: The Role of Shape Similarity in Early Acquisition , 1994 .

[9]  H. Gardner,et al.  The comprehension of metaphor in brain-damaged patients. , 1977, Brain : a journal of neurology.

[10]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[11]  Gilles Fauconnier,et al.  Conceptual Projection and Middle Spaces , 2008 .

[12]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[13]  Bipin Indurkhya,et al.  An Empirical Study on the Mechanisms of Creativity in Visual Arts , 2012, CogSci.

[14]  Vikram Pudi,et al.  FISH: a practical system for fast interactive image search in huge databases , 2008, CIVR '08.

[15]  Alfons Maes,et al.  Perceptual and Conceptual Visual Rhetoric: The Case of Symmetric Object Alignment , 2009 .

[16]  J. Kennedy,et al.  What Makes a Metaphor Stronger Than a Simile , 1999 .

[17]  Alan F. Blackwell,et al.  Visual Metaphor , 2009, Encyclopedia of Database Systems.

[18]  G. Gottfried,et al.  Comprehending compounds: evidence for metaphoric skill? , 1997, Journal of Child Language.

[19]  Edward De Bono New think : the use of lateral thinking in the generation of new ideas , 1968 .

[20]  Dedre Gentner,et al.  The effect of language on similarity: The use of relational labels improves young children’s performance in a mapping task , 1998 .

[21]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[22]  S. Kaplan,et al.  A conceptual analysis of form and content in visual metaphors , 1992 .

[23]  P. Marangolo,et al.  Metaphor Comprehension in Right Brain-Damaged Patients with Visuo-Verbal and Verbal Material: A Dissociation (RE)Considered , 2004, Cortex.

[24]  C. Hausman,et al.  Metaphor and art : interactionism and reference in the verbal and nonverbal arts , 1991 .

[25]  G. Corbett,et al.  Colour terms in Russian: reflections of typological constraints in a single language , 1988, Journal of Linguistics.

[26]  B. Indurkhya,et al.  Emergence of Features in Metaphor Comprehension , 2000 .

[27]  John M. Kennedy,et al.  Aptness is more important than comprehensibility in preference for metaphors and similes , 2003 .

[28]  John M Kennedy,et al.  Metaphor in Pictures , 1982, Perception.

[29]  E. Torrance,et al.  The Torrance Tests of Creative Thinking , 2012 .

[30]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[31]  Gianni Rodari,et al.  The grammar of fantasy , 1996 .

[32]  S. Dehaene Reading in the Brain: The New Science of How We Read , 2009 .

[33]  Bipin Indurkhya,et al.  Emergent representations, interaction theory and the cognitive force of metaphor , 2006 .

[34]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[35]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[36]  S. Siltanen Effects of Three Levels of Context on Children's Metaphor Comprehension. , 1989, The Journal of genetic psychology.

[37]  Alfons Maes,et al.  The Role of Shape in Comparing Objects: How Perceptual Similarity May Affect Visual Metaphor Processing , 2011 .

[38]  J. Kennedy,et al.  Literal Bases for Metaphor and Simile , 2001 .

[39]  H. Pollio,et al.  The anomaly of anomaly , 1977, Journal of Psycholinguistic Research.

[40]  J. Mccormack,et al.  Computers and Creativity , 2012, Springer Berlin Heidelberg.

[41]  W. Gordon Synectics: The Development of Creative Capacity , 1961 .

[42]  Dedre Gentner,et al.  Evidence for Relational Selectivity in the Interpretation of Analogy and Metaphor , 1988 .

[43]  John M. Kennedy,et al.  Reversibility, Aptness, and the Conventionality of Metaphors and Similes , 2003 .

[44]  Paul Sambre,et al.  Gilles Fauconnier & Mark Turner, " The way we think: conceptual blending and the mind's hidden complexities" , 2002 .

[45]  W. Brewer,et al.  Comprehension and memory of the literal and figurative meaning of proverbs , 1980 .

[46]  L. Oakes,et al.  By land or by sea: the role of perceptual similarity in infants' categorization of animals. , 1997, Developmental psychology.

[47]  Charles Forceville,et al.  Pictorial Metaphor in Advertising , 1998 .

[48]  Charles Forceville,et al.  Pictorial Metaphor in Advertisements , 1994 .

[49]  Kamran Baig An act of creation , 2003, BMJ : British Medical Journal.

[50]  M. Faust,et al.  Cerebral hemispheric asymmetries in processing lexical metaphorsfn2 fn2 This research was part of the M.A. thesis of the first author at Bar-Ilan University under the supervision of the second author. , 1998, Neuropsychologia.

[51]  Barry Gholson,et al.  Surface similarity and relational similarity in the development of analogical problem solving: Isomorphic and nonisomorphic transfer. , 1994 .

[52]  Donald A. Schön Displacement of Concepts , 1963 .

[53]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[54]  Tomasz Komendziński,et al.  Metaphor and cognition , 2008 .

[55]  Bipin Indurkhya,et al.  Thinking Like A Child: The Role of Surface Similarities in Stimulating Creativity , 2013, AAAI Spring Symposium: Creativity and Cognitive Development.

[56]  Bipin Indurkhya,et al.  Experiments with a Creativity-Support System based on Perceptual Similarity , 2008, SoMeT.

[57]  Alan F. Blackwell,et al.  Metaphor in diagrams , 1998 .

[58]  S. Bres,et al.  Key Points-based Indexing for Pre-attentive Similarities: The KIWI System , 2001, Pattern Analysis & Applications.