Visual mismatch negativity indicates automatic, task-independent detection of artistic image composition in abstract artworks

In complex abstract art, image composition (i.e., the artist's deliberate arrangement of pictorial elements) is an important aesthetic feature. We investigated whether the human brain detects image composition in abstract artworks automatically (i.e., independently of the experimental task). To this aim, we studied whether a group of 20 original artworks elicited a visual mismatch negativity when contrasted with a group of 20 images that were composed of the same pictorial elements as the originals, but in shuffled arrangements, which destroy artistic composition. We used a passive oddball paradigm with parallel electroencephalogram recordings to investigate the detection of image type-specific properties. We observed significant deviant-standard differences for the shuffled and original images, respectively. Furthermore, for both types of images, differences in amplitudes correlated with the behavioral ratings of the images. In conclusion, we show that the human brain can detect composition-related image properties in visual artworks in an automatic fashion.

[1]  Johan Wagemans,et al.  The gist of beauty: An investigation of aesthetic perception in rapidly presented images , 2017, HVEI.

[2]  Anne S. Hsu,et al.  Who art thou? Personality predictors of artistic preferences in a large UK sample: the importance of openness. , 2009, British journal of psychology.

[3]  R. Arnheim.  Art and visual perception: A psychology of the creative eye, New version , 1955 .

[4]  Gregor U. Hayn-Leichsenring,et al.  Evaluating Abstract Art: Relation between Term Usage, Subjective Ratings, Image Properties and Personality Traits , 2016, Front. Psychol..

[5]  Wassily Kandinsky,et al.  Über das Geistige in der Kunst : insbesondere in der Malerei , 1912 .

[6]  D. Berlyne,et al.  The perception of collative properties in visual stimuli. , 1979, Scandinavian journal of psychology.

[7]  J. Wagemans,et al.  All is beautiful? Generality vs. specificity of word usage in visual aesthetics. , 2012, Acta psychologica.

[8]  Gerald C. Cupchik,et al.  Interest and Pleasure as Dimensions of Aesthetic Response , 1990 .

[9]  Florian Hönig.  Defining Computational Aesthetics , 2005, CAe.

[10]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions: new evidence from the equiprobable paradigm , 2012, Behavioral and Brain Functions.

[11]  Jan R. Landwehr,et al.  A Dual-Process Perspective on Fluency-Based Aesthetics , 2015, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[12]  C. Redies,et al.  Statistical regularities in art: Relations with visual coding and perception , 2010, Vision Research.

[13]  Christina M. Krause,et al.  Early and Late Mismatch Negativity Elicited by Words and Speech-Like Stimuli in Children , 2001, Brain and Language.

[14]  T. Jacobsen.  Individual and group modelling of aesthetic judgment strategies. , 2004, British journal of psychology.

[15]  István Czigler,et al.  Visual mismatch negativity is sensitive to symmetry as a perceptual category , 2013, The European journal of neuroscience.

[16]  G. Stefanics,et al.  Visual mismatch negativity: a predictive coding view , 2014, Front. Hum. Neurosci..

[17]  István Czigler,et al.  One plus one is less than two: Visual features elicit non-additive mismatch-related brain activity , 2011, Brain Research.

[18]  H. Leder,et al.  In the white cube: museum context enhances the valuation and memory of art. , 2015, Acta psychologica.

[19]  S. Chaiken,et al.  The Automatic Evaluation of Novel Stimuli , 2002, Psychological science.

[20]  G. Stefanics,et al.  Visual Mismatch Negativity Reveals Automatic Detection of Sequential Regularity Violation , 2011, Front. Hum. Neurosci..

[21]  I. Czigler.  Visual mismatch negativity: Violation of nonattended environmental regularities , 2007 .

[22]  C. Escera,et al.  Differential deviant probability effects on two hierarchical levels of the auditory novelty system , 2016, Biological Psychology.

[23]  Ben R. Newell,et al.  Fractals: A Resonance between Art and Nature , 2005 .

[24]  István Czigler,et al.  Processing of unattended facial emotions: A visual mismatch negativity study , 2012, NeuroImage.

[25]  Nelson Goodman,et al.  Languages of Art, an Approach to a Theory of Symbols , 1970 .

[26]  Joachim Denzler,et al.  PHOG analysis of self-similarity in aesthetic images , 2012, Electronic Imaging.

[27]  A. Chatterjee,et al.  The Assessment of Preference for Balance: Introducing a New Test , 2005 .

[28]  K Overbeeke,et al.  An empirical evaluation of the visual rightness theory of pictorial composition. , 1999, Acta psychologica.

[29]  Kazimir Severinovich Malevich.  Die gegenstandslose Welt , 1927 .

[30]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[31]  C. Redies,et al.  A universal model of esthetic perception based on the sensory coding of natural stimuli. , 2007, Spatial vision.

[32]  M. Kimura.  Visual mismatch negativity and unintentional temporal-context-based prediction in vision. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[34]  Erich Schröger,et al.  Visual mismatch negativity: new evidence from the equiprobable paradigm. , 2009, Psychophysiology.

[35]  Anselm Brachmann,et al.  Computational and Experimental Approaches to Visual Aesthetics , 2017, Front. Comput. Neurosci..

[36]  Gitte Lindgaard,et al.  Attention web designers: You have 50 milliseconds to make a good first impression! , 2006, Behav. Inf. Technol..

[37]  V. Gallese,et al.  ERP Modulation during Observation of Abstract Paintings by Franz Kline , 2013, PloS one.

[38]  C. Redies,et al.  Combining universal beauty and cultural context in a unifying model of visual aesthetic experience , 2015, Front. Hum. Neurosci..

[39]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[40]  Slobodan Markovic,et al.  Aesthetic experience and the emotional content of paintings , 2010 .

[41]  István Czigler,et al.  Is it a face of a woman or a man? Visual mismatch negativity is sensitive to gender category , 2013, Front. Hum. Neurosci..

[42]  Risto Näätänen,et al.  vMMN for schematic faces: automatic detection of change in emotional expression , 2013, Front. Hum. Neurosci..

[43]  Jean Paul,et al.  Vorschule der Ästhetik , 1990 .

[44]  Joachim Denzler,et al.  PHOG-Derived Aesthetic Measures Applied to Color Photographs of Artworks, Natural Scenes and Objects , 2012, ECCV Workshops.

[45]  S. Marković,et al.  Automatic processes in aesthetic judgment: Insights from the Implicit Association Test , 2012 .

[46]  I. Czigler,et al.  Automatic detection of orientation variance , 2017, Neuroscience Letters.

[47]  H. Leder,et al.  Ten years of a model of aesthetic appreciation and aesthetic judgments : The aesthetic episode - Developments and challenges in empirical aesthetics. , 2014, British journal of psychology.

[48]  Pablo P. L. Tinio,et al.  Do You See What I See? : An Investigation of the Aesthetic Experience in the Laboratory and Museum , 2017 .

[49]  I. Mcmanus,et al.  The Aesthetics of Composition: A Study of Mondrian , 1993 .

[50]  Ana Radonjić,et al.  Implicit and explicit features of paintings. , 2008, Spatial vision.

[51]  Nicolas J. Bullot,et al.  The artful mind meets art history: Toward a psycho-historical framework for the science of art appreciation , 2013, Behavioral and Brain Sciences.

[52]  Pieter Jan Stappers,et al.  Spatial Balance of Color Triads in the Abstract Art of Piet Mondrian , 2005, Perception.

[53]  Joachim Denzler,et al.  Statistical image properties of print advertisements, visual artworks and images of architecture , 2013, Front. Psychol..

[54]  Dominique Morlet,et al.  MMN and Novelty P3 in Coma and Other Altered States of Consciousness: A Review , 2013, Brain Topography.

[55]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[56]  Clement Greenberg,et al.  American-Type Painting , 2013 .

[57]  Adrian Furnham,et al.  Personality and judgements of abstract, pop art, and representational paintings , 2001 .

[58]  Cheuk Yee Pang,et al.  Electrophysiological correlates of looking at paintings and its association with art expertise , 2013, Biological Psychology.

[59]  Erich Schröger,et al.  The Primacy of Beauty in Judging the Aesthetics of Objects , 2004, Psychological reports.

[60]  Bevil R. Conway,et al.  Neuroaesthetics and the Trouble with Beauty , 2013, PLoS biology.

[61]  C. Redies,et al.  Beauty in abstract paintings: perceptual contrast and statistical properties , 2014, Front. Hum. Neurosci..

[62]  I. Czigler,et al.  Automatic change detection in vision: Adaptation, memory mismatch, or both? II: Oddball and adaptation effects on event-related potentials , 2017, Attention, perception & psychophysics.

[63]  Thomas Jacobsen,et al.  Electrophysiological indices of processing aesthetics: Spontaneous or intentional processes? , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[64]  Claudia Mello-Thoms,et al.  Visual interest in pictorial art during an aesthetic experience. , 2007, Spatial vision.

[65]  Joachim Denzler,et al.  Fractal-like image statistics in visual art: similarity to natural scenes. , 2007, Spatial vision.

[66]  H. Leder,et al.  What makes an art expert? Emotion and evaluation in art appreciation , 2014, Cognition & emotion.

[67]  A. Danto.  The transfiguration of the commonplace : a philosophy of art , 1982 .

[68]  Oshin Vartanian,et al.  Neuroaesthetics , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[69]  C. Redies,et al.  Changes of Statistical Properties During the Creation of Graphic Artworks , 2015 .

[70]  T. Jacobsen,et al.  Descriptive and evaluative judgment processes: Behavioral and electrophysiological indices of processing symmetry and aesthetics , 2003, Cognitive, affective & behavioral neuroscience.

[71]  H. J. Eysenck,et al.  A New Visual Aesthetic Sensitivity Test: I. Construction and Psychometric Properties , 1979 .

[72]  G. Kovács,et al.  Does surprise enhancement or repetition suppression explain visual mismatch negativity? , 2016, The European journal of neuroscience.

[73]  J. Wagemans,et al.  Beauty in the blink of an eye: The time course of aesthetic experiences , 2018, British journal of psychology.