Perceptual and emotional categorization of sound.

This paper investigates how different types of data from psychoacoustical experiments may be combined to render further knowledge about the mechanisms underlying sound perception. Two studies were conducted with auditory alerts of short duration. First, an experiment where participants rated the dissimilarity among the auditory alerts was performed. This resulted in a two-dimensional multi-dimensional scaling solution. Second, an experiment where participants evaluated the stimuli with semantic descriptors and rated their emotional reactions to the sounds was performed. The output of this experiment was a reduced set of underlying perceptual and emotional dimensions. The results of the two experiments were then integrated by the use of multi-dimensional perceptual unfolding and a set mediation analyses. The integrative analyses showed that part of the cognitive categorization of the semantic descriptors was mediated by the emotional reactions to the sounds. The results are discussed in relation to theories of auditory perception and emotional response categorization.

[1]  J. Carroll,et al.  How separate are the sensory, emotional, and motivational dimensions of pain? A multidimensional scaling analysis. , 2001, Somatosensory & motor research.

[2]  David P. MacKinnon,et al.  Current Directions in Mediation Analysis , 2009, Current directions in psychological science.

[3]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[4]  Tommy Gärling,et al.  The measurement of core affect: a Swedish self-report measure derived from the affect circumplex. , 2002, Scandinavian journal of psychology.

[5]  R. Patterson.  Auditory warning sounds in the work environment. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  R Plomp,et al.  Beats of mistuned consonances. , 1967, The Journal of the Acoustical Society of America.

[7]  L. Nygaard,et al.  Communicating emotion: linking affective prosody and word meaning. , 2008, Journal of experimental psychology. Human perception and performance.

[8]  E C Haas,et al.  Perceived urgency of and response time to multi-tone and frequency-modulated warning signals in broadband noise. , 1995, Ergonomics.

[9]  S. McAdams,et al.  Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones. , 2005, The Journal of the Acoustical Society of America.

[10]  Åse Innes-Ker,et al.  Emotional response categorization. , 1999 .

[11]  G. Thierry,et al.  Event-related potential study of attention capture by affective sounds , 2007, Neuroreport.

[12]  R Graham,et al.  Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application. , 1999, Ergonomics.

[13]  Paul Kline,et al.  An easy guide to factor analysis , 1993 .

[14]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[15]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[16]  Peter Keller,et al.  Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. , 2004, Journal of experimental psychology. Applied.

[17]  Tommy Gärling,et al.  Validation of a Swedish short self-report measure of core affect. , 2007, Scandinavian journal of psychology.

[18]  E. Carterette,et al.  Perceptual space for musical structures. , 1974, The Journal of the Acoustical Society of America.

[19]  P. Shrout,et al.  Mediation in experimental and nonexperimental studies: new procedures and recommendations. , 2002, Psychological methods.

[21]  J Edworthy,et al.  Improving Auditory Warning Design: Relationship between Warning Sound Parameters and Perceived Urgency , 1991, Human factors.

[22]  William L. Martens,et al.  Multidimensional Perceptual Unfolding of Spatially Processed Speech I: Deriving Stimulus Space Using INDSCAL , 2000 .

[23]  Anders Sköld.  Integrative Analyses of Perception and Reaction to Information and Warning Sounds in Vehicles , 2008 .

[24]  Gregory Ashby,et al.  On the Dangers of Averaging Across Subjects When Using Multidimensional Scaling or the Similarity-Choice Model , 1994 .

[25]  J. Ballas.  Common factors in the identification of an assortment of brief everyday sounds. , 1993, Journal of experimental psychology. Human perception and performance.

[26]  William M. Smith,et al.  A Study of Thinking , 1956 .

[27]  John G. Neuhoff,et al.  Perceptual bias for rising tones , 1998, Nature.

[28]  W H Warren,et al.  Auditory perception of breaking and bouncing events: a case study in ecological acoustics. , 1984, Journal of experimental psychology. Human perception and performance.

[29]  Brian Gygi,et al.  Similarity and categorization of environmental sounds , 2007, Perception & psychophysics.

[30]  M. Cabanac.  Pleasure: the common currency. , 1992, Journal of theoretical biology.

[31]  R. K. Reddy,et al.  Categorization of environmental sounds , 2009, Biological Cybernetics.

[32]  P. Niedenthal,et al.  Emotional state and the use of stimulus dimensions in judgment. , 1997, Journal of personality and social psychology.

[33]  D. Dubois.  Categories as Acts of Meaning: The Case of Categories in Olfaction and Audition , 1999 .

[34]  B. Repp,et al.  Action Can Affect Auditory Perception , 2007, Psychological science.

[35]  C. Judd,et al.  When moderation is mediated and mediation is moderated. , 2005, Journal of personality and social psychology.

[36]  I. Pollack,et al.  The Information of Elementary Multidimensional Auditory Displays , 1954 .

[37]  J. R. Comstock,et al.  A psychophysiological evaluation of the perceived urgency of auditory warning signals. , 1995, Ergonomics.

[38]  Neville A. Stanton,et al.  Warnings in research and practice , 1995 .

[39]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[40]  L. F. Barrett.  Discrete Emotions or Dimensions? The Role of Valence Focus and Arousal Focus , 1998 .

[41]  William W. Gaver.  Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[42]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[43]  Christian Schmid,et al.  A Matlab function to estimate choice model parameters from paired-comparison data , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[44]  K. Scherer.  Appraisal considered as a process of multilevel sequential checking. , 2001 .

[45]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[46]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[47]  Leo A. Aroian,et al.  The probability function of the product of two normally distributed variables. , 1947 .

[48]  Anders Genell.  Perception of Sound and Vibration in Heavy Trucks , 2008 .

[49]  Vincent Rioux.  Sound Quality of Flue Organ Pipe. An Interdisciplinary Study on the Art of Voicing , 2001 .