Perceptual evaluation of sound-producing objects

The experimental study of sonic interactions can elucidate one of the most important aspects of the design process: "How should the sonic interaction be structured to produce a target perceptual result or to induce a specic motor behavior of the user?" Very similar questions are the object of basic research on the human processing of sensory events (e.g., "What is the perceptual effect of this sound stimulus?"), and have spurred the development of a large number of experimental methods. This chapter is meant as an introductory guide to the behavioral methods for the experimental study of complex sound events and sonic interactions.

[1]  Moonja P. Kim,et al.  The Method of Sorting as a Data-Gathering Procedure in Multivariate Research. , 1975, Multivariate behavioral research.

[2]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .

[3]  Jin Yong Jeon,et al.  Sound radiation and sound quality characteristics of refrigerator noise in real living environments , 2007 .

[4]  Terri L. Bonebright.  An investigation of data collection methods for auditory stimuli: Paired comparisons versus a computer sorting task , 1996 .

[5]  L. Wedin,et al.  Dimension analysis of the perception of instrumental timbre. , 1972, Scandinavian journal of psychology.

[6]  Stephen McAdams,et al.  Influences of Large-Scale Form on Continuous Ratings in Response to a Contemporary Piece in a Live Concert Setting , 2004 .

[7]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[8]  A. Friberg,et al.  Visual Perception of Expressiveness in Musicians' Body Movements , 2007 .

[9]  Marcelo M. Wanderley,et al.  Recognition, Analysis and Performance with Expressive Conducting Gestures , 2004, ICMC.

[10]  Alexander Refsum Jensenius,et al.  Action-sound : developing methods and tools to study music-related body movement , 2007 .

[11]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[12]  Edward C. Carterette,et al.  Verbal Attributes of Simultaneous Wind Instrument Timbres: I. von Bismarck's Adjectives , 1993 .

[13]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[14]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[15]  Jürgen Hellbrück.  Memory effects in loudness scaling of traffic noise. How overall loudness of short-term and long-term sounds depends on memory. , 2000 .

[16]  Charles S. Watson,et al.  The perceptual dimensionality of environmental sounds , 2003 .

[17]  F. Gregory Ashby,et al.  Multidimensional Models of Perception and Cognition , 2014 .

[18]  Thomas Hempel,et al.  Evaluation of interior car sound with a new specific semantic differential design , 1999 .

[19]  J. Douglas Carroll,et al.  Psychometric Methods in Marketing Research: Part I, Conjoint Analysis , 1995 .

[20]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[21]  A. Lehmann,et al.  Tracking Performance Correlates of Changes in Perceived Intensity of Emotion During Different Interpretations of a Chopin Piano Prelude , 2001 .

[22]  B. Treutwein.  Adaptive psychophysical procedures , 1995, Vision Research.

[23]  Robert J. Logan,et al.  Perception of acoustic source characteristics: walking sounds. , 1991, The Journal of the Acoustical Society of America.

[24]  Marcelo M. Wanderley,et al.  Visualization of Bowing Gestures for Feedback : The Hodgson Plot , 2007 .

[25]  Xavier Rodet,et al.  Characterizing the sound quality of air-conditioning noise , 2004 .

[26]  R. Lutfi,et al.  Correlational analysis of acoustic cues for the discrimination of auditory motion. , 1996, The Journal of the Acoustical Society of America.

[27]  Forrest W. Young,et al.  Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling features , 1977 .

[28]  J. C. Schelleng,et al.  The bowed string and the player , 1973 .

[29]  Seiichiro Namba,et al.  Temporal change of timbre of helicopter noise , 1990 .

[30]  M. Grassi.  Do we hear size or sound? Balls dropped on plates , 2005, Perception & psychophysics.

[31]  W. Todd Maddox,et al.  Perceptual and decisional separability. , 1992 .

[32]  Stephen McAdams,et al.  Loudness asymmetries for tones with increasing and decreasing levels using continuous and global ratings , 2005 .

[33]  Roberto Bresin,et al.  Measurement and reproduction accuracy of computer-controlled grand pianos. , 2003, The Journal of the Acoustical Society of America.

[34]  R. Jacobs.  What determines visual cue reliability? , 2002, Trends in Cognitive Sciences.

[35]  Etienne Parizet,et al.  Continuous evaluation of noise uncomfort in a bus , 2003 .

[36]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[37]  D J Willshaw,et al.  An evaluation of the use of multidimensional scaling for understanding brain connectivity. , 1995, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  Valery Nosulenko,et al.  Approche systémique de l'analyse des verbalisations dans le cadre de l'étude des processus perceptifs et cognitifs , 1997 .

[39]  R. Bisping,et al.  Car interior sound quality : experimental analysis by synthesis , 1997 .

[40]  Georg v. Békésy,et al.  A New Audiometer , 1947 .

[41]  R. Lutfi,et al.  Auditory discrimination of material changes in a struck-clamped bar. , 1997, The Journal of the Acoustical Society of America.

[42]  Stephen McAdams,et al.  The psychomechanics of simulated sound sources: material properties of impacted thin plates. , 2010, The Journal of the Acoustical Society of America.

[43]  Stephen McAdams,et al.  Multisensory integration in percussion performance , 2010 .

[44]  Ching-Ju Liu,et al.  Individual differences in source identification from synthesized impact sounds. , 2006, The Journal of the Acoustical Society of America.

[45]  Patrick Susini,et al.  The Timbre Toolbox: extracting audio descriptors from musical signals. , 2011, The Journal of the Acoustical Society of America.

[46]  S. S. Stevens.  The direct estimation of sensory magnitudes-loudness. , 1956, The American journal of psychology.

[47]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[48]  M. Hansen,et al.  Continuous assessment of time-varying speech quality. , 1999, The Journal of the Acoustical Society of America.

[49]  Erwin Schoonderwaldt,et al.  Extraction of bowing parameters from violin performance combining motion capture and sensors. , 2009, The Journal of the Acoustical Society of America.

[50]  Michel Wedel,et al.  The effects of alternative methods of collecting similarity data for Multidimensional Scaling , 1995 .

[51]  S. McAdams,et al.  Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones. , 2005, The Journal of the Acoustical Society of America.

[52]  On the loudness of road traffic noise of longer duration (20 min.) in relation to instantaneous judgment , 1978 .

[53]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[54]  Miguelina Guirao,et al.  Loudness, reciprocality, and partition scales. , 1962 .

[55]  Ulf Böckenholt,et al.  Scaling of Preferential Choice , 2005 .

[56]  Davide Rocchesso,et al.  Integration of acoustical information in the perception of impacted sound sources: the role of information accuracy and exploitability. , 2010, Journal of experimental psychology. Human perception and performance.

[57]  Brian Gygi,et al.  Spectral-temporal factors in the identification of environmental sounds. , 2004, The Journal of the Acoustical Society of America.

[58]  Sofia Dahl,et al.  Playing the accent : comparing striking velocity and timing in an ostinato rhythm performed by four drummers , 2004 .

[59]  B. Repp.  The sound of two hands clapping: an exploratory study. , 1987, The Journal of the Acoustical Society of America.

[60]  Stephen McAdams,et al.  Comparison of Methods for Collecting and Modeling Dissimilarity Data: Applications to Complex Sound Stimuli , 2011, Multivariate behavioral research.

[61]  Ralph Katz,et al.  Alternative Multidimensional Scaling Methods for Large Stimulus Sets , 1971 .

[62]  S. Lederman.  Auditory Texture Perception , 1979, Perception.

[63]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[64]  Stephen McAdams,et al.  Hearing living symbols and nonliving icons: Category specificities in the cognitive processing of environmental sounds , 2010, Brain and Cognition.

[65]  Harry T. Lawless,et al.  Multidimensional scaling of sorting data applied to cheese perception , 1995 .

[66]  Vincent Hayward,et al.  Identification of walked-upon materials in auditory, kinesthetic, haptic, and audio-haptic conditions. , 2012, The Journal of the Acoustical Society of America.

[67]  P. E. Doak,et al.  A subjective rating scale for timbre , 1976 .

[68]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[69]  Sung-Hwan Shin,et al.  Experimental design and assessment of product sound quality: application to a vacuum cleaner , 2003 .

[70]  Charles Spence,et al.  The role of auditory cues in modulating the perceived crispness and staleness of potato chips , 2004 .

[71]  Brian Gygi,et al.  Similarity and categorization of environmental sounds , 2007, Perception & psychophysics.

[72]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[73]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[74]  Roberto Bresin,et al.  Sound Design for Affective Interaction , 2007, ACII.

[75]  Brian Gygi,et al.  General functions and specific applications of environmental sound research. , 2007, Frontiers in bioscience : a journal and virtual library.

[76]  Catherine Guastavino,et al.  Categorization of environmental sounds. , 2007, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[77]  J. Jenkins,et al.  Identifying the sources of environmental sounds with a varying number of spectral channels , 2003 .

[78]  R. Pastore,et al.  Auditory event perception: The source—perception loop for posture in human gait , 2008, Perception & psychophysics.

[79]  P. Green,et al.  Conjoint Analysis in Consumer Research: Issues and Outlook , 1978 .

[80]  D. Freed,et al.  Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. , 1990, The Journal of the Acoustical Society of America.

[81]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[82]  W H Warren,et al.  Auditory perception of breaking and bouncing events: a case study in ecological acoustics. , 1984, Journal of experimental psychology. Human perception and performance.

[83]  Midori Kitagawa,et al.  MoCap for Artists: Workflow and Techniques for Motion Capture , 2008 .

[84]  F. Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[85]  Stephen McAdams,et al.  Perceiving Musical Individuality: Performer Identification is Dependent on Performer Expertise and Expressiveness, but Not on Listener Expertise , 2011, Perception.

[86]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[87]  Anne Faure.  Des sons aux mots, comment parle-t-on du timbre musical ? , 2000 .

[88]  C. Osgood.  The nature and measurement of meaning. , 1952, Psychological bulletin.

[89]  Seiichiro Namba,et al.  Assessment of musical performance by using the method of continuous judgment by selected description , 1991 .

[90]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[91]  D. W. Robinson,et al.  A re-determination of the equal-loudness relations for pure tones , 1956 .

[92]  N. Chouard,et al.  A semantic differential design especially developed for the evaluation of interior car sounds , 1999 .

[93]  R A Lutfi,et al.  Auditory detection of hollowness. , 2001, The Journal of the Acoustical Society of America.

[94]  Emery Schubert,et al.  Continuous Self-Report Methods , 1993 .

[95]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[96]  Editors-in-chief,et al.  Encyclopedia of statistics in behavioral science , 2005 .

[97]  M. García-Pérez,et al.  Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties , 1998, Vision Research.

[98]  Stephen McAdams,et al.  The sound quality of car horns: A psychoacoustical study of timbre , 2007 .

[99]  L. N. Solomon.  Semantic Approach to the Perception of Complex Sounds , 1958 .

[100]  Hugo Fastl,et al.  Average loudness of road traffic noise , 1989 .

[101]  M. Marcell,et al.  Confrontation Naming of Environmental Sounds , 2000, Journal of clinical and experimental neuropsychology.

[102]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[103]  Sébastien Poitrenaud,et al.  The PROCOPE semantic network: an alternative to action grammars , 1995, Int. J. Hum. Comput. Stud..

[104]  Stephen McAdams,et al.  Environmental Sound Perception: Metadescription and Modeling Based on Independent Primary Studies , 2010, EURASIP J. Audio Speech Music. Process..

[105]  S. Kuwano,et al.  Continuous judgment of level-fluctuating sounds and the relationship between overall loudness and instantaneous loudness , 1985, Psychological research.

[106]  S. Winsberg,et al.  A multidimentional technique for sound quality assessment , 1999 .

[107]  J. Hellbrueck,et al.  Evaluating sequences of environmental noise using the method of absolute judgment in laboratory and outdoor situations. Some methodological considerations , 1999 .

[108]  Bruno L. Giordano,et al.  Material identification of real impact sounds: effects of size variation in steel, glass, wood, and plexiglass plates. , 2006, The Journal of the Acoustical Society of America.

[109]  Stephen McAdams,et al.  Global and Continuous Loudness Estimation of Time-Varying Levels , 2002 .

[110]  Susan J. Lederman,et al.  Multisensory Texture Perception , 2010 .

[111]  Anthony Peter Macmillan Coxon,et al.  Sorting Data: Collection and Analysis , 1999 .

[112]  Vithala R. Rao,et al.  Conjoint Measurement- for Quantifying Judgmental Data , 1971 .

[113]  I. Howard,et al.  Human Spatial Orientation , 1966 .

[114]  J. Ballas.  Common factors in the identification of an assortment of brief everyday sounds , 1993 .

[115]  Carol L. Krumhansl,et al.  Topic in Music: An Empirical Study of Memorability, Openness, and Emotion in Mozart's String Quintet in C Major and Beethoven's String Quartet in A Minor , 1998 .

[116]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[117]  Wolfgang Ellermeier,et al.  Scaling the Unpleasantness of Sounds According to the BTL Model: Ratio-Scale Representation and Psychoacoustical Analysis , 2004 .

[118]  L. Thurstone.  A law of comparative judgment. , 1994 .

[119]  C. Coombs.  A theory of data. , 1965, Psychology Review.

[120]  Roddy Cowie,et al.  FEELTRACE: an instrument for recording perceived emotion in real time , 2000 .