Extracting Meaning from Sound: Nomic Mappings, Everyday Listening, and Perceiving Object Size from Frequency

In developing a theoretical framework for the field of ecological acoustics, Gaver (1993b) distinguished between the experience of musical listening (perceiving sounds) and everyday listening (perceiving sources of sounds). Within the everyday listening experience, Gaver (1993a) proposed that the frequency of an object results from, and therefore specifies, the size of that object. The relation in which frequency and object size stand to one another is an example of a nomic mapping. A symbolic mapping involves the pairing of unrelated dimensions and, relative to a nomic mapping, requires an additional step in recognition and learning. Using a perceptual identification task, an experiment investigated the hypothesis that nomic mappings are identified more easily than symbolic mappings. It was predicted that the advantage manifests only during the everyday listening experience, and that the initially superior recognition of nomic mappings is equaled by symbolic mappings after extended exposure. The results provided support for the hypotheses. Theoretical implications of the differential recognition of nomic and symbolic mappings are discussed, together with practical applications of nomic relations.

[1]  W H Warren,et al.  Auditory perception of breaking and bouncing events: a case study in ecological acoustics. , 1984, Journal of experimental psychology. Human perception and performance.

[2]  M. Breeding,et al.  Object recognition as a function of stimulus characteristics , 1984 .

[3]  J. Jolles,et al.  Learning and retrieval rate of words presented auditorily and visually. , 1985, The Journal of general psychology.

[4]  D. C. Howell Statistical methods for psychology, 3rd ed. , 1992 .

[5]  J. Jacko,et al.  Psychology of Computer Use: XLVI. Age-Related Differences in the Mapping of Auditory Icons to Visual Icons in Computer Interfaces for Children , 1997, Perceptual and motor skills.

[6]  A Ehrenstein,et al.  Pitch and pitch change interact in auditory displays. , 2000, Journal of experimental psychology. Applied.

[7]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[8]  W. R. Garner,et al.  Integrality of stimulus dimensions in various types of information processing , 1970 .

[9]  R. G. Leiser,et al.  Paralanguage and human-computer interaction. Part 2: comprehension of synthesized vocal segregates , 1989 .

[10]  K. J. Vicente,et al.  Evidence for Direct Perception From Cognition in the Wild , 1996 .

[11]  Mark C. Detweiler,et al.  Iconic Reference: Evolving Perspectives and an Organizing Framework , 1993, Int. J. Man Mach. Stud..

[12]  R. Plomp,et al.  The Perception of Musical Tones , 1999 .

[13]  Richard J. Shavelson,et al.  Statistical Reasoning for the Behavioral Sciences , 1980 .

[14]  C. Carello,et al.  Perception of Object Length by Sound , 1998 .

[15]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[16]  William W. Gaver The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[17]  J. Pind The Discovery of Spoken Language, Peter W. Jusczyk (Ed.). MIT Press (1997), ISBN 0 262 10058 4 , 1997 .

[18]  W. Gouvier,et al.  Rey Auditory-Verbal Learning Test: the effects of age and gender, and norms for delayed recall and story recognition trials. , 1992, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[19]  J Edworthy,et al.  A user-centred approach to the design and evaluation of auditory warning signals: 1. Methodology. , 1995, Ergonomics.

[20]  William W. Gaver How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[21]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[22]  Bruce N. Walker,et al.  Psychophysical scaling of sonification mappings , 2000 .

[23]  R. Melara,et al.  Dimensional interaction between color and pitch. , 1989, Journal of experimental psychology. Human perception and performance.

[24]  J. B. Pittenger,et al.  Human Echolocation as a Basic Form of Perception and Action , 1995 .

[25]  Peter Keller,et al.  Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. , 2004, Journal of experimental psychology. Applied.

[26]  J. Ballas Common factors in the identification of an assortment of brief everyday sounds , 1993 .

[27]  Elizabeth D. Mynatt Transforming Graphical Interfaces Into Auditory Interfaces for Blind Users , 1997, Hum. Comput. Interact..

[28]  J. Michell Measurement in psychology: A critical history of a methodological concept. , 1999 .

[29]  L E Marks,et al.  Dimensional interactions in language processing: investigating directions and levels of crosstalk. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[30]  M. Cook,et al.  The Power Law as a Special Case of Fechner's Law , 1967, Perceptual and motor skills.

[31]  R. Greene Stimulus suffix effects in recognition memory , 1988, Memory & cognition.

[32]  William W. Gaver Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[33]  W. Jay Dowling,et al.  Context Effects on Melody Recognition: Scale-Step versus Interval Representations , 1986 .

[34]  J. H. Howard,et al.  Interpreting the Language of Environmental Sounds , 1987 .

[35]  D. Deutsch,et al.  The Psychology of Music , 1983 .

[36]  R. Jenison On Acoustic Information for Motion , 1997 .

[37]  D. C. Howell Statistical Methods for Psychology , 1987 .

[38]  D Rosenblum Lawrence,et al.  Auditory Reachability: An Affordance Approach to the Perception of Sound Source Distance , 1996 .

[39]  J. Michell An introduction to the logic of psychological measurement , 1995 .

[40]  Christopher C. Heasly,et al.  A User-Centered Approach to the Design of a Naval Tactical Workstation Interface , 1993 .

[41]  Douglas L. Chute,et al.  Fifth-generation research tools: Collaborative development with PowerLaboratory , 1996 .

[42]  R. Guski,et al.  Listening: The Perception of Auditory Events? , 1991 .

[43]  D. Algom,et al.  Stroop and Garner effects in comparative judgment of numerals: The role of attention. , 1999 .

[44]  Julie A. Jacko,et al.  The Identifiability of Auditory Icons for Use in Educational Software for Children , 1996, Interact. Comput..

[45]  Norman J. Lass,et al.  Listeners' Identification of Environmental Sounds , 1982 .

[46]  J. Michell Measurement scales and statistics: A clash of paradigms. , 1986 .