Auditory Imagery Contains More Than Audition

Contributions of nonauditory information to auditory imagery are examined. The spontaneous appearance of visual imagery concurrent with intentionally formed auditory imagery, and the similarities of spatial-temporal properties, mnemonic properties, and perceptual properties of auditory imagery and of visual imagery, is considered. A hypothesized distinction between an “inner voice” (which contains kinesthetic information related to speech articulation) and an “inner ear” (which does not) in auditory imagery is discussed, and evidence consistent (verbal transformation effect, judgments and comparisons of imaged content, clinical studies) and inconsistent (evidence against existence of a separate phonological loop, pre-articulatory auditory verbal imagery) with this distinction is considered. Possible relationships of auditory imagery to kinesthetic information from practice and performance of music and dance are considered, and the relationship of auditory imagery and synesthesia is briefly considered.

[1]  Timothy L Hubbard,et al.  Auditory imagery: empirical findings. , 2010, Psychological bulletin.

[2]  A. Paivio Imagery and verbal processes , 1972 .

[3]  I. Peretz,et al.  Mode and tempo relative contributions to “happy-sad” judgements in equitone melodies , 2003, Cognition & emotion.

[4]  William K. Estes,et al.  Cognitive Processes that Resemble Perceptual Processes , 2014 .

[5]  J. D. Smith,et al.  “Enacted” Auditory Images are Ambiguous; “Pure” Auditory Images are Not , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[6]  Takashi Hanakawa,et al.  Song and speech: Brain regions involved with perception and covert production , 2006, NeuroImage.

[7]  J. D. Smith,et al.  The role of subvocalization in auditory imagery , 1995, Neuropsychologia.

[8]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[9]  Randolph G. Bias,et al.  Phonological recoding and reading. , 1981 .

[10]  D. Mackay,et al.  CONSTRAINTS ON THEORIES OF INNER SPEECH , 2014 .

[11]  C. Spence Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[12]  Peter E Keller,et al.  Auditory Pitch Imagery and Its Relationship to Musical Synchronization , 2009, Annals of the New York Academy of Sciences.

[13]  A. Halpern,et al.  Mental scanning in auditory imagery for songs. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[14]  R. Cytowič Synesthesia: A Union of the Senses , 1989 .

[15]  A. Baddeley,et al.  Exploring the Articulatory Loop , 1984 .

[16]  S. Dehaene,et al.  Topographical Layout of Hand, Eye, Calculation, and Language-Related Areas in the Human Parietal Lobe , 2002, Neuron.

[17]  Jeff H. Duyn,et al.  Cortical Systems Associated with Covert Music Rehearsal , 2002, NeuroImage.

[18]  R. Finke Levels of equivalence in imagery and perception. , 1980 .

[19]  J. Cumming,et al.  Professional Dancers Describe Their Imagery: Where, When, What, Why, and How , 2005 .

[20]  Dylan M. Jones,et al.  Irrelevant tones produce an irrelevant speech effect : Implications for phonological coding in working memory , 1993 .

[21]  L. Pring,et al.  Remembering the past and imagining the future: A role for nonvisual imagery in the everyday cognition of blind and sighted people , 2006 .

[22]  Emery Schubert,et al.  Perception of Emotion in Sounded and Imagined Music , 2010 .

[23]  K. Stoeckig,et al.  Musical imagery: generation of tones and chords. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Robert H. Logie,et al.  AUDITORY IMAGERY AND WORKING MEMORY , 1992 .

[25]  Gary S. Dell,et al.  Inner speech slips exhibit lexical bias, but not the phonemic similarity effect , 2008, Cognition.

[26]  S. Murphy,et al.  Imagery in Sport, Exercise and Dance , 2008 .

[27]  Functional characteristics of the inner voice and the inner ear: Single or double agency? , 1995 .

[28]  Mascha van 't Wout,et al.  Subvocalization in auditory-verbal imagery: just a form of motor imagery? , 2004, Cognitive Processing.

[29]  M. Pitt,et al.  The role of spectral and dynamic cues in imagery for musical timbre. , 1992, Journal of experimental psychology. Human perception and performance.

[30]  R A Finke,et al.  Some consequences of visualization in pattern identification and detection. , 1986, The American journal of psychology.

[31]  J. Cumming,et al.  The development of imagery in dance : Part II. Quantitative data from a mixed sample of dancers , 2006 .

[32]  Andrea R. Halpern,et al.  Perceived and Imagined Tempos of Familiar Songs , 1988 .

[33]  M. J. Sharps,et al.  Auditory imagery and free recall. , 1992, The Journal of general psychology.

[34]  Stephen M. Kosslyn,et al.  Image and mind , 1982 .

[35]  G. A. Shaw The multisensory image and emotion in poetry. , 2008 .

[36]  Hans-Jochen Heinze,et al.  Scanning silence: Mental imagery of complex sounds , 2005, NeuroImage.

[37]  R. Zatorre,et al.  Effect of unilateral temporal-lobe excision on perception and imagery of songs , 1993, Neuropsychologia.

[38]  V. van de Ven,et al.  The brain's voices: comparing nonclinical auditory hallucinations and imagery. , 2011, Cerebral cortex.

[39]  R. Gibbs Embodiment and Cognitive Science: Concepts , 2005 .

[40]  Mariko Mikumo,et al.  Motor Encoding Strategy for Pitches of Melodies , 1994 .

[41]  Christian Abry,et al.  Multistable syllables as enacted percepts: a source of an asymmetric bias in the verbal transformation effect , 2006, Perception & psychophysics.

[42]  S. Kosslyn,et al.  Visual mental imagery induces retinotopically organized activation of early visual areas. , 2005, Cerebral cortex.

[43]  Clemens Wöllner,et al.  Seeing or hearing the pianists? A synopsis of an early audiovisual perception experiment and a replication , 2011 .

[44]  D. Rubin,et al.  Imagery and retrieval of auditory and visual information: Neural correlates of successful and unsuccessful performance , 2011, Neuropsychologia.

[45]  Albert Costa,et al.  The lexical bias effect in bilingual speech production: Evidence for feedback between lexical and sublexical levels across languages , 2006, Psychonomic bulletin & review.

[46]  H. Leuthold,et al.  The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects , 2011 .

[47]  Cyriel M. A. Pennartz,et al.  Modality-specific and modality-independent components of the human imagery system , 2010, NeuroImage.

[48]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.

[49]  Avishai Henik,et al.  The Neuronal Correlate of Bidirectional Synesthesia: A Combined Event-related Potential and Functional Magnetic Resonance Imaging Study , 2007, Journal of Cognitive Neuroscience.

[50]  Kenneth Hugdahl,et al.  Reversing spoken items—mind twisting not tongue twisting , 2005, Brain and Language.

[51]  Alan D. Baddeley,et al.  Attention: Selection, Awareness, and Control , 1993 .

[52]  Margaret Jean Intons-Pererson The role of loudness in auditory imagery , 1980 .

[53]  A. Henik,et al.  Auditory imagery from musical notation in expert musicians , 2003, Perception & psychophysics.

[54]  B. Repp,et al.  Music Notation, But Not Action on a Keyboard, Influences Pianists' Judgments of Ambiguous Melodies , 2011 .

[55]  Elia Formisano,et al.  The functional neuroanatomy of metrical stress evaluation of perceived and imagined spoken words. , 2004, Cerebral cortex.

[56]  A. Friederici,et al.  Time Perception and Motor Timing: A Common Cortical and Subcortical Basis Revealed by fMRI , 2000, NeuroImage.

[57]  Word imagery modalities and learning in the deaf and hearing. , 1976, The Journal of psychology.

[58]  Amir Amedi,et al.  Negative BOLD in Sensory Cortices During Verbal Memory: A Component in Generating Internal Representations? , 2009, Brain Topography.

[59]  A Thron,et al.  Playing piano in the mind--an fMRI study on music imagery and performance in pianists. , 2004, Brain research. Cognitive brain research.

[60]  Auditory and visual imagery in free recall. , 1984, The Journal of psychology.

[61]  Jamie Ward,et al.  A comparison of lexical-gustatory and grapheme-colour synaesthesia , 2005, Cognitive neuropsychology.

[62]  David Silbersweig,et al.  Functional anatomy of inner speech and auditory verbal imagery , 1995, Schizophrenia Research.

[63]  Stefan Debener,et al.  Multisensory identification of natural objects in a two-way crossmodal priming paradigm. , 2008, Experimental psychology.

[64]  P. Keller,et al.  Individual Differences, Auditory Imagery, and the Coordination of Body Movements and Sounds in Musical Ensembles , 2010 .

[65]  L. Lippman,et al.  Mental Practice and Memorization of Piano Music. , 1991, The Journal of general psychology.

[66]  D. Deutsch The tritone paradox: Effects of spectral variables , 1987, Perception & psychophysics.

[67]  Gary M. Oppenheim,et al.  Motor movement matters: The flexible abstractness of inner speech , 2010, Memory & cognition.

[68]  T. Pechmann,et al.  Interference in memory for tonal pitch: Implications for a working-memory model , 1992, Memory & cognition.

[69]  B. Repp,et al.  Spectral Envelope and Context Effects in the Tritone Paradox , 1997, Perception.

[70]  R M Warren,et al.  Verbal transformation effect and auditory perceptual mechanisms. , 1968, Psychological bulletin.

[71]  T L Hubbard,et al.  Musical scales and evaluations of happiness and awkwardness: effects of pitch, direction, and scale mode. , 2001, The American journal of psychology.

[72]  C. Cornoldi,et al.  Modality-specific Auditory Imaging and the Interactive Imagery Effect , 1997 .

[73]  Luigi Cattaneo,et al.  Covert Speech Arrest Induced by rTMS over Both Motor and Nonmotor Left Hemisphere Frontal Sites , 2005, Journal of Cognitive Neuroscience.

[74]  P. McGuire,et al.  Is auditory imagery defective in patients with auditory hallucinations? , 2000, Psychological Medicine.

[75]  Georgije Lukatela,et al.  Phonemic similarity effects and prelexical phonology , 1990, Memory & cognition.

[76]  Manuel Rodriguez,et al.  Integration of auditory and kinesthetic information in motion: alterations in Parkinson's disease. , 2008, Neuropsychology.

[77]  D. S. Hill,et al.  Shared Processes in Spatial Rotation and Musical Permutation , 2001, Brain and Cognition.

[78]  Lynn C. Robertson,et al.  Synesthesia : perspectives from cognitive neuroscience , 2005 .

[79]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[80]  Janet S. Dufek,et al.  Imagery and Conditioning Practices for Dancers , 1997, Dance Research Journal.

[81]  Robert W. Mitchell,et al.  Embodying Music: Matching Music and Dance in Memory , 2001 .

[82]  Peter E Keller,et al.  The planning and execution of short auditory sequences , 2006, Psychonomic bulletin & review.

[83]  Z. Eitan,et al.  HOW MUSIC MOVES: Musical Parameters and Listeners' Images of Motion , 2006 .

[84]  P. Keller,et al.  Auditory imagery shapes movement timing and kinematics: evidence from a musical task. , 2010, Journal of experimental psychology. Human perception and performance.

[85]  K. Douglas,et al.  Amusia is associated with deficits in spatial processing , 2007, Nature Neuroscience.

[86]  R. Finke,et al.  Theories relating mental imagery to perception. , 1985, Psychological bulletin.

[87]  Robert G. Crowder,et al.  Imagery for musical timbre , 1989 .

[88]  Stephen M. Kosslyn,et al.  When is imagery used in everyday life? A diary study. , 1990 .

[89]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[90]  William L. Berz Working Memory in Music: A Theoretical Model , 1995 .

[91]  Alan D. Baddeley,et al.  Disruption of short-term memory by unattended speech : Implications for the structure of working memory , 1982 .

[92]  Robert J. Zatorre,et al.  Bucknell Digital Commons Bucknell Digital Commons Mental reversal of imagined melodies: A role for the posterior Mental reversal of imagined melodies: A role for the posterior parietal cortex parietal cortex , 2022 .

[93]  M. J. Intons-Peterson Components of auditory imagery. , 2014 .

[94]  R. Murray,et al.  Functional anatomy of auditory verbal imagery in schizophrenic patients with auditory hallucinations. , 2000, The American journal of psychiatry.

[95]  C. Perfetti,et al.  The visual tongue-twister effect: Phonological activation in silent reading , 1982 .

[96]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[97]  P. Keller,et al.  Action Planning in Sequential Skills: Relations to Music Performance , 2008, Quarterly journal of experimental psychology.

[98]  D. Proffitt Embodied Perception and the Economy of Action , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[99]  Avishai Henik,et al.  The mental representation of music notation: notational audiation. , 2008, Journal of experimental psychology. Human perception and performance.

[100]  Martin Puttke,et al.  The Neurocognition of Dance , 2010 .

[101]  C. D. Frith,et al.  Abnormal monitoring of inner speech: a physiological basis for auditory hallucinations , 1995, The Lancet.

[102]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[103]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[104]  D. Deutsch,et al.  The Psychology of Music , 1983 .

[105]  Gian Luca Romani,et al.  Mental imagery generation in different modalities activates sensory-motor areas , 2009, Cognitive Processing.

[106]  J. Zacks Neuroimaging Studies of Mental Rotation: A Meta-analysis and Review , 2008, Journal of Cognitive Neuroscience.

[107]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[108]  Günther Knoblich,et al.  The Social Nature of Perception and Action , 2006 .

[109]  M. Farah,et al.  Psychophysical evidence for a shared representational medium for mental images and percepts. , 1985, Journal of experimental psychology. General.

[110]  Kazuo Matsuoka,et al.  Effects of Auditory Imagery on the Detection of a Pure Tone in White Noise: Experimental Evidence of the Auditory Perky Effect , 1992, Perceptual and motor skills.

[111]  Ashok S. Jansari,et al.  Mental imagery and synaesthesia: Is synaesthesia from internally-generated stimuli possible? , 2008, Cognition.

[112]  M. J. Sharps,et al.  Category superiority effects and the processing of auditory images. , 1998, The Journal of general psychology.

[113]  N. Kroll,et al.  Bizarre imagery: The misremembered mnemonic. , 1986 .

[114]  C. Mills,et al.  DIGIT SYNAESTHESIA: A CASE STUDY USING A STROOP-TYPE TEST , 1999 .

[115]  N Cowan,et al.  Can auditory memory for tone pitch be rehearsed? , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[116]  R. Malach,et al.  Negative BOLD Differentiates Visual Imagery and Perception , 2005, Neuron.

[117]  Adam Reeves,et al.  How visual imagery interferes with vision. , 1992, Psychological review.

[118]  A. Halpern,et al.  Memory for the absolute pitch of familiar songs , 1989, Memory & cognition.

[119]  J. Sundberg,et al.  Does music performance allude to locomotion? A model of final ritardandi derived from measurements of stopping , 1999 .

[120]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[121]  T. Hubbard,et al.  A Fröhlich effect and representational gravity in memory for auditory pitch. , 2013, Journal of experimental psychology. Human perception and performance.

[122]  Caroline Palmer,et al.  Effects of Auditory and Motor Mental Practice in Memorized Piano Performance , 2004 .

[123]  D. Cahn The effects of varying ratios of physical and mental practice, and task difficulty on performance of a tonal pattern , 2008 .

[124]  Robert J. Zatorre,et al.  Mental Concerts: Musical Imagery and Auditory Cortex , 2005, Neuron.

[125]  P. Sedlmeier,et al.  Music is in the Muscle: How Embodied Cognition May Influence Music Preferences , 2011 .

[126]  A. Baddeley,et al.  Working Memory and Language , 2018, Working Memories.

[127]  Mine Dogantan-Dack,et al.  The body behind music: precedents and prospects , 2006 .

[128]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[129]  Dylan M. Jones,et al.  Objects, streams, and threads of auditory attention. , 1993 .

[130]  K Takeda,et al.  Activated brain regions in musicians during an ensemble: a PET study. , 2001, Brain research. Cognitive brain research.

[131]  Emery Schubert Modeling Perceived Emotion With Continuous Musical Features , 2004 .

[132]  C. Krumhansl,et al.  Can Dance Reflect the Structural and Expressive Qualities of Music? A Perceptual Experiment on Balanchine's Choreography of Mozart's Divertimento No. 15 , 1997 .

[133]  L. Nygaard,et al.  Reading voices and hearing text: talker-specific auditory imagery in reading. , 2008, Journal of experimental psychology. Human perception and performance.

[134]  Daniel Reisberg,et al.  Can mental images be ambiguous , 1985 .

[135]  G. Bower Analysis of a mnemonic device , 1970 .

[136]  Lawrence E. Marks,et al.  On colored-hearing synesthesia: cross-modal translations of sensory dimensions. , 1975 .

[137]  Jay Juchniewicz,et al.  The influence of physical movement on the perception of musical performance , 2008 .

[138]  Simon Baron-Cohen,et al.  Synaesthesia : classic and contemporary readings , 1997 .

[139]  S. J. Segal,et al.  Influence of imaged pictures and sounds on detection of visual and auditory signals. , 1970, Journal of experimental psychology.

[140]  L. Lippman,et al.  Effects of Mental Practice and Modeling on Guitar and Vocal Performance , 1995 .

[141]  P. Fraisse 6 – Rhythm and Tempo , 1982 .

[142]  Avishai Henik,et al.  When Blue is Larger than Red: Colors Influence Numerical Cognition in Synesthesia , 2005, Journal of Cognitive Neuroscience.

[143]  R. Zatorre,et al.  When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. , 1999, Cerebral cortex.

[144]  M Lotze,et al.  The musician's brain: functional imaging of amateurs and professionals during performance and imagery , 2003, NeuroImage.

[145]  A. Paivio Mental Representations: A Dual Coding Approach , 1986 .

[146]  T. Horn,et al.  Advances in Sport Psychology , 2002 .

[147]  S. Goldinger,et al.  What the reader’s eye tells the mind’s ear: Silent reading activates inner speech , 1997, Perception & psychophysics.

[148]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[149]  L. Marks The Unity of the Senses: Interrelations Among the Modalities , 1978 .

[150]  D Hemsley,et al.  Verbal self-monitoring and auditory verbal hallucinations in patients with schizophrenia , 2001, Psychological Medicine.