Listening With Machines: A shared approach

The aim of this article is to review the last twenty years of ‘machine listening’ 1 to sound and music, and to suggest a balanced approach to the human–machine relationship for the future. How might machine listening, and MIR 2 -based ideas of data storage, retrieval and presentation enhance both our embodied experience of the music and its more reflective study (analysis)? While the issues raised may be pertinent to almost any music, the focus will remain on electroacoustic music in its many forms, whether for interactive composition, performance or analytical endeavour. I suggest a model of listening with – that is, alongside – machines in such a way that our skills may be enhanced. What can we share with machines to mutual advantage?

[1]  G. Kramer.  Auditory Scene Analysis: The Perceptual Organization of Sound by Albert Bregman (review) , 2016 .

[2]  Michael Clarke.  Wind Chimes: An Interactive Aural Analysis , 2010 .

[3]  Gil Weinberg,et al.  Toward Robotic Musicianship , 2006, Computer Music Journal.

[4]  Michel Chion.  Guide des objets sonores : Pierre Schaeffer et la recherche musicale , 1983 .

[5]  Pierre Schaeffer.  Traité des objets musicaux , 1966 .

[6]  Denis Smalley,et al.  The listening imagination: Listening in the electroacoustic era , 1996 .

[7]  Atsuo Takanishi,et al.  The Waseda Flutist Robot WF-4RII in Comparison with a Professional Flutist , 2006, Computer Music Journal.

[8]  George E. Lewis.  Too Many Notes: Computers, Complexity and Culture in Voyager , 2000, Leonardo Music Journal.

[9]  S. Handel,et al.  Listening: An Introduction to the Perception of Auditory Events , 1993 .

[10]  Peter Leonard,et al.  Towards a comprehensive framework for electro-acoustic music analysis , 2011, ICMC.

[11]  Todd Winkler.  Composing Interactive Music: Techniques and Ideas Using Max , 1998 .

[12]  Simon Emmerson,et al.  Music, Electronic Media and Culture , 2013 .

[13]  B. Truax.  Acoustic Communication , 1985 .

[14]  David Cope,et al.  Computers and Musical Style , 1993 .

[15]  Mary Simoni.  Analytical Methods of Electroacoustic Music , 2005 .

[16]  David Gray.  The Visualization and Representation of Electroacoustic Music , 2013 .

[17]  Katharine Norman,et al.  Real-World Music as Composed Listening , 1996 .

[18]  Mick Grierson,et al.  Mining Unlabeled Electronic Music Databases through 3D Interactive Visualization of Latent Component Relationships , 2013, NIME.

[19]  S. McAdams,et al.  Auditory Cognition. (Book Reviews: Thinking in Sound. The Cognitive Psychology of Human Audition.) , 1993 .

[20]  Denis Smalley,et al.  Space-form and the acousmatic image , 2007, Organised Sound.

[21]  Eric Clarke,et al.  Ways of Listening , 2005 .

[22]  Jonathan Harvey,et al.  "Mortuos Plango, Vivos Voco": A Realization at IRCAM , 1981 .

[23]  Eric Clarke,et al.  Ways of Listening: An Ecological Approach to the Perception of Musical Meaning , 2005 .

[24]  Peter Leonard,et al.  Systematic And Quantative Electro-Acoustic Music Analysis (Sqema) , 2010, ICMC.

[25]  Peter D. Manning,et al.  Introducing Tacem and the Tiaals Software , 2013, ICMC.

[26]  Arne Eigenfeldt,et al.  Real-time timbral organisation: Selecting samples based upon similarity1 , 2010 .

[27]  R. Dean.  The Oxford Handbook of Computer Music , 2011 .

[28]  Nick Collins,et al.  The Cambridge Companion to Electronic Music , 2007 .

[29]  R. Dean,et al.  A Rise–Fall Temporal Asymmetry of Intensity in Composed and Improvised Electroacoustic Music , 2010, Organised Sound.

[30]  Marc Leman,et al.  Content-Based Music Information Retrieval: Current Directions and Future Challenges , 2008, Proceedings of the IEEE.

[31]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[32]  Guy J. Brown,et al.  Computational Auditory Scene Analysis: Principles, Algorithms, and Applications , 2006 .

[33]  Richard Polfreman,et al.  Sound spotting: a frame-based approach , 2001 .

[34]  Justin London,et al.  Book Review: Hearing in Time: Psychological Aspects of Musical Meter (2nd Edition) , 2004 .

[35]  Roger Dean,et al.  Hyperimprovisation: Computer-Interactive sound improvisation , 2003 .