A History of Audio Effects

Audio effects are an essential tool that the field of music production relies upon. The ability to intentionally manipulate and modify a piece of sound has opened up considerable opportunities for music making. The evolution of technology has often driven new audio tools and effects, from early architectural acoustics through electromechanical and electronic devices to the digitisation of music production studios. Throughout time, music has constantly borrowed ideas and technological advancements from all other fields and contributed back to the innovative technology. This is defined as transsectorial innovation and fundamentally underpins the technological developments of audio effects. The development and evolution of audio effect technology is discussed, highlighting major technical breakthroughs and the impact of available audio effects.

[1]  György Fazekas,et al.  An Ontology for Audio Features , 2016, ISMIR.

[2]  Sune H. Bergman,et al.  Electrical musical instrument , 1980 .

[3]  bullet Equalizer History.  Operator Adjustable Equalizers : An Overview , 2006 .

[4]  Gerald Schuller,et al.  New Sonorities for Jazz Recordings: Separation and Mixing using Deep Neural Networks , 2016 .

[5]  A. Leuchter,et al.  Ancient Architectural Acoustic Resonance Patterns and Regional Brain Activity , 2008 .

[6]  Mark Sandler,et al.  Adaptive Ballistics Control of Dynamic Range Compression for Percussive Tracks , 2018 .

[7]  Johannes Mulder.  Early history of amplified music: Transectorial innovation and decentralized development , 2015 .

[8]  Barry A. Blesser.  An Interdisciplinary Synthesis of Reverberation Viewpoints , 2001 .

[9]  Antonio J. Oliveira.  A Feedforward Side Chain Limiter/Compressor/De-Esser with Improved Flexibility , 1989 .

[10]  Vesa Välimäki,et al.  Fifty Years of Artificial Reverberation , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  Kirill V. Horoshenkov,et al.  Acoustic Absorbers and Diffusers: Theory, Design and Application, third ed., Trevor J. Cox, Peter D’Antonio. CRC Press, Boca Raton (2017). ISBN: 9781498740999 , 2017 .

[12]  Joshua D. Reiss,et al.  An Evaluation of Audio Feature Extraction Toolboxes , 2015 .

[13]  Manfred R. Schroeder,et al.  Natural Sounding Artificial Reverberation , 1962 .

[14]  Massimo Garai,et al.  A comparison of methods to compute the "effective duration" of the autocorrelation function and an alternative proposal. , 2011, The Journal of the Acoustical Society of America.

[15]  Joshua D. Reiss,et al.  Automatic gain and fader control for live mixing , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[16]  Paul Théberge,et al.  Any Sound You Can Imagine: Making Music/Consuming Technology , 1998 .

[17]  Vesa Välimäki,et al.  All About Audio Equalization: Solutions and Frontiers , 2016 .

[18]  Sofia Nannini,et al.  Towards Italian Opera Houses: A Review of Acoustic Design in Pre-Sabine Scholars , 2019, Acoustics.

[19]  Julius O. Smith,et al.  Neural Style Transfer for Audio Spectograms , 2018, ArXiv.

[20]  György Fazekas,et al.  AUFX-O: Novel Methods for the Representation of Audio Processing Workflows , 2016, SEMWEB.

[21]  W. Mathis,et al.  Life and Work of Wilhelm Cauer (1900 - 1945) , 2000 .

[22]  H Perttu,et al.  SMOOTHING OF THE CONTROL SIGNAL WITHOUT CLIPPED OUTPUT IN DIGITAL PEAK LIMITERS , 2002 .

[23]  Mark Marrington.  Experiencing Musical Composition in the DAW: The Software Interface as Mediator of the Musical Idea , 2011 .

[24]  Udo Zölzer,et al.  Adaptive digital audio effects (a-DAFx): a new class of sound transformations , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Bryan Pardo,et al.  Weighted-Function-Based Rapid Mapping of Descriptors to Audio Processing Parameters , 2011 .

[26]  薛兆喜.  Noise reduction system , 2012 .

[27]  Jean-Claude Risset.  Examples of the Musical Use of Digital Audio Effects , 2002 .

[28]  Udo Zoelzer,et al.  DAFX: Digital Audio Effects , 2011 .

[29]  Virgil Moorefield.  The Producer as Composer: Shaping the Sounds of Popular Music , 2005 .

[30]  Robert G. Arns,et al.  Resonant Cavities in the History of Architectural Acoustics , 1995 .

[31]  R. Pritchard.  Mutual Acoustic Impedance between Radiators in an Infinite Rigid Plane , 1960 .

[32]  Tapio Lokki,et al.  Acoustics of Epidaurus - Studies With Room Acoustics Modelling Methods , 2013 .

[33]  Joshua D. Reiss,et al.  Digital Dynamic Range Compressor Design—A Tutorial and Analysis , 2012 .

[34]  Joshua D. Reiss,et al.  Intelligent Music Production , 2019 .

[35]  William S. Marlens.  Duration and/or Frequency Alteration , 1965 .

[36]  Xavier Serra,et al.  Audio Descriptors and Descriptor Schemes in the Context of MPEG-7 , 1999, ICMC.

[37]  T. Lokki,et al.  Studies of Epidaurus with a hybrid room acoustics modeling method , 2011 .

[38]  Mark Sandler,et al.  STATISTICAL MEASURES OF EARLY REFLECTIONS OF ROOM IMPULSE RESPONSES , 2007 .

[39]  ヒルデブランド、ハロルド・エイ.  Pitch detection and intonation correction apparatus and method , 1998 .

[40]  Rupert Till,et al.  An archaeoacoustic study of the Ħal Saflieni Hypogeum on Malta , 2017, Antiquity.

[41]  Jean-Michel Réveillac.  Musical Sound Effects: Analog and Digital Sound Processing , 2017 .

[42]  Mark B. Sandler,et al.  Approaches in Intelligent Music Production , 2019, Arts.

[43]  Massimo Garai,et al.  The aesthetics of the Bayreuth Festspielhaus explained by means of acoustic measurements and simulations , 2018, Journal of Cultural Heritage.

[44]  Dave Moffat,et al.  An Automated Approach to the Application of Reverberation , 2019 .

[45]  Florian Thalmann,et al.  Towards a Semantic Web Representation and Application of Audio Mixing Rules , 2018 .

[46]  M. Hicks.  Sixties Rock: Garage, Psychedelic, and Other Satisfactions , 1999 .

[47]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[48]  P. Devereux.  A Ceiling Painting in the Hal-Saflieni Hypogeum as Acoustically-Related Imagery: A Preliminary Note , 2009 .

[49]  Peter Manning.  The significance of techné in understanding the art and practice of electroacoustic composition , 2006 .

[50]  Francisca Zalaquett Rock,et al.  Arqueoacústica maya. La necesidad del estudio sistemático de efectos acústicos en sitios arqueológicos , 2008 .

[51]  Robert G. Jahn,et al.  Acoustical resonances of assorted ancient structures , 1996 .

[52]  O. Julien.  The diverting of musical technology by rock musicians: the example of double-tracking , 1999, Popular Music.

[53]  Harald Bode,et al.  History of Electronic Sound Modification , 1984 .

[54]  Brecht De Man.  Audio Effects in Sound Design , 2019 .

[55]  Richard C. Heyser,et al.  Acoustical Measurements by Time Delay Spectrometry , 1967 .

[56]  Brian F G Katz,et al.  Pre-Sabine room acoustic design guidelines based on human voice directivity. , 2018, The Journal of the Acoustical Society of America.

[57]  Andrew. King.  Technology as a vehicle (tool and practice) for developing diverse creativities , 2015 .

[58]  A. Watson,et al.  Architecture and sound: an acoustic analysis of megalithic monuments in prehistoric Britain , 1999, Antiquity.

[59]  Joshua D. Reiss,et al.  Audio Effects: Theory, Implementation and Application , 2014 .

[60]  Pierre Schaeffer.  Traité des objets musicaux , 1966 .

[61]  Lars Lundheim,et al.  On Shannon and "Shannon's Formula" , 2002 .

[62]  Dario D'Orazio,et al.  The autocorrelation-based analysis as a tool of sound perception in a reverberant field , 2017 .

[63]  Dave Moffat,et al.  Machine Learning Multitrack Gain Mixing of Drums , 2019 .

[64]  Hugh Davies.  A history of sampling , 1996 .

[65]  Diogo Alvim.  As the World Leaks into the Work: Composition and architecture , 2017, Organised Sound.

[66]  Nicola Bernardini,et al.  Compositional Use of Digital Audio Effects , 2002 .

[67]  Michael Forsyth,et al.  Buildings for Music: The Architect, the Musician, and the Listener from the Seventeenth Century to the Present Day , 1987 .

[68]  Logan Volkers,et al.  PHASE VOCODER , 2008 .

[69]  Marco A. Martínez Ramírez,et al.  End-to-end equalization with convolutional neural networks , 2018 .

[70]  Joshua D. Reiss,et al.  Stem audio mixing as a content-basec transformation of audio features , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[71]  J. Reiss,et al.  Analysis and Prediction of the Audio Feature Space when Mixing Raw Recordings into Individual Stems , 2017 .

[72]  S. Waksman,et al.  The turn to noise: rock guitar from the 1950s to the 1970s , 2003 .

[73]  György Fazekas,et al.  Audio Effect Classification Based on Auditory Perceptual Attributes , 2013 .

[74]  Christoph Cox,et al.  Audio Culture: Readings in Modern Music , 2004 .

[75]  Bryan Pardo,et al.  Audio Source Separation in a Musical Context , 2018 .

[76]  Stephen McAdams,et al.  Instrument Sound Description in the Context of MPEG-7 , 2000, ICMC.

[77]  Daniel Teruggi.  Technology and musique concrète: The technical developments of the groupe de recherches musicales and their implication in musical composition , 2007 .

[78]  Woon-Seng Gan,et al.  Introduction to Adaptive Filters , 2010 .

[79]  Bruno Fazenda,et al.  Cave acoustics in prehistory: Exploring the association of Palaeolithic visual motifs and acoustic response. , 2017, The Journal of the Acoustical Society of America.

[80]  P. Ramshaw,et al.  Is music production now a composition process , 2005 .

[81]  H. Sabine.  Room Acoustics , 1953, The SAGE Encyclopedia of Human Communication Sciences and Disorders.

[82]  Acousmatic Fabrications: Les Paul and the ‘Les Paulverizer’ , 2011 .

[83]  Jonathan Weinel.  Inner Sound: Altered States of Consciousness in Electronic Music and Audio-Visual Media , 2018 .

[84]  Jay Hodgson,et al.  A field guide to equalisation and dynamics processing on rock and electronica records , 2010, Popular Music.

[85]  Òscar Celma,et al.  Tools for Content-based Retrieval and Transformation of Audio using MPEG-7: The SPOffline and the MDTools , 2004 .

[86]  B. Widrow,et al.  Adaptive antenna systems , 1967 .

[87]  M. Schmid.  Electronic And Experimental Music , 2016 .

[88]  Stefan Bilbao,et al.  Virtual Analog Models of the Lockhart and Serge Wavefolders , 2017 .

[89]  François Pachet,et al.  The CUIDADO Project: New Applications based on Audio and Music Content Description , 2002, ICMC.

[90]  Michael Rettinger.  Reverberation Chambers for Broadcasting and Recording Studios , 1957 .

[91]  Victor Desarnaulds.  De l"acoustique des églises en Suisse , 2002 .

[92]  Udo Zölzer,et al.  Adaptive Digital Audio Effects , 2011 .

[93]  James A. Moorer,et al.  About This Reverberation Business , 1978 .

[94]  Helmut Haas,et al.  The Influence of a Single Echo on the Audibility of Speech , 1972 .

[95]  Joshua D. Reiss,et al.  A Machine-Learning Approach to Application of Intelligent Artificial Reverberation , 2017 .

[96]  David Lubman,et al.  Archaeological acoustic study of chirped echo from the Mayan pyramid at Chichén Itzá , 1998 .

[97]  Matthew Duignan,et al.  Computer Mediated Music Production: a Study of Abstraction and Activity , 2008 .

[98]  Andre Piatier.  Transectorial innovations and the transformation of firms , 1988, Inf. Soc..

[99]  Joshua D. Reiss.  DEEP LEARNING AND INTELLIGENT AUDIO MIXING , 2017 .

[100]  Dorothea Baumann.  Music and space : a systematic and historical investigation into the impact of architectural acoustics on performance practice followed by a study of Handel's Messiah , 2011 .

[101]  D. Bryant.  The ‘cori spezzati’ of St Mark's: myth and reality , 1981, Early Music History.

[102]  Jyri Tapani Pakarinen,et al.  A Review of Digital Techniques for Modeling Vacuum-Tube Guitar Amplifiers , 2009, Computer Music Journal.

[103]  Mark N. Katz.  Hindemith, Toch, and Grammophonmusik , 2001 .

[104]  Harald Bode.  Solid State Audio Frequency Spectrum Shifter , 1965 .

[105]  Joshua D. Reiss,et al.  Intelligent Multitrack Dynamic Range Compression , 2015 .

[106]  Eduard Stikvoort,et al.  Digital Dynamic Range Compressor for Audio , 1986 .

[107]  Joshua D. Reiss,et al.  Applications of Cross-Adaptive Audio Effects: Automatic Mixing, Live Performance and Everything in Between , 2018, Front. Digit. Humanit..

[108]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[109]  Dragana Sumarac Pavlovic,et al.  Acoustic resonators in Serbian orthodox churches , 2002 .

[110]  Jean-Marc Jot,et al.  Analysis and synthesis of room reverberation based on a statistical time-frequency model , 1997 .

[111]  Mark Sandler,et al.  Automatic Mixing Level Balancing Enhanced through Source Interference Identification , 2019 .

[112]  György Fazekas,et al.  High-Level Semantic Metadata for the Control of Multitrack Adaptive Digital Audio Effects , 2012 .

[113]  Peter Doyle,et al.  Echo and Reverb: Fabricating Space in Popular Music Recording, 1900-1960 , 2005 .

[114]  Joshua D. Reiss,et al.  Modeling Nonlinear Audio Effects with End-to-end Deep Neural Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[115]  Anthony Chan Carusone,et al.  Analogue adaptive filters: past and present , 2000 .

[116]  Guy W. McNally,et al.  Dynamic Range Control of Digital Audio Signals , 1984 .

[117]  R. M. Schafer,et al.  The Soundscape: Our Sonic Environment and the Tuning of the World , 1993 .

[118]  Vincent Verfaille,et al.  AN INTERDISCIPLINARY APPROACH TO AUDIO EFFECT CLASSIFICATION , 2006 .

[119]  F. K. Becker,et al.  Automatic equalization for digital communication , 1965 .

[120]  Patrick Susini,et al.  The Timbre Toolbox: extracting audio descriptors from musical signals. , 2011, The Journal of the Acoustical Society of America.

[121]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .