Tuning sound for infrastructures: artificial intelligence, automation, and the cultural politics of audio mastering

ABSTRACT This paper traces the infrastructural politics of automated music mastering to reveal how contemporary iterations of artificial intelligence (AI) shape cultural production. The paper examines the emergence of LANDR, an online platform that offers automated music mastering, built on top of supervised machine learning branded as artificial intelligence. Increasingly, machine learning will become an integral part of signal processing for sounds and images, shaping the way media cultures sound, look, and feel. While LANDR is a product of the so-called ‘big bang’ in machine learning, it could not exist without specific conditions: specific kinds of commensurable data, as well as specific aesthetic and industrial conditions. Mastering, in turn, has become an indispensable but understudied part of music circulation as an infrastructural practice. Here we analyze the intersecting histories of machine learning and mastering, as well as LANDR’s failure at automating other domains of audio engineering. By doing so, we critique the discourse of AI’s inevitability and show the ways in which machine learning must frame or reframe cultural and aesthetic practices in order to automate them, in service of digital distribution, recognition, and recommendation infrastructures.

[1]  L. Gitelman.  Welcome to the Bubble Chamber: Online in the Humanities Today , 2010 .

[2]  Patrick Vonderau,et al.  Spotify Teardown , 2019 .

[3]  Olivera Marjanovic,et al.  Living with Monsters? Social Implications of Algorithmic Phenomena, Hybrid Agency, and the Performativity of Technology , 2018, IFIP Advances in Information and Communication Technology.

[4]  Pat Langley,et al.  The changing science of machine learning , 2011, Machine Learning.

[5]  Norman Kaplan,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1974 .

[6]  J. Overhage,et al.  Sorting Things Out: Classification and Its Consequences , 2001, Annals of Internal Medicine.

[7]  Dylan Mulvin.  Proxies: The Cultural Work of Standing In , 2021 .

[8]  Bob Katz,et al.  Mastering Audio: The Art and the Science , 2002 .

[9]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[10]  Xiaochang Mara Li,et al.  Vocal Features: From Voice Identification to Speech Recognition by Machine , 2019, Technology and culture.

[11]  S. Frith,et al.  The Art of Record Production: An Introductory Reader for a New Academic Field , 2012 .

[12]  Blake Hallinan,et al.  Recommended for you: The Netflix Prize and the production of algorithmic culture , 2016, New Media Soc..

[13]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[14]  Sally Wyatt,et al.  Danger! Metaphors at Work in Economics, Geophysiology, and the Internet , 2004 .

[15]  Joanna Radin,et al.  “Digital Natives”: How Medical and Indigenous Histories Matter for Big Data , 2017, Osiris.

[16]  Anne Balsamo,et al.  Designing Culture: The Technological Imagination at Work , 2011 .

[17]  Francis Rumsey.  Mastering: Art, Perception, Technologies , 2011 .

[18]  Nicole Starosielski,et al.  Signal Traffic: Critical Studies of Media Infrastructures , 2015 .

[19]  Benjamin Piekut,et al.  Deadness: Technologies of the Intermundane , 2010, TDR/The Drama Review.

[20]  Bhiksha Raj,et al.  On the Origin of Deep Learning , 2017, ArXiv.

[21]  Geoffrey C. Bowker,et al.  Introduction: An Agenda for Infrastructure Studies , 2009, J. Assoc. Inf. Syst..

[22]  Frederick Turner,et al.  From Counterculture to Cyberculture: Stewart Brand, the Whole Earth Network, and the Rise of Digital Utopianism , 2006 .

[23]  Nick Collins,et al.  Towards Machine Musicians Who Have Listened to More Music Than Us: Audio Database-Led Algorithmic Criticism for Automatic Composition and Live Concert Systems , 2016, CIE.

[24]  Esther Weltevrede,et al.  Multi-Situated App Studies: Methods and Propositions , 2019, Social Media + Society.

[25]  Jan Baetens,et al.  Selling Digital Music, Formatting Culture , 2017, Leonardo.

[26]  Louise Meintjes,et al.  Sound of Africa!: Making Music Zulu in a South African Studio , 2003 .

[27]  Shlomo Dubnov,et al.  Delegating Creativity: Use of Musical Algorithms in Machine Listening and Composition , 2014, Digital Da Vinci.

[28]  Jonathan Sterne,et al.  MP3: The Meaning of a Format , 2012 .

[29]  Blake Durham.  Regulating dissemination : a comparative digital ethnography of licensed and unlicensed spheres of music circulation , 2018 .

[30]  David Brackett,et al.  Categorizing Sound: Genre and Twentieth-Century Popular Music , 2016 .

[31]  Susan Schmidt Horning.  Chasing Sound: Technology, Culture, and the Art of Studio Recording from Edison to the LP , 2013 .

[32]  Shoshana Zuboff.  The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power , 2019 .

[33]  Steve G. Hoffman.  Managing Ambiguities at the Edge of Knowledge , 2017 .

[34]  Matthew T. Shelvock,et al.  Audio Mastering as Musical Practice , 2012 .

[35]  D. Boyd,et al.  CRITICAL QUESTIONS FOR BIG DATA , 2012 .

[36]  V. Ekstrand.  Digital Music Wars: Ownership and Control of the Celestial Jukebox , 2007 .

[37]  Nancy K. Baym,et al.  Playing to the Crowd: Musicians, Audiences, and the Intimate Work of Connection , 2018 .

[38]  Georgina Born,et al.  On Musical Mediation: Ontology, Technology and Creativity , 2005, Twentieth-Century Music.

[39]  Steven G. Jones.  Music and the Internet , 2000, Popular Music.

[40]  George E. Lewis.  Why Do We Want Our Computers to Improvise? , 2018, The Oxford Handbook of Algorithmic Music.

[41]  Benjamin H. Bratton,et al.  The Stack: On Software and Sovereignty , 2016 .

[42]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[43]  L. Winner.  Autonomous Technology: Technics-out-of-Control as a Theme in Political Thought , 1977 .

[44]  Daniele Barchiesi,et al.  Reverse Engineering of a Mix , 2010 .

[45]  Alexander Galloway,et al.  The Interface Effect , 2012 .

[46]  Robert E W Hancock,et al.  Collateral damage , 2014, Nature Biotechnology.

[47]  Karen E. C. Levy,et al.  The Contexts of Control: Information, Power, and Truck-Driving Work , 2015, Inf. Soc..

[48]  A. Aneesh.  Skill saturation: Rationalization and post-industrial work , 2013 .

[49]  George E. Lewis.  Interacting with latter-day musical automata , 1999 .

[50]  Jenna Burrell,et al.  How the machine ‘thinks’: Understanding opacity in machine learning algorithms , 2016 .

[51]  Bozena Kostek,et al.  A Study on Audio Signal Processed by "Instant Mastering" Services , 2017 .

[52]  Kate Crawford,et al.  Can an Algorithm be Agonistic? Ten Scenes from Life in Calculated Publics , 2016 .

[53]  Vladan Joler.  Anatomy of an AI System The Amazon Echo as an anatomical map of human labor , data and planetary resources , 2018 .

[54]  Paul N. Edwards,et al.  We Have Been Assimilated: Some Principles for Thinking About Algorithmic Systems , 2018, IS&O.

[55]  Nick Collins.  A Funny Thing Happened on the Way to the Formula: Algorithmic Composition for Musical Theater , 2016, Computer Music Journal.

[56]  Jonathan Sterne,et al.  Machine Learning in Context, or Learning from LANDR: Artificial Intelligence and the Platformization of Music Mastering , 2019, Social Media + Society.