Large-Scale Physical Modeling Synthesis, Parallel Computing, and Musical Experimentation: The NESS Project in Practice

Sound synthesis using physical modeling, emulating systems of a complexity approaching and even exceeding that of real-world acoustic musical instruments, is becoming possible, thanks to recent theoretical developments in musical acoustics and algorithm design. Severe practical difficulties remain, both at the level of the raw computational resources required, and at the level of user control. An approach to the first difficulty is through the use of large-scale parallelization, and results for a variety of physical modeling systems are presented here. Any progress with regard to the second difficulty requires, necessarily, the experience and advice of professional musicians. A basic interface to a parallelized large-scale physical modeling synthesis system is presented here, accompanied by first-hand descriptions of the working methods of five composers, each of whom generated complete multichannel pieces using the system.

[1]  Stefan Bilbao,et al.  An Energy Conserving Finite Difference Scheme for the Simulation of Collisions in Snare Drums , 2014, DAFx.

[2]  Craig J. Webb,et al.  Physical Modeling, Algorithms, and Sound Synthesis: The NESS Project , 2019, Computer Music Journal.

[3]  Miller S. Puckette,et al.  Combining Event and Signal Processing in the MAX Graphical Programming Environment , 1991 .

[4]  Vesa Välimäki,et al.  Audio Signal Processing Using Graphics Processing Units , 2011 .

[5]  Peter R. Samson,et al.  A General-Purpose Digital Synthesizer , 1980 .

[6]  Rolf Bader,et al.  Real-Time Finite-Difference Method Physical Modeling of Musical Instruments Using Field-Programmable Gate Array Hardware , 2016 .

[7]  Miller Puckette,et al.  The Architecture of the IRCAM Musical Workstation , 1991, USENIX Summer.

[8]  Stefan Bilbao A Modular Percussion Synthesis Environment , 2009 .

[9]  L. Dagum,et al.  OpenMP: an industry standard API for shared-memory programming , 1998 .

[10]  Stefan Bilbao,et al.  Hierarchical Parallelism in a Physical Modelling Synthesis Code , 2015, PARCO.

[11]  Kevin Skadron,et al.  Scalable parallel programming , 2008, 2008 IEEE Hot Chips 20 Symposium (HCS).

[12]  Bill Hsu,et al.  Realtime GPU Audio , 2013, ACM Queue.

[13]  Stefan Bilbao,et al.  Numerical Modeling and Sound Synthesis for Articulated String/Fretboard Interactions , 2015 .

[14]  Stefan Bilbao,et al.  Physical Modeling of Timpani Drums in 3D on GPGPUs , 2013 .

[15]  Stefan Bilbao,et al.  Edinburgh Research Explorer An Environment for Physical Modeling of Articulated Brass Instruments , 2015 .

[16]  David R. Butenhof Programming with POSIX threads , 1993 .

[17]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[18]  Paul Graham,et al.  Modular Physical Modeling Synthesis Environments on GPU , 2014, ICMC.

[19]  Qiong Zhang,et al.  Physically-Based Sound Synthesis on GPUs , 2005, ICEC.

[20]  Dinesh Manocha,et al.  An efficient GPU-based time domain solver for the acoustic wave equation , 2012 .

[21]  D. Gareth Loy,et al.  The Systems Concepts Digital Synthesizer: An Architectural Retrospective , 2013, Computer Music Journal.

[22]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[23]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[24]  Vesa Välimäki,et al.  Real-Time Additive Synthesis with One Million Sinusoids Using a GPU , 2010 .

[25]  Stefan Bilbao,et al.  Design Methodology for Real-Time FPGA-Based Sound Synthesis , 2007, IEEE Transactions on Signal Processing.

[26]  D. Gareth Loy Life and Times of the Samson Box , 2013, Computer Music Journal.

[27]  Vladimir M. Pentkovski,et al.  Implementing Streaming SIMD Extensions on the Pentium III Processor , 2000, IEEE Micro.

[28]  Paulo Dias,et al.  Finite Difference Room Acoustic Modelling on a General Purpose Graphics Processing Unit , 2010 .