Virtual Acoustic Musical Instruments: Review and Update

This article gives an overview of selected developments in musical sound synthesis based on physical models of musical instruments – sometimes called “virtual acoustic” sound synthesis. Emphasis is placed on techniques which yield the highest playability and sound quality in real time at a reasonable computational expense.

[1]  Cumhur Erkut,et al.  Methods for Modeling Realistic Playing in Acoustic Guitar Synthesis , 2001, Computer Music Journal.

[2]  M. Verge,et al.  Aeroacoustics of confined jets : with applications to the physical modeling of recorder-like instruments , 1995 .

[3]  Julius O. Smith,et al.  Efficient Synthesis of Stringed Musical Instruments , 1993, ICMC.

[4]  Perry R. Cook,et al.  Physical wave propagation modeling for real-time synthesis of natural sounds , 2002 .

[5]  Schumacher,et al.  Reconstruction of bowing point friction force in a bowed string , 2000, The Journal of the Acoustical Society of America.

[6]  Jean-Pierre Dalmont,et al.  Nonlinear characteristics of single-reed instruments: quasistatic volume flow and reed opening measurements. , 2003, The Journal of the Acoustical Society of America.

[7]  Richard Kronland-Martinet,et al.  Resynthesis of Coupled Piano String Vibrations Based on Physical Modeling , 2001 .

[8]  Xavier Rodet,et al.  One and Two Mass Model Oscillations for Voice and Instruments , 1995, ICMC.

[9]  J. A. Conklin.  Generation of partials due to nonlinear mixing in a stringed instrument , 1999 .

[10]  Stefan Bilbao,et al.  Wave and scattering methods for the numerical integration of partial differential equations , 2001 .

[11]  Maarten van Walstijn,et al.  Discrete-time modelling of brass and reed woodwind instruments with application to musical sound synthesis , 2002 .

[12]  Eric Ducasse,et al.  An alternative to the traveling-wave approach for use in two-port descriptions of acoustic bores. , 2002, The Journal of the Acoustical Society of America.

[13]  Vesa Välimäki,et al.  Reducing the dispersion error in the digital waveguide mesh using interpolation and frequency-warping techniques , 2000, IEEE Trans. Speech Audio Process..

[14]  Julius O. Smith,et al.  Methods for simulating string collisions with rigid spatial obstacles , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[15]  Kurt Adler.  The Mechanics of Musical Instruments , 1965 .

[16]  Matti Karjalainen,et al.  Body Modeling Techniques for String Instrument Synthesis , 1996, ICMC.

[17]  Murray Campbell,et al.  Discrete-time modeling of woodwind instrument bores using wave variables. , 2003, The Journal of the Acoustical Society of America.

[18]  Julius O. Smith,et al.  On fast FIR filters implemented as tail-canceling IIR filters , 1997, IEEE Trans. Signal Process..

[19]  Vesa Välimäki,et al.  Reduction of the dispersion error in the interpolated digital waveguide mesh using frequency warping , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[20]  Gary P. Scavone,et al.  MODELING VOCAL-TRACT INFLUENCE IN REED WIND INSTRUMENTS , 2003 .

[21]  A. Fettweis.  Wave digital filters: Theory and practice , 1986, Proceedings of the IEEE.

[22]  Perry R. Cook,et al.  Non Linear Periodic Prediction for On-Line Identification of Oscillator Characteristics in Woodwind Instruments , 1991, International Conference on Mathematics and Computing.

[23]  Caroline Traube,et al.  ESTIMATING THE PLUCKING POINT ON A GUITAR STRING , 2000 .

[24]  Perry R. Cook,et al.  Real-time Computer Modeling of Woodwind Instruments , 1998 .

[25]  Maarten van Walstijn,et al.  The Wave Digital Tonehole Model , 2000, ICMC.

[26]  Richard Kronland-Martinet,et al.  The simulation of piano string vibration: from physical models to finite difference schemes and digital waveguides. , 2003, The Journal of the Acoustical Society of America.

[27]  Vincent Pagneux,et al.  A study of wave propagation in varying cross-section waveguides by modal decomposition. Part I. Theory and validation , 1996 .

[28]  Hui-Ling Lu,et al.  Glottal source modeling for singing voice synthesis , 2000, ICMC.

[29]  Daniel Mahgerefteh,et al.  The conical bore in musical acoustics , 1983 .

[30]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[31]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[32]  Xavier Rodet,et al.  The CHANT Project: From the Synthesis of the Singing Voice to Synthesis in General , 1984 .

[33]  Marina Bosi,et al.  Introduction to Digital Audio Coding and Standards , 2004, J. Electronic Imaging.

[34]  M. Hasler,et al.  Representation of the weakly nonlinear propagation in air-filled pipes with Volterra series , 2003 .

[35]  A Avraham Hirschberg,et al.  Aero-acoustics of wind instruments , 1995 .

[36]  René Causse,et al.  Input impedance of brass musical instruments—Comparison between experiment and numerical models , 1984 .

[37]  Jim Woodhouse,et al.  Mechanics of the contact area between a violin bow and a string; Part III: parameter dependence , 1998 .

[38]  Marina Bosi,et al.  Overview of MPEG audio : Current and future standards for low-bit-rate audio coding , 1997 .

[39]  Julius O. Smith,et al.  Commuted Piano Synthesis , 1995, ICMC.

[40]  Cumhur Erkut,et al.  Commuted Waveguide Synthesis of the Clavichord , 2003, Computer Music Journal.

[41]  Perry R. Cook,et al.  A Meta-Wind-Instrument Physical Model, and a Meta-Controller for Real-Time Performance Control , 1992, ICMC.

[42]  Stefania Serafin,et al.  MODELING HIGH-FREQUENCY MODES OF COMPLEX RESONATORS USING A WAVEGUIDE MESH , 2000 .

[43]  S. Schwerman,et al.  The Physics of Musical Instruments , 1991 .

[44]  J. Flanagan,et al.  Synthesis of voiced sounds from a two-mass model of the vocal cords , 1972 .

[45]  Matti Karjalainen,et al.  Digital Waveguide Modeling of Wind Instrument Bores constructed of Truncated Cones , 1994, ICMC.

[46]  Arthur H. Benade,et al.  Equivalent circuits for conical waveguides , 1988 .

[47]  Richard Kronland-Martinet,et al.  A Hybrid Resynthesis Model for Hammer-String Interaction of Piano Tones , 2004, EURASIP J. Adv. Signal Process..

[48]  J. Schwinger,et al.  On the Radiation of Sound from an Unflanged Circular Pipe , 1948 .

[49]  Stefania Serafin,et al.  BOWED STRING PHYSICAL MODEL VALIDATION THROUGH USE OF A BOW CONTROLLER AND EXAMINATION OF BOW STROKES , 2003 .

[50]  C. J. Nederveen,et al.  RADIATION IMPEDANCE OF TUBES WITH DIFFERENT FLANGES: NUMERICAL AND EXPERIMENTAL INVESTIGATIONS , 2001 .

[51]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[52]  Gary S Settles,et al.  Schlieren imaging of shock waves from a trumpet. , 2003, The Journal of the Acoustical Society of America.

[53]  Pierre Ruiz,et al.  Synthesizing Musical Sounds by Solving the Wave Equation for Vibrating Objects: Part 2 , 1971 .

[54]  Julius O. Smith,et al.  Developments for the Commuted Piano , 1995, ICMC.

[55]  B. Fabre,et al.  Physical modeling of flue instruments : A review of lumped models , 2000 .

[56]  Julius O. Smith,et al.  Physical Modeling Using Digital Waveguides , 1992 .

[57]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[58]  Jean-Marie Adrien,et al.  The missing link: modal synthesis , 1991 .

[59]  van Rr René Hassel,et al.  Corrections for woodwind tone-hole calculations , 1998 .

[60]  Gavin R. Putland.  Every One-Parameter Acoustic Field Obeys Webster's Horn Equation , 1993 .

[61]  Gabriel Weinreich,et al.  Coupled piano strings , 1977 .

[62]  J. Sundberg,et al.  The Science of Singing Voice , 1987 .

[63]  C. Vergez,et al.  Experiments With An Artificial Mouth For Trumpet , 1998 .

[64]  A Avraham Hirschberg,et al.  From sound synthesis to instrument making : An overview of recent researches on woodwinds , 2003 .

[65]  Tapio Takala,et al.  Waveguide Mesh Method for Low-Frequency Simulation of Room Acoustics , 1995 .

[66]  Matti Karjalainen,et al.  Plucked-string models: From the Karplus-Strong algorithm to digital waveguides and beyond , 1998 .

[67]  Denis Matignon,et al.  Numerical Simulation of Acoustic Waveguides for Webster-Lokshin Model Using Diffusive Representations , 2003 .

[68]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[69]  C. K. Yuen,et al.  Theory and Application of Digital Signal Processing , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[70]  Matti Karjalainen,et al.  Acoustical analysis and model-based sound synthesis of the kantele. , 2002, The Journal of the Acoustical Society of America.

[71]  P. Stoica,et al.  The Steiglitz-McBride Algorithm Revisited-Convergence Analysis and Accuracy Aspects , 1981 .

[72]  John T. Scott,et al.  Fundamentals of musical acoustics , 1976 .

[73]  Xavier Rodet,et al.  PHYSICAL CONSTRAINTS FOR THE CONTROL OF A PHYSICAL MODEL OF A TRUMPET , 2002 .

[74]  Julius O. Smith,et al.  Use of Truncated Innite Impulse Response (TIIR) Filters in Implementing Ecien t Digital Waveguide Models of Flared Horns and Piecewise Conical Bores with Unstable One-Pole Filter Elements , 1998 .

[75]  Julius O. Smith,et al.  Physical Modeling Synthesis Update , 1996 .

[76]  Federico Avanzini,et al.  Modelling the mechanical response of the Reed-mouthpiece-lip system of a clarinet. Part I. A one-dimensional distributed model , 2004 .

[77]  Jim Woodhouse,et al.  Plucked guitar transients: Comparison of measurements and synthesis (vol 90, pg 945, 2004) , 2004 .

[78]  Unto K. Laine,et al.  Frequency-warped signal processing for audio applications , 2000 .

[79]  S. Adachi,et al.  Trumpet sound simulation using a two‐dimensional lip vibration model , 1996 .

[80]  J. O. Smith,et al.  Estimating glottal aspiration noise via wavelet thresholding and best-basis thresholding , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[81]  Julius O. Smith,et al.  The one-filter Keefe clarinet tonehole , 1997, Proceedings of 1997 Workshop on Applications of Signal Processing to Audio and Acoustics.

[82]  Vesa Välimäki,et al.  Parameter Estimation of a Plucked String Synthesis Model Using a Genetic Algorithm with Perceptual Fitness Calculation , 2003, EURASIP J. Adv. Signal Process..

[83]  Matti Karjalainen,et al.  Efficient modeling and synthesis of bell-like sounds , 2002 .

[84]  Davide Rocchesso,et al.  A New Formulation of the 2D-Waveguide Mesh for Percussion Instruments , 1995 .

[85]  Xavier Rodet,et al.  Radiation of a pulsating portion of a sphere: application to horn radiation , 2003 .

[86]  A Lewis,et al.  THE SCIENCE OF SOUND , 1997 .

[87]  Vesa Välimäki,et al.  Development and Calibration of a Guitar Synthesizer , 1997 .

[88]  Julius O. Smith.  Waveguide Simulation of Non-Cylindrical Acoustic Tubes , 1991, ICMC.

[89]  Ajm Adrian Houtsma,et al.  Quasi-stationary model of air flow in the reed channel of single-reed woodwind instruments , 1990 .

[90]  Julius O. Smith,et al.  Efficient Simulation of the Reed-Bore and Bow-String Mechanisms , 1986, ICMC.

[91]  Daniel Noreland,et al.  Numerical Techniques for Acoustic Modelling and Design of Brass Wind Instruments , 2003 .

[92]  Balázs Bank.  Physics-Based Sound Synthesis of the Piano , 2000 .

[93]  Dana C. Massie.  Wavetable Sampling Synthesis , 2002 .

[94]  J. Smitha,et al.  The tribology of rosin , 2022 .

[95]  B. Moore,et al.  A Model of Loudness Applicable to Time-Varying Sounds , 2002 .

[96]  S. Adachi,et al.  Time‐domain simulation of sound production in the brass instrument , 1995 .

[97]  Julius O. Smith,et al.  Inferring control inputs to an acoustic violin from audio spectra , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[98]  Benoît Fabre,et al.  Experimental study of the influence of the mouth geometry on sound production in a recorder-like instrument : windway length and chamfers , 2000 .

[99]  R. T. Schumacher,et al.  ON THE OSCILLATIONS OF MUSICAL-INSTRUMENTS , 1983 .

[100]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[101]  Douglas H. Keefe,et al.  Experiments on the single woodwind tone hole , 1982 .

[102]  David B. Sharp,et al.  Acoustic pulse reflectometry for the measurement of musical wind instruments , 1996 .

[103]  Julius O. Smith,et al.  Bark and ERB bilinear transforms , 1999, IEEE Trans. Speech Audio Process..

[104]  Xavier Rodet,et al.  Synthesis of the singing voice , 1989 .

[105]  Vesa Välimäki,et al.  Interpolated rectangular 3-D digital waveguide mesh algorithms with frequency warping , 2003, IEEE Trans. Speech Audio Process..

[106]  J. Gilbert,et al.  Artificial buzzing lips and brass instruments: experimental results. , 1998, The Journal of the Acoustical Society of America.

[107]  N. S. Barnett,et al.  Private communication , 1969 .

[108]  Xavier Rodet,et al.  Inversion of a physical model of a trumpet , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[109]  P. Morse.  Vibration and Sound , 1949, Nature.

[110]  Gary P. Scavone,et al.  An Acoustic Analysis Of Single-Reed Woodwind Instruments With An Emphasis On Design And Performance Issues And Digital Waveguide Modeling Techniques , 1997 .

[111]  Cumhur Erkut,et al.  Sound Synthesis of the Harpsichord Using a Computationally Efficient Physical Model , 2004, EURASIP J. Adv. Signal Process..

[112]  Julius O. Smith,et al.  Scattering Parameters for the Keefe Clarinet Tonehole Model , 1997 .

[113]  J. Strikwerda.  Finite Difference Schemes and Partial Differential Equations , 1989 .

[114]  Cumhur Erkut,et al.  Aspects in analysis and model-based sound synthesis of plucked string instruments , 2002 .

[115]  Vesa Välimäki,et al.  Physical Modeling of Plucked String Instruments with Application to Real-Time Sound Synthesis , 1996 .

[116]  Joël Gilbert,et al.  Brass Instruments: Linear Stability Analysis and Experiments with an Artificial Mouth , 2000 .

[117]  D. Klatt,et al.  Analysis, synthesis, and perception of voice quality variations among female and male talkers. , 1990, The Journal of the Acoustical Society of America.

[118]  Julius O. Smith,et al.  SynthBuilder Demonstration - A Graphical Real-Time Synthesis, Processing and Performance System , 1995, ICMC.

[119]  Xavier Rodet,et al.  CONTROL PARAMETER ESTIMATION FOR A PHYSICAL MODEL OF A TRUMPET USING PATTERN RECOGNITION , 2002 .

[120]  Davide Rocchesso,et al.  Physically Informed Signal Processing Methods for Piano Sound Synthesis: A Research Overview , 2003, EURASIP J. Adv. Signal Process..

[121]  V. Valimaki,et al.  Robust loss filter design for digital waveguide synthesis of string tones , 2003, IEEE Signal Processing Letters.

[122]  Julius Smith,et al.  Adaptive Interpolated Time-Delay Estimation , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[123]  Matti Karjalainen,et al.  Tonehole Radiation Directivity: A Comparison of Theory to Measurements , 2002, ICMC.

[124]  Davide Rocchesso,et al.  MODELING INTERACTIONS BETWEEN RUBBED DRY SURFACES USING AN ELASTO-PLASTIC FRICTION MODEL , 2002 .

[125]  Cedric Nishan Canagarajah,et al.  Modelling Diffusion at the Boundary of a Digital Waveguide Mesh , 1999, International Conference on Mathematics and Computing.

[126]  Perry R. Cook,et al.  Singing Voice Synthesis: History, Current Work, and Future Directions , 1996 .

[127]  Julius O. Smith,et al.  Toward a high-quality singing synthesizer with vocal texture control , 2002 .

[128]  Jim Woodhouse,et al.  Bowed string simulation using a thermal friction model , 2003 .

[129]  Matti Karjalainen,et al.  Audibility of Inharmonicity in String Instrument Sounds, and Implications to Digital Sound Synthesis , 1999, ICMC.

[130]  Matthew Wright,et al.  Problems and Prospects for Intimate Musical Control of Computers , 2002, Computer Music Journal.

[131]  Julius O. Smith,et al.  Principles of Digital Waveguide Models of Musical Instruments , 2002 .

[132]  Matti Karjalainen,et al.  Modeling of tension modulation nonlinearity in plucked strings , 2000, IEEE Trans. Speech Audio Process..

[133]  Douglas H. Keefe,et al.  Theory of sound propagation in a duct with a branched tube using modal decomposition , 1999 .

[134]  M. Lang,et al.  Simple and robust method for the design of allpass filters using least-squares phase error criterion , 1994 .

[135]  Murray Campbell,et al.  Brass instruments as we know them today , 2004 .

[136]  Jim Woodhouse,et al.  Mechanics of the contact area between a violin bow and a string; Part II: simulating the bowed string , 1998 .

[137]  Jonathan A. Kemp.  Theoretical and experimental study of wave propagation in brass musical instruments , 2002 .

[138]  Stefania Serafin,et al.  The sound of friction: Real-time models, playability and musical applications , 2004 .

[139]  Julius O. Smith,et al.  Physical Modeling with the 2-D Digital Waveguide Mesh , 1993, ICMC.

[140]  Xavier Rodet,et al.  New algorithm for nonlinear propagation of a sound wave applica-tion to a physical model of a trumpe , 2000 .

[141]  Perry R. Cook,et al.  TBone: An Interactive WaveGuide Brass Instrument Synthesis Workbench for the NeXT Machine , 1991, ICMC.

[142]  A Avraham Hirschberg,et al.  Shock waves in trombones , 1996 .

[143]  Vincent Pagneux,et al.  A study of wave propagation in varying cross-section waveguides by modal decomposition. Part II. Results , 1997 .

[144]  Antoine Chaigne,et al.  Time-domain simulation of a guitar: model and method. , 2003, The Journal of the Acoustical Society of America.

[145]  David P. Berners,et al.  Acoustics and signal processing techniques for physical modeling of brass instruments , 1999 .

[146]  Julius O. Smith,et al.  Music applications of digital waveguides , 1987 .

[147]  A. Chaigne,et al.  Numerical simulations of piano strings. I. A physical model for a struck string using finite difference methods , 1994 .

[148]  Douglas H. Keefe,et al.  Theory of the single woodwind tone hole , 1982 .

[149]  Julius O. Smith,et al.  Viewpoints on the History of Digital Synthesis , 1991, ICMC.

[150]  Jonathan S. Abel,et al.  A SIMPLE, ACCURATE WALL LOSS FILTER FOR ACOUSTIC TUBES , 2003 .

[151]  Richard Kronland-Martinet,et al.  From the Physics of Piano Strings to Digital Waveguides , 2002, ICMC.

[152]  Perry R. Cook,et al.  Identification Of Control Parameters In An Articulatory Vocal Tract Model, With Applications To The Synthesis Of Singing , 1990 .

[153]  B. Moore.  An Introduction to the Psychology of Hearing , 1977 .

[154]  Jim Woodhouse,et al.  The physics of the violin , 1986 .

[155]  Stefania Serafin,et al.  Analysis and synthesis of unusual friction-driven musical instruments , 2002, International Conference on Mathematics and Computing.

[156]  Steve Winder.  Introduction to digital filters , 2002 .

[157]  李幼升,et al.  Ph , 1989 .

[158]  John M. Chowning.  Frequency modulation synthesis of the singing voice , 1989 .

[159]  Perry R. Cook,et al.  Combined Linear and Nonlinear Periodic Prediction in Calibrating Models of Musical Instruments to Recordings , 1994, ICMC.

[160]  Patty Huang,et al.  The banded digital waveguide mesh , 2001 .

[161]  Douglas H. Keefe,et al.  Woodwind air column models , 1990 .

[162]  Hanna Järveläinen,et al.  Perception of attributes in real and synthetic string instrument sounds , 2003 .

[163]  Julius O. Smith,et al.  The 3D Tetrahedral Digital Waveguide Mesh with Musical Applications , 1996, ICMC.

[164]  Jim Woodhouse,et al.  On the Synthesis of Guitar Plucks , 2004 .

[165]  Julius O. Smith,et al.  Digital Waveguide Modeling of Woodwind Toneholes , 1997, ICMC.

[166]  Xavier Rodet,et al.  Dynamical Systems and Physical Models of Trumpet-like Instruments. Analytical study and Asymptotical Properties , 2000 .

[167]  Timothy S. Stilson.  Forward-Going Wave Extraction in Acoustic Tubes , 1995, ICMC.