Model-based synthesis of plucked string instruments by using a class of scattering recurrent networks

A physical modeling method for electronic music synthesis of plucked-string tones by using recurrent networks is proposed. A scattering recurrent network (SRN) which is used to analyze string dynamics is built based on the physics of acoustic strings. The measured vibration of a plucked string is employed as the training data for the supervised learning of the SRN. After the network is well trained, it can be regarded as the virtual model for the measured string and used to generate tones which can be very close to those generated by its acoustic counterpart. The "virtual string" corresponding to the SRN can respond to different "plucks" just like a real string, which is impossible using traditional synthesis techniques such as frequency modulation and wavetable. The simulation of modeling a cello "A"-string demonstrates some encouraging results of the new music synthesis technique. Some aspects of modeling and synthesis procedures are also discussed.

[1]  A. J. Jerri.  Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[2]  Fernando J. Pineda,et al.  Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation , 1989, Neural Computation.

[3]  Peter Otto,et al.  An Introduction to the Creation of Electroacoustic Music , 1995 .

[4]  H. Saunders,et al.  Fundamentals of Acoustics (3rd Ed.) , 1983 .

[5]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[6]  Pierre Ruiz,et al.  Synthesizing Musical Sounds by Solving the Wave Equation for Vibrating Objects: Part 2 , 1971 .

[7]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[8]  Julius O. Smith,et al.  Efficient Synthesis of Stringed Musical Instruments , 1993, ICMC.

[9]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[10]  Julius O. Smith,et al.  Physical Modeling Using Digital Waveguides , 1992 .

[11]  Nevin Berger,et al.  How music and computers work , 1994 .

[12]  Kevin Karplus,et al.  Digital Synthesis of Plucked-String and Drum Timbers , 1983 .

[13]  Perry R. Cook,et al.  Identification Of Control Parameters In An Articulatory Vocal Tract Model, With Applications To The Synthesis Of Singing , 1990 .

[14]  B. B. Bauer,et al.  Fundamentals of acoustics , 1963 .

[15]  Vesa Välimäki,et al.  Physical Modeling of Plucked String Instruments with Application to Real-Time Sound Synthesis , 1996 .

[16]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[17]  S. Schwerman,et al.  The Physics of Musical Instruments , 1991 .

[18]  P. Morse.  Vibration and Sound , 1949, Nature.

[19]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[20]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[21]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[22]  F. Richard Moore,et al.  Elements of computer music , 1990 .

[23]  Jim Woodhouse,et al.  The physics of the violin , 1986 .

[24]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[25]  A. J. Jerri.  The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.