Advanced algorithms for audio quality improvement in musical keyboards instruments

The focus of this thesis is on the signal processing techniques used to increase the audio quality of the most common digital audio effects employed in electronic musical instruments also taking into account the feasibility of the proposed algorithms’ implementation in accordance with the design constraints and the available computational limits. More in detail four different issues have been analyzed throughout this dissertation: artificial reverberation, analysis and emulation of nonlinear devices, audio morphing, and room response equalization. Among the audio effects, one of the most used is definitely artificial reverberation. A great deal of research has been devoted in the last decades to improve the performance of digital artificial reverberators. Thanks to the progress of technology the traditional techniques based on recursive structures (i.e., IIR filters) are accompanied by new approaches based on fast convolution techniques and hybrid reverberator structures. On this basis, an efficient real-time implementation of a fast convolution algorithm has been proposed taking into account an embedded system. Moreover, a technique for reducing the computational load required by this operation using psychoacoustic expedients has been presented considering a joint assessment of the energy decay relief and the absolute threshold of hearing. Finally, some techniques for the approximation of the convolution operation with recursive structures at low computational cost have been suggested. Doctoral School on Engineering Sciences Universita Politecnica delle Marche Although the convolution operation allows the exact reproduction of a linear system, it is important to consider that most of the audio effects are nonlinear systems (i.e., compressors, distortion, amplifiers). For this reason, the most commonly used techniques for the emulation of nonlinear systems based on a black box approach have been studied and analyzed. In particular, a technique for the approximation of the dynamic convolution operation by exploiting the principal component analysis has been proposed. Using this procedure it is possible to reduce the cost of dynamic convolution without lowering the perceived audio quality. An adaptive algorithm for the identification of nonlinear systems using orthogonal functions has also been presented. In order to provide greater flexibility and major artistic expression to musicians, several audio morphing techniques have been analyzed. In particular, this procedure makes possible to combine two or more audio signals in order to create new sounds that are acoustically interesting. This study has led to the development of an audio morphing algorithm for percussive hybrid sound generation. The main features of the presented approach are preprocessing of the audio references performed in the frequency domain and time domain linear interpolation to execute the morphing. Finally, equalization techniques for improving the quality of sound reproduction systems by compensating the room transfer function have been taken into account. In particular, two algorithms for adaptive minimum-phase equalization and a mixed-phase equalization technique have been proposed. In order to verify the suitability of the proposed systems, experiments on a realistic scenario have been carried out.

[1]  Manfred R. Schroeder,et al.  Natural Sounding Artificial Reverberation , 1962 .

[2]  Jeffrey Hurchalla,et al.  A Time Distributed FFT for Efficient Low Latency Convolution , 2010 .

[3]  Stefano Squartini,et al.  Ibrida: A New DWT-Domain Sound Hybridization Tool , 2012 .

[4]  Angelo Farina,et al.  Not-Linear Convolution: A New Approach For The Auralization Of Distorting Systems , 2001 .

[5]  William G. Gardner,et al.  Efficient Convolution without Input/Output Delay , 1995 .

[6]  Francesco Piazza,et al.  A low latency implementation of a non-uniform partitioned convolution algorithm for room acoustic simulation , 2012, Signal, Image and Video Processing.

[7]  Wayne Luk,et al.  The hArtes CarLab: A New Approach to Advanced Algorithms Development for Automotive Audio , 2010 .

[8]  Francesco Piazza,et al.  System Identification based on Hammerstein Models using Cubic Splines , 2013 .

[9]  Philip A. Nelson,et al.  Multiple-Point Equalization in a Room Using Adaptive Digital Filters , 1989 .

[10]  Stefania Cecchi,et al.  A Hybrid Approach for Real-Time Room Acoustic Response Simulation , 2010 .

[11]  Angelo Farina,et al.  Implementation of real-time partitioned convolution on a DSP board , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[12]  Jiun-In Guo,et al.  Perceptual Convolution for Reverberation , 2003 .

[13]  Francesco Piazza,et al.  An adaptive multiple position room response equalizer , 2011, 2011 19th European Signal Processing Conference.

[14]  Rebecca Stewart,et al.  A Hybrid Artificial Reverberation Algorithm , 2007 .

[15]  Francesco Piazza,et al.  Mixed Time-Frequency Approach for Multipoint Room Response Equalization , 2012 .

[16]  Aurelio Uncini,et al.  Real-time room acoustic response simulation by IIR adaptive filter , 2003 .

[17]  Eric Battenberg,et al.  IMPLEMENTING REAL-TIME PARTITIONED CONVOLUTION ALGORITHMS ON CONVENTIONAL OPERATING SYSTEMS , 2011 .

[18]  James A. Moorer,et al.  About This Reverberation Business , 1978 .

[19]  Francesco Piazza,et al.  Approximation of Dynamic Convolution Exploiting Principal Component Analysis: Objective and Subjective Quality Evaluation , 2012 .

[20]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[21]  Ahmet M. Kondoz,et al.  Morphing of transient sounds based on shift-invariant discrete wavelet transform and singular value decomposition , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Angelo Farina,et al.  EMULATION OF NOT-LINEAR, TIME-VARIANT DEVICES BY THE CONVOLUTION TECHNIQUE , 2005 .

[23]  Jan Berg,et al.  HIGH-PERFORMANCE REAL-TIME FIR-FILTERING USING FAST CONVOLUTION ON GRAPHICS HARDWARE , 2010 .

[24]  Giovanni L. Sicuranza,et al.  MULTIPLE POSITION ROOM RESPONSE EQUALIZATION WITH FREQUENCY DOMAIN FUZZY C-MEANS PROTOTYPE DESIGN , 2008 .

[25]  Adriano Farina,et al.  Real-Time Auralization Employing a Not-Linear, Not-Time-Invariant Convolver , 2007 .

[26]  F. Piazza,et al.  An efficient DSP-based implementation of a fast convolution approach with non uniform partitioning , 2012, 2012 5th European DSP Education and Research Conference (EDERC).

[27]  Carlo Drioli,et al.  Sound Morphing With Gaussian Mixture Models , 2001 .

[28]  Guillermo Garcia Optimal Filter Partition for Efficient Convolution with Short Input/Output Delay , 2002 .

[29]  Francesco Piazza,et al.  Evaluation of a Multipoint Equalization System based on Impulse Responses Prototype Extraction , 2011 .

[30]  Francesco Piazza,et al.  Approximation of real impulse response using IIR structures , 2011, 2011 19th European Signal Processing Conference.

[31]  R. D. Figueiredo The Volterra and Wiener theories of nonlinear systems , 1982 .

[32]  Malcolm Slaney,et al.  Automatic audio morphing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[33]  Francesco Piazza,et al.  Audio Morphing for Percussive Hybrid Sound Generation , 2012 .

[34]  Vesa Välimäki,et al.  Fifty Years of Artificial Reverberation , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[35]  F. Piazza,et al.  An efficient DSP implementation of a dynamic convolution approach using principal component analysis , 2012, 2012 5th European DSP Education and Research Conference (EDERC).

[36]  Manfred R. Schroeder,et al.  “Colorless” Artificial Reverberation , 1960 .

[37]  Lamberto Tronchin Non Linear Convolution and Its Application to Audio Effects , 2011 .

[38]  G.L. Sicuranza,et al.  Multiple position room response equalization: Frequency domain prototype design strategies , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[39]  C. Kyriakakis,et al.  A cluster centroid method for room response equalization at multiple locations , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[40]  Barry D. Kulp,et al.  Digital Equalization Using Fourier Transform Techniques , 1988 .

[41]  Jean-Marc Jot,et al.  Digital Delay Networks for Designing Artificial Reverberators , 1991 .

[42]  Jont B. Allen,et al.  Invertibility of a room impulse response , 1979 .

[43]  Udo Zoelzer,et al.  DAFX: Digital Audio Effects , 2011 .

[44]  Jon Dattorro Part Effect Design* 1: Reverberator and Other Filters , 1997 .

[45]  Francesco Piazza,et al.  Hybrid Reverberation Algorithm: a Practical Approach , 2013 .

[46]  J.E. Greenberg,et al.  Adaptive Beamformer Performance In Reverberation , 1991, Final Program and Paper Summaries 1991 IEEE ASSP Workshop on Applications of Signal Processing to Audio and Acoustics.

[47]  Francesco Piazza,et al.  A Low Latency Implementation of a Non Uniform Partitioned Overlap and Save Algorithm for Real Time Applications , 2011 .

[48]  Shoji Makino,et al.  Multiple-point equalization of room transfer functions by using common acoustical poles , 1997, IEEE Trans. Speech Audio Process..

[49]  Tokunbo Ogunfunmi,et al.  Adaptive Nonlinear System Identification: The Volterra and Wiener Model Approaches , 2007 .

[50]  Francesco Piazza,et al.  Adaptive Identification of Nonlinear Models Using Orthogonal Nonlinear Functions , 2012 .

[51]  Michael Vorländer,et al.  Optimal Filter Partitions for Non-Uniformly Partitioned Convolution , 2012 .

[52]  Francesco Piazza,et al.  An Advanced Implementation of a Digital Artificial Reveberator , 2011 .

[53]  Michael J. Kemp Analysis and Simulation of Non-Linear Audio Processes Using Finite Impulse Responses Derived at Multiple Impulse Amplitudes , 1999 .

[54]  Thomas G. Stockham,et al.  High-speed convolution and correlation , 1966, AFIPS '66 (Spring).

[55]  Francesco Piazza,et al.  An adaptive multiple position room response equalizer in warped domain , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[56]  Stefania Cecchi,et al.  NU-Tech: The Entry Tool of the HArtes Toolchain for Algorithms Design , 2008 .