Exploiting Nonlinearity in Adaptive Signal Processing

Quantitative performance criteria for the analysis of machine learning architectures and algorithms have been long established. However, the qualitative performance criteria, e.g., nonlinearity assessment, are still emerging. To that end, we employ some recent developments in signal characterisation and derive criteria for the assessment of the changes in the nature of the processed signal. In addition, we also propose a novel online method for tracking the system nonlinearity. A comprehensive set of simulations in both the linear and nonlinear settings and their combination supports the analysis.

[1]  M. Hulle,et al.  The Delay Vector Variance Method for Detecting Determinism and Nonlinearity in Time Series , 2004 .

[2]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[3]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[4]  Steve McLaughlin,et al.  Speech characterization and synthesis by nonlinear methods , 1999, IEEE Trans. Speech Audio Process..

[5]  Andrew C. Singer,et al.  Multi-stage adaptive signal processing algorithms , 2000, Proceedings of the 2000 IEEE Sensor Array and Multichannel Signal Processing Workshop. SAM 2000 (Cat. No.00EX410).

[6]  T. Schreiber.  Interdisciplinary application of nonlinear time series methods , 1998, chao-dyn/9807001.

[7]  Ronald W. Schafer,et al.  Digital Processing of Speech Signals , 1978 .

[8]  Sadaoki Furui,et al.  Advances in Speech Signal Processing , 1991 .

[9]  D. P. Mandic,et al.  NNGD algorithm for neural adaptive filters , 2000 .

[10]  T. Schreiber,et al.  Discrimination power of measures for nonlinearity in a time series , 1997, chao-dyn/9909043.

[11]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[12]  Petros Maragos,et al.  Speech nonlinearities, modulations, and energy operators , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[13]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[14]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[15]  Pekka Loula,et al.  Hammerstein Model for Speech Coding , 2003, EURASIP J. Adv. Signal Process..

[16]  S. D. Hansen,et al.  Non-linear short-term prediction in speech coding , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Schreiber,et al.  Improved Surrogate Data for Nonlinearity Tests. , 1996, Physical review letters.

[18]  Kuldip K. Paliwal,et al.  Speech Coding and Synthesis , 1995 .

[19]  Danilo P. Mandic,et al.  Signal nonlinearity in fMRI: a comparison between BOLD and MION , 2003, IEEE Transactions on Medical Imaging.

[20]  F. Martinez,et al.  Detection of chaotic behaviour in speech signals using the largest Lyapunov exponent , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[21]  L. Gavidia-Ceballos,et al.  A nonlinear operator-based speech feature analysis method with application to vocal fold pathology assessment , 1998, IEEE Transactions on Biomedical Engineering.

[22]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction , 2001 .

[23]  Liang Li,et al.  Nonlinear adaptive prediction of nonstationary signals , 1995, IEEE Trans. Signal Process..

[24]  Kazuo Yana,et al.  Adaptive estimation of the degree of system nonlinearity , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[25]  Gernot Kubin,et al.  Nonlinear long-term prediction of speech signals , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  Wolfgang Wokurek.  Time-frequency analysis of the glottal opening , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Kazuyuki Aihara,et al.  Detecting nonlinear Determinism in voiced Sounds of Japanese vowel /a/ , 2000, Int. J. Bifurc. Chaos.

[28]  Ali H. Sayed,et al.  Steady state performance of convex combinations of adaptive filters , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[29]  Danilo P. Mandic,et al.  Non-Linear Adaptive Prediction of Speech with a Pipelined Recurrent Neural Network and Advanced Learning Algorithms , 1998 .

[30]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[31]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[32]  Danilo P. Mandic,et al.  Collaborative Adaptive Learning using Hybrid Filters , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[33]  John H. L. Hansen,et al.  Discrete-Time Processing of Speech Signals , 1993 .

[34]  B. Townshend,et al.  Nonlinear prediction of speech , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[35]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[36]  Mike Brookes,et al.  Estimation of Glottal Closure Instants in Voiced Speech Using the DYPSA Algorithm , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[38]  D. T. Kaplan,et al.  Exceptional events as evidence for determinism , 1994 .