Modeling and Identification of Nonlinear Systems in the Short-Time Fourier Transform Domain

In this paper, we introduce a novel approach for improved nonlinear system identification in the short-time Fourier transform (STFT) domain. We first derive explicit representations of discrete-time Volterra filters in the STFT domain. Based on these representations, approximate nonlinear STFT models, which consist of parallel combinations of linear and nonlinear components, are developed. The linear components are represented by cross-band filters between subbands, while the nonlinear components are modeled by multiplicative cross-terms. We consider the identification of quadratically nonlinear systems and show that a significant reduction in computational cost as well as substantial improvement in estimation accuracy can be achieved over a time-domain Volterra model, particularly when long-memory systems are considered. Experimental results validate the theoretical derivations and demonstrate the effectiveness of the proposed approach.

[1]  Edward J. Powers,et al.  A digital method of modeling quadratically nonlinear systems with a general random input , 1988, IEEE Trans. Acoust. Speech Signal Process..

[2]  Wei-Ping Zhu,et al.  Compensation of Loudspeaker Nonlinearity in Acoustic Echo Cancellation Using Raised-Cosine Function , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  Robert D. Nowak,et al.  Random and pseudorandom inputs for Volterra filter identification , 1994, IEEE Trans. Signal Process..

[4]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[5]  Y. Selen,et al.  Model-order selection: a review of information criterion rules , 2004, IEEE Signal Processing Magazine.

[6]  V. J. O H N M A T H.  Adaptive Polynomial Filters , 2022 .

[7]  R. de Figueiredo.  The Volterra and Wiener theories of nonlinear systems , 1982, Proceedings of the IEEE.

[8]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[9]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[10]  Robert D. Nowak,et al.  Penalized least squares estimation of Volterra filters and higher order statistics , 1998, IEEE Trans. Signal Process..

[11]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[12]  Walter A. Frank.  An efficient approximation to the quadratic Volterra filter and its application in real-time loudspeaker linearization , 1995, Signal Process..

[13]  Jason Wexler,et al.  Discrete Gabor expansions , 1990, Signal Process..

[14]  Walter Kellermann,et al.  Adaptation of a memoryless preprocessor for nonlinear acoustic echo cancelling , 2000, Signal Process..

[15]  D. Westwick,et al.  Separable Least Squares Identification of Nonlinear Hammerstein Models: Application to Stretch Reflex Dynamics , 2001, Annals of Biomedical Engineering.

[16]  Israel Cohen,et al.  Identification of linear systems with adaptive control of the cross-multiplicative transfer function approximation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Rudolf Rabenstein,et al.  Nonlinear acoustic echo cancellation with 2nd order adaptive Volterra filters , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[18]  Giovanni Ramponi,et al.  Quadratic digital filters for image processing , 1988, IEEE Trans. Acoust. Speech Signal Process..

[19]  Israel Cohen,et al.  Adaptive System Identification in the Short-Time Fourier Transform Domain Using Cross-Multiplicative Transfer Function Approximation , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[20]  Rik Pintelon,et al.  Modified AIC and MDL model selection criteria for short data records , 2004, IEEE Transactions on Instrumentation and Measurement.

[21]  Jacob Benesty,et al.  An objective technique for evaluating doubletalk detectors in acoustic echo cancelers , 1999, IEEE Trans. Speech Audio Process..

[22]  Minyue Fu,et al.  A blind approach to Hammerstein model identification , 2002, IEEE Trans. Signal Process..

[23]  Jacob Benesty,et al.  A new class of doubletalk detectors based on cross-correlation , 2000, IEEE Trans. Speech Audio Process..

[24]  W. Martin Snelgrove,et al.  Adaptive linearization of a loudspeaker , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[25]  Christof Faller,et al.  Suppressing acoustic echo in a spectral envelope space , 2005, IEEE Transactions on Speech and Audio Processing.

[26]  NeumaierArnold.  Solving Ill-Conditioned and Singular Linear Systems , 1998 .

[27]  Edward J. Powers,et al.  Batch and adaptive Volterra filtering of cubically nonlinear systems with a Gaussian input , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[28]  Israel Cohen,et al.  System Identification in the Short-Time Fourier Transform Domain With Crossband Filtering , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[29]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[30]  Nicholas Kalouptsidis,et al.  Nonlinear system identification using Gaussian inputs , 1995, IEEE Trans. Signal Process..

[31]  Allen Gersho,et al.  Adaptive Cancellation of Nonlinear Intersymbol Interference for Voiceband Data Transmission , 1984, IEEE Journal on Selected Areas in Communications.

[32]  Régine Le Bouquin-Jeannès,et al.  Nonlinear acoustic echo cancellation based on Volterra filters , 2003, IEEE Trans. Speech Audio Process..

[33]  Taiho Koh,et al.  Second-order Volterra filtering and its application to nonlinear system identification , 1985, IEEE Trans. Acoust. Speech Signal Process..

[34]  Graham C. Goodwin,et al.  Estimated Transfer Functions with Application to Model Order Selection , 1992 .

[35]  M. Portnoff.  Time-frequency representation of digital signals and systems based on short-time Fourier analysis , 1980 .

[36]  George-Othon Glentis,et al.  Efficient multichannel FIR filtering using a single step versatile order recursive algorithm , 1994, Signal Process..

[37]  Gerhard Schmidt,et al.  Acoustic echo control. An application of very-high-order adaptive filters , 1999, IEEE Signal Process. Mag..

[38]  George-Othon Glentis,et al.  Efficient algorithms for Volterra system identification , 1999, IEEE Trans. Signal Process..

[39]  Youhong Lu,et al.  Gabor expansion for adaptive echo cancellation , 1999, IEEE Signal Process. Mag..

[40]  Martin Vetterli,et al.  Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation , 1992, IEEE Trans. Signal Process..

[41]  Brett Ninness,et al.  Quantifying the accuracy of Hammerstein model estimation , 2000, Autom..

[42]  George-Othon Glentis,et al.  Efficient order recursive algorithms for multichannel least squares filtering , 1992, IEEE Trans. Signal Process..

[43]  Israel Cohen,et al.  Adaptive Nonlinear System Identification in the Short-Time Fourier Transform Domain , 2009, IEEE Transactions on Signal Processing.

[44]  Rik Pintelon,et al.  System Identification: A Frequency Domain Approach , 2012 .

[45]  Giovanni L. Sicuranza,et al.  Simplified volterra filters for acoustic echo cancellation in GSM receivers , 2000, 2000 10th European Signal Processing Conference.

[46]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[47]  H. Akaike.  A new look at the statistical model identification , 1974 .

[48]  Demetrios G. Lainiotis,et al.  A partitioned adaptive approach to nonlinear channel equalization , 1998, IEEE Trans. Commun..

[49]  E. Powers,et al.  A block LMS algorithm for third-order frequency-domain Volterra filters , 1997, IEEE Signal Processing Letters.

[50]  Shie Qian,et al.  Discrete Gabor transform , 1993, IEEE Trans. Signal Process..

[51]  Yves Rolain,et al.  Identification of linear systems with nonlinear distortions , 2003, Autom..

[52]  W. Rugh.  Nonlinear System Theory: The Volterra / Wiener Approach , 1981 .

[53]  V. J. Mathews,et al.  Polynomial Signal Processing , 2000 .

[54]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[55]  Torbjörn Wigren,et al.  Quantifying model errors caused by nonlinear undermodeling in linear system identification , 1996 .

[56]  Israel Cohen,et al.  On Multiplicative Transfer Function Approximation in the Short-Time Fourier Transform Domain , 2007, IEEE Signal Processing Letters.

[57]  G. Sicuranza.  Quadratic filters for signal processing , 1992, Proc. IEEE.

[58]  Sergio Benedetto,et al.  Nonlinear Equalization of Digital Satellite Channels , 1982, IEEE J. Sel. Areas Commun..

[59]  Israel Cohen,et al.  NONLINEAR ACOUSTIC ECHO CANCELLATION BASED ON A MULTIPLICA TIVE TRANSFER FUNCTION APPROXIMATION , 2008 .

[60]  Walter Kellermann,et al.  Orthogonalized power filters for nonlinear acoustic echo cancellation , 2006, Signal Process..

[61]  V. John Mathews,et al.  Parallel-cascade realizations and approximations of truncated Volterra systems , 1998, IEEE Trans. Signal Process..