Relative optimization for blind deconvolution

We propose a relative optimization framework for quasi-maximum likelihood (QML) blind deconvolution and the relative Newton method as its particular instance. Special Hessian structure allows fast Newton system construction and solution, resulting in a fast-convergent algorithm with iteration complexity comparable to that of gradient methods. We also propose the use of rational infinite impulse response (IIR) restoration kernels, which constitute a richer family of filters than the traditionally used finite impulse response (FIR) kernels. We discuss different choices of nonlinear functions that are suitable for deconvolution of super- and sub-Gaussian sources and formulate the conditions under which the QML estimation is stable. Simulation results demonstrate the efficiency of the proposed methods.

[1]  T. Kailath,et al.  A least-squares approach to blind channel identification , 1995, IEEE Trans. Signal Process..

[2]  Michael Zibulevsky.  Smoothing Method of Multipliers for Sum-Max Problems , 2005 .

[3]  J. Treichler,et al.  A new approach to multipath correction of constant modulus signals , 1983 .

[4]  Alexander M. Bronstein,et al.  BLOCK-COORDINATE RELATIVE NEWTON METHOD FOR BLIND SOURCE SEPARATION , 2003 .

[5]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[6]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[7]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[8]  Yehoshua Y. Zeevi,et al.  Quasi Maximum Likelihood Blind Deconvolution of Images Using Optimal Sparse Representations , 2003 .

[9]  A. Benveniste,et al.  Robust identification of a nonminimum phase system: Blind adjustment of a linear equalizer in data communications , 1980 .

[10]  Y. Hua.  Fast maximum likelihood for blind identification of multiple FIR channels , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[11]  S. Douglas,et al.  On equivariant adaptation in blind deconvolution , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[12]  Thomas P. von Hoff,et al.  BLIND SEPARATION OF MIXED-KURTOSIS SIGNALS USING AN ADAPTIVE THRESHOLD NONLINEARITY , 2000 .

[13]  Alexander M. Bronstein,et al.  Blind source separation using block-coordinate relative Newton method , 2004, Signal Process..

[14]  Chrysostomos L. Nikias,et al.  EVAM: an eigenvector-based algorithm for multichannel blind deconvolution of input colored signals , 1995, IEEE Trans. Signal Process..

[15]  Georgios B. Giannakis,et al.  Blind fractionally spaced equalization of noisy FIR channels: direct and adaptive solutions , 1997, IEEE Trans. Signal Process..

[16]  Barak A. Pearlmutter,et al.  Blind source separation by sparse decomposition , 2000, SPIE Defense + Commercial Sensing.

[17]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[18]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[19]  Eric Moulines,et al.  Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[21]  Eric Moulines,et al.  Subspace methods for the blind identification of multichannel FIR filters , 1995, IEEE Trans. Signal Process..

[22]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[23]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[24]  Chong-Yung Chi,et al.  Batch processing algorithms for blind equalization using higher-order statistics , 2003, IEEE Signal Process. Mag..

[25]  P. Schniter,et al.  On frequency-domain implementations of filtered-gradient blind deconvolution algorithms , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[26]  Yingbo Hua,et al.  Previously Published Works Uc Riverside Title: Fast Maximum Likelihood for Blind Identification of Multiple Fir Channels Fast Maximum Likelihood for Blind Identification of Multiple Fir Channels , 2022 .

[27]  Lang Tong,et al.  A new approach to blind identification and equalization of multipath channels , 1991, [1991] Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers.

[28]  Barak A. Pearlmutter,et al.  Independent Component Analysis: Blind source separation by sparse decomposition in a signal dictionary , 2001 .

[29]  Shun-ichi Amari,et al.  Novel On-Line Adaptive Learning Algorithms for Blind Deconvolution Using the Natural Gradient Approach , 1997 .

[30]  S.C. Douglas,et al.  Multichannel blind deconvolution and equalization using the natural gradient , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[31]  Lang Tong,et al.  Blind identification and equalization based on second-order statistics: a time domain approach , 1994, IEEE Trans. Inf. Theory.

[32]  R. Lambert.  Multichannel blind deconvolution: FIR matrix algebra and separation of multipath mixtures , 1996 .

[33]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[34]  Scott C. Douglas,et al.  On the existence of universal nonlinearities for blind source separation , 2002, IEEE Trans. Signal Process..

[35]  Y. Sato,et al.  A Method of Self-Recovering Equalization for Multilevel Amplitude-Modulation Systems , 1975, IEEE Trans. Commun..

[36]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[37]  M. Zibulevsky.  BLIND SOURCE SEPARATION WITH RELATIVE NEWTON METHOD , 2003 .

[38]  Philippe Loubaton,et al.  Second order blind equalization in multiple input multiple output FIR systems: a weighted least squares approach , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.