Sparse deconvolution using adaptive mixed-Gaussian models

In this paper we present a new algorithm to recover a sparse signal from a noisy register. The algorithm assumes a new prior distribution for the sparse signal that consists of a mixture of a narrow and a broad Gaussian both with zero mean. A penalty term which favors solutions driven from this model is added to the usual error cost function and the resultant global cost function is minimized by means of a gradient-type algorithm. A condition is derived for the step-size parameter in order to ensure convergence. In the paper we also propose a method (based on the Expectation-Maximization algorithm) to update the mixture parameters. The estimation of the sparse signal and the optimization of the Gaussian mixture are combined in the proposed algorithm: in each iteration a new signal estimate and a new model (which approximates the distribution of the new estimate) are obtained. In this way, the proposed method can be used without any statistical knowledge about the signal. Simulation experiments show that the accuracy of the proposed method is competitive with classical statistical detectors with a lower computational load.

[1]  José R. Casar,et al.  Adaptive iterative algorithms for spiky deconvolution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[2]  Stefano Alliney,et al.  An algorithm for the minimization of mixed l1 and l2 norms with application to Bayesian estimation , 1994, IEEE Trans. Signal Process..

[3]  H. L. Taylor,et al.  Deconvolution with the l 1 norm , 1979 .

[4]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[5]  X. Zhuang,et al.  Gaussian mixture density modeling of non-Gaussian source for autoregressive process , 1995, IEEE Trans. Signal Process..

[6]  Anthony N. Sinclair,et al.  Recovery of a sparse spike time series by L1 norm deconvolution , 1994, IEEE Trans. Signal Process..

[7]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[8]  Geoffrey E. Hinton,et al.  A soft decision-directed LMS algorithm for blind equalization , 1993, IEEE Trans. Commun..

[9]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[10]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[11]  Geoffrey E. Hinton,et al.  Simplifying Neural Networks by Soft Weight-Sharing , 1992, Neural Computation.

[12]  Jerry M. Mendel,et al.  Maximum-Likelihood Deconvolution , 1989 .

[13]  Marc Lavielle,et al.  Bayesian deconvolution of Bernoulli-Gaussian processes , 1993, Signal Process..