Interpolation of signals with missing data using Principal Component Analysis

A non-iterative methodology for the interpolation and regularization of multidimensional sampled signals with missing data resorting to Principal Component Analysis (PCA) is introduced. Based on unbiased sub-optimal estimators for the mean and covariance of signals corrupted by zero-mean noise, the PCA is performed and the signals are interpolated and regularized. The optimal solution is obtained from a weighted least mean square minimization problem, and upper and lower bounds are provided for the mean square interpolation error. This solution is a refinement to a previously introduced method proposed by the author Oliveira (Proceedings of the IEEE international conference on acoustics, speech, and signal processing—ICASSP06, Toulouse, France, 2006), where three extensions are exploited: (i) mean substitution for covariance estimation, (ii) Tikhonov regularization method and, (iii) dynamic principal components selection. Performance assessment benchmarks relative to averaging, Papoulis-Gerchberg, and Power Factorization methods are included, given the results obtained from a series of Monte Carlo experiments with 1-D audio and 2-D image signals. Tight upper and lower bounds were observed, and improved performance was attained for the refined method. The generalization to multidimensional signals is immediate.

[1]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[2]  R. Gerchberg Super-resolution through Error Energy Reduction , 1974 .

[3]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[4]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[5]  Dan Schonfeld,et al.  Multi-Dimensional Image Reconstruction and Field Estimation from Randomly Scattered Sensors , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[6]  J. Benedetto,et al.  Modern Sampling Theory , 2012 .

[7]  Alfred Mertins,et al.  Signal Analysis: Wavelets, Filter Banks, Time-Frequency Transforms and Applications , 1999 .

[8]  C. Vogel Computational Methods for Inverse Problems , 1987 .

[9]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[10]  C. R. Subrahmanya,et al.  A new method of image restoration , 1975 .

[11]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[12]  Thomas Vetter,et al.  Reconstructing the Complete 3D Shape of Faces from Partial Information (Rekonstruktion der dreidimensionalen Form von Gesichtern aus partieller Information) , 2002, Informationstechnik Tech. Inform..

[13]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[14]  Hyeokho Choi,et al.  Analysis and design of minimax-optimal interpolators , 1998, IEEE Trans. Signal Process..

[15]  Yue Wang,et al.  On Nonuniform Sampling of Bandlimited Signals Associated with the Fractional Fourier Transform , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[16]  Carlos Silvestre,et al.  MARIUS: an autonomous underwater vehicle for coastal oceanography , 1997, IEEE Robotics Autom. Mag..

[17]  Paulo Oliveira,et al.  MMAE terrain reference navigation for underwater vehicles using PCA , 2007, Int. J. Control.

[18]  J. Benedetto,et al.  Modern Sampling Theory: Mathematics and Applications , 2012 .

[19]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[20]  Jan P. Allebach,et al.  Iterative reconstruction of bandlimited images from nonuniformly spaced samples , 1987 .

[21]  Paulo Oliveira,et al.  Interpolation of Signals with Missing Data Using PCA , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[22]  K. Gröchenig RECONSTRUCTION ALGORITHMS IN IRREGULAR SAMPLING , 1992 .

[23]  A. Papoulis A new algorithm in spectral analysis and band-limited extrapolation. , 1975 .

[24]  K.R. Rao,et al.  Error concealment for video transmission using adaptive principal component analysis with missing data , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.

[25]  J. Yen On Nonuniform Sampling of Bandwidth-Limited Signals , 1956 .

[26]  Andrew W. Fitzgibbon,et al.  Damped Newton algorithms for matrix factorization with missing data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  I. Jolliffe Principal Component Analysis , 2002 .

[28]  A. Tikhonov,et al.  Numerical Methods for the Solution of Ill-Posed Problems , 1995 .

[29]  Harry Shum,et al.  Principal Component Analysis with Missing Data and Its Application to Polyhedral Object Modeling , 1995, IEEE Trans. Pattern Anal. Mach. Intell..