Generalized smoothing splines and the optimal discretization of the Wiener filter

We introduce an extended class of cardinal L/sup */L-splines, where L is a pseudo-differential operator satisfying some admissibility conditions. We show that the L/sup */L-spline signal interpolation problem is well posed and that its solution is the unique minimizer of the spline energy functional /spl par/Ls/spl par//sub L2//sup 2/, subject to the interpolation constraint. Next, we consider the corresponding regularized least squares estimation problem, which is more appropriate for dealing with noisy data. The criterion to be minimized is the sum of a quadratic data term, which forces the solution to be close to the input samples, and a "smoothness" term that privileges solutions with small spline energies. Here, too, we find that the optimal solution, among all possible functions, is a cardinal L/sup */L-spline. We show that this smoothing spline estimator has a stable representation in a B-spline-like basis and that its coefficients can be computed by digital filtering of the input signal. We describe an efficient recursive filtering algorithm that is applicable whenever the transfer function of L is rational (which corresponds to the case of exponential splines). We justify these algorithms statistically by establishing an equivalence between L/sup */L smoothing splines and the minimum mean square error (MMSE) estimation of a stationary signal corrupted by white Gaussian noise. In this model-based formulation, the optimum operator L is the whitening filter of the process, and the regularization parameter is proportional to the noise variance. Thus, the proposed formalism yields the optimal discretization of the classical Wiener filter, together with a fast recursive algorithm. It extends the standard Wiener solution by providing the optimal interpolation space. We also present a Bayesian interpretation of the algorithm.

[1]  I. J. Schoenberg Contributions to the problem of approximation of equidistant data by analytic functions. Part A. On the problem of smoothing or graduation. A first class of analytic approximation formulae , 1946 .

[2]  I. J. Schoenberg Contributions to the problem of approximation of equidistant data by analytic functions. Part B. On the problem of osculatory interpolation. A second class of analytic approximation formulae , 1946 .

[3]  I. J. Schoenberg,et al.  SPLINE FUNCTIONS AND THE PROBLEM OF GRADUATION , 1964 .

[4]  C. D. Boor,et al.  On splines and their minimum properties , 1966 .

[5]  D. Schweikert An Interpolation Curve Using a Spline in Tension , 1966 .

[6]  C. Reinsch Smoothing by spline functions , 1967 .

[7]  J. L. Walsh,et al.  The theory of splines and their applications , 1969 .

[8]  Y. Katznelson An Introduction to Harmonic Analysis: Interpolation of Linear Operators , 1968 .

[9]  G. Wahba,et al.  SPLINE FUNCTIONS AND STOCHASTIC PROCESSES. , 1969 .

[10]  G. Wahba,et al.  A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines , 1970 .

[11]  G. Matheron The intrinsic random functions and their applications , 1973, Advances in Applied Probability.

[12]  P. M. Prenter Splines and variational methods , 1975 .

[13]  Jean Duchon,et al.  Splines minimizing rotation-invariant semi-norms in Sobolev spaces , 1976, Constructive Theory of Functions of Several Variables.

[14]  Gursharan S. Sidhu,et al.  A stochastic framework for recursive computation of spline functions-Part I: Interpolating splines , 1978, IEEE Trans. Inf. Theory.

[15]  J. Meinguet Multivariate interpolation at arbitrary points made simple , 1979 .

[16]  R. Byrd,et al.  A stochastic framework for recursive computation of spline functions: Part II, smoothing splines , 1980 .

[17]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[18]  C. Micchelli Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .

[19]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[20]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[21]  Gilles Deslauriers,et al.  Symmetric iterative interpolation processes , 1989 .

[22]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[23]  Anastasios N. Venetsanopoulos,et al.  Regularization theory in image restoration-the stabilizing functional approach , 1990, IEEE Trans. Acoust. Speech Signal Process..

[24]  D. Myers Kriging, cokriging, radial basis functions and the role of positive definiteness , 1992 .

[25]  Akram Aldroubi,et al.  B-spline signal processing. II. Efficiency design and applications , 1993, IEEE Trans. Signal Process..

[26]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART II-EFFICIENT DESIGN AND APPLICATIONS , 1993 .

[27]  D. Cox An Analysis of Bayesian Inference for Nonparametric Regression , 1993 .

[28]  Rutuparna Panda,et al.  Generalized B-spline signal processing , 1996, Signal Process..

[29]  B. P. Lathi Signal Processing And Linear Systems , 1998 .

[30]  R. Eubank Nonparametric Regression and Spline Smoothing , 1999 .

[31]  Thierry Blu,et al.  Fractional Splines and Wavelets , 2000, SIAM Rev..

[32]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[33]  Jean-Paul Chilbs,et al.  Geostatistics , 2000, Technometrics.

[34]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[35]  Thierry Blu,et al.  Wavelets, fractals, and radial basis functions , 2002, IEEE Trans. Signal Process..

[36]  Michael Unser Cardinal exponential splines: part II - think analog, act digital , 2005, IEEE Transactions on Signal Processing.

[37]  Thierry Blu,et al.  Cardinal exponential splines: part I - theory and filtering algorithms , 2005, IEEE Transactions on Signal Processing.

[38]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[39]  Maria Huhtala,et al.  Random Variables and Stochastic Processes , 2021, Matrix and Tensor Decompositions in Signal Processing.