SPLINES : A PERFECT FIT FOR SIGNAL / IMAGE PROCESSING

1. INTRODUCTION Finding a general mechanism for switching between the continuous and discrete signal domains is one of the fundamental issues in signal processing. It is a question that arises naturally during the acquisition process where an analog signal or an image is to be converted into a sequence of numbers (discrete representation). Conversely, the need for a continuous signal representation comes up every time one wishes to implement numerically an operator that is initially defined in the continuous domain. Typical examples in image processing are the detection of edges through the computation of gradients (spatial derivatives), and geometric transformations such as rotations and scaling (interpolation). The textbook approach to those problems is provided by Shannon's sampling theory which describes an equivalence between a bandlimited function and its equidistant samples taken at a frequency that is superior or equal to the Nyquist rate [76]. Even though this theory has had an enormous impact on the field, it has a number of problems associated with it. First, it relies on the use of ideal filters which are devices not commonly found in nature. Second, the bandlimited hypothesis is in contradiction with the idea of a finite (or finite duration) signal. Third, the bandlimiting operation tends to generate Gibbs oscillations which can be visually disturbing in images. Lastly, the underlying cardinal basis function (sinc(x)) has a very slow decay which makes computations in the signal domain very inefficient. While the first two problems can be dealt with by using approximations and introducing concepts such as an essential bandwidth and an essential time duration [78], there is no way to address the last two issues other than changing basis functions. Our purpose here will be to provide arguments in favor of an alternative approach that uses splines, which is equally justifiable on a theoretical basis, and which offers many practical advantages. To reassure the reader who may be afraid to enter new territory, we must emphasize that we are not loosing anything because we will retain the traditional theory as a particular case (i.e., a spline of infinite degree). The basic computational tools will also be familiar to a signal processing audience (filters and recursive algorithms), even though-2-their use in the present context is less conventional. In the course of the presentation, we will also bring out the connection with the multiresolution theory of the wavelet transform. Interestingly, splines are slightly older than …

[1]  A. Haar Zur Theorie der orthogonalen Funktionensysteme , 1910 .

[2]  I J Schoenberg,et al.  SPLINE FUNCTIONS AND THE PROBLEM OF GRADUATION. , 1964, Proceedings of the National Academy of Sciences of the United States of America.

[3]  C. Reinsch Smoothing by spline functions , 1967 .

[4]  J. L. Walsh,et al.  The theory of splines and their applications , 1969 .

[5]  C. D. Boor,et al.  On Calculating B-splines , 1972 .

[6]  I. J. Schoenberg Notes on spline functions III: On the convergence of the interpolating cardinal splines as their degree tends to infinity , 1973 .

[7]  P. M. Prenter Splines and variational methods , 1975 .

[8]  D. Slepian,et al.  On bandwidth , 1976, Proceedings of the IEEE.

[9]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[10]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[11]  L. Schumaker Spline Functions: Basic Theory , 1981 .

[12]  J. A. Parker,et al.  Comparison of Interpolating Methods for Image Resampling , 1983, IEEE Transactions on Medical Imaging.

[13]  R. Hummel Sampling for Spline Reconstruction , 1983 .

[14]  I. W. Wright Splines in Statistics , 1983 .

[15]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[16]  R. L. Eubank,et al.  Approximate regression models and splines , 1984 .

[17]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[18]  Klaus Höllig,et al.  Bivariate cardinal interpolation by splines on a three-direction mesh , 1985 .

[19]  Alan W. Paeth,et al.  A fast algorithm for general raster rotation , 1986 .

[20]  Peter Lancaster,et al.  Curve and surface fitting - an introduction , 1986 .

[21]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Carl de Boor,et al.  The polynomials in the linear span of integer translates of a compactly supported function , 1987 .

[23]  G. Battle A block spin construction of ondelettes. Part I: Lemarié functions , 1987 .

[24]  Alan L. Yuille,et al.  A regularized solution to edge detection , 1985, J. Complex..

[25]  Masaru Kamada,et al.  Two-dimensional spline interpolation for image reconstruction , 1988, Pattern Recognit..

[26]  I. J. Schoenberg Contributions to the Problem of Approximation of Equidistant Data by Analytic Functions , 1988 .

[27]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Gilbert Strang,et al.  Wavelets and Dilation Equations: A Brief Introduction , 1989, SIAM Rev..

[29]  S. Mallat Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[30]  Fuhua Cheng,et al.  B-spline curves and surfaces viewed as digital filters , 1990, Comput. Vis. Graph. Image Process..

[31]  G. Wahba Spline models for observational data , 1990 .

[32]  Martin Vetterli,et al.  Interpolative multiresolution coding of advance television with compatible subchannels , 1991, IEEE Trans. Circuits Syst. Video Technol..

[33]  Y. Meyer,et al.  Wavelets and Filter Banks , 1991 .

[34]  Michael Unser,et al.  Fast B-spline Transforms for Continuous Image Representation and Interpolation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[36]  Olivier Rioul,et al.  Fast algorithms for discrete and continuous wavelet transforms , 1992, IEEE Trans. Inf. Theory.

[37]  C. Chui,et al.  On compactly supported spline wavelets and a duality principle , 1992 .

[38]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[39]  Martin Vetterli,et al.  Wavelets and filter banks: theory and design , 1992, IEEE Trans. Signal Process..

[40]  Michael Unser,et al.  Cardinal spline filters: Stability and convergence to the ideal sinc interpolator , 1992, Signal Process..

[41]  Michael Unser,et al.  On the asymptotic convergence of B-spline wavelets to Gabor functions , 1992, IEEE Trans. Inf. Theory.

[42]  Michael Unser,et al.  Polynomial spline signal approximations: Filter design and asymptotic equivalence with Shannon's sampling theorem , 1992, IEEE Trans. Inf. Theory.

[43]  Dennis M. Healy,et al.  Two applications of wavelet transforms in magnetic resonance imaging , 1992, IEEE Trans. Inf. Theory.

[44]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Michael Unser,et al.  An improved least squares Laplacian pyramid for image compression , 1992, Signal Process..

[46]  J. Weaver,et al.  Wavelet‐encoded MR imaging , 1992, Magnetic resonance in medicine.

[47]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[48]  Michael Unser,et al.  The L2-Polynomial Spline Pyramid , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  A. Aldroubi,et al.  Families of multiresolution and wavelet spaces with optimal properties , 1993 .

[50]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART II-EFFICIENT DESIGN AND APPLICATIONS , 1993 .

[51]  R. Jia,et al.  Approximation by multiinteger translates of functions having global support , 1993 .

[52]  A. Aldroubi,et al.  Polynomial splines and wavelets: a signal processing perspective , 1993 .

[53]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[54]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .

[55]  Michael Unser,et al.  A family of polynomial spline wavelet transforms , 1993, Signal Process..

[56]  M. Eden,et al.  Discrete spline filters for multiresolutions and wavelets of l 2 , 1994 .

[57]  A. Aldroubi,et al.  Sampling procedures in function spaces and asymptotic equivalence with shannon's sampling theory , 1994 .

[58]  L. A. Ferrari,et al.  B-spline FIR filters , 1994 .

[59]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[60]  W. Sweldens,et al.  Asymptotic error expansion of wavelet approximations of smooth functions II , 1994 .

[61]  Michael Unser,et al.  Fast implementation of the continuous wavelet transform with integer scales , 1994, IEEE Trans. Signal Process..

[62]  Michael Unser,et al.  Convolution-based interpolation for fast, high-quality rotation of images , 1995, IEEE Trans. Image Process..

[63]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[64]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[65]  A. Aldroubi,et al.  Designing Multiresolution Analysis-type Wavelets and Their Fast Algorithms , 1995 .

[66]  Zhengwei Yang,et al.  Invariant matching and identification of curves using B-splines curve representation , 1995, IEEE Trans. Image Process..

[67]  Pierre Moulin,et al.  A multiscale relaxation algorithm for SNR maximization in nonorthogonal subband coding , 1995, IEEE Trans. Image Process..

[68]  Michael Unser,et al.  Enlargement or reduction of digital images with minimum loss of information , 1995, IEEE Trans. Image Process..

[69]  Masaru Kamada,et al.  A smooth signal generator based on quadratic B-spline functions , 1995, IEEE Trans. Signal Process..

[70]  Bernd Menser,et al.  Embedded Laplacian pyramid image coding using conditional arithmetic coding , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[71]  Jorge L. C. Sanz,et al.  Periodic quasi-orthogonal spline bases and applications to least-squares curve fitting of digital images , 1996, IEEE Trans. Image Process..

[72]  Michael Unser,et al.  Comparison of algorithms for the fast computation of the continuous wavelet transform , 1996, Optics & Photonics.

[73]  Masaru Kamada,et al.  Quadratic spline interpolator , 1996, Int. J. Syst. Sci..

[74]  Paul Dierckx,et al.  Curve and surface fitting with splines , 1994, Monographs on numerical analysis.

[75]  Michael Unser Approximation power of biorthogonal wavelet expansions , 1996, IEEE Trans. Signal Process..

[76]  Zhaohui Huang,et al.  Affine-invariant B-spline moments for curve matching , 1996, IEEE Trans. Image Process..

[77]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[78]  Michael Unser,et al.  Shift-orthogonal wavelet bases using splines , 1996, IEEE Signal Processing Letters.

[79]  A. Aldroubi Oblique projections in atomic spaces , 1996 .

[80]  Frank Müller,et al.  Scalable video coding at very low bit rates employing resolution pyramids , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[81]  D. Weinberger,et al.  Analysis of interpolation effects in the reslicing of functional MR images. , 1997, Journal of computer assisted tomography.

[82]  Michael Unser,et al.  Rapid computation of the continuous wavelet transform by oblique projections , 1997, IEEE Trans. Signal Process..

[83]  Pierre Moulin,et al.  Multiscale modeling and estimation of motion fields for video coding , 1997, IEEE Trans. Image Process..

[84]  Michael Unser,et al.  Generalized sampling without bandlimiting constraints , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[85]  Michael Unser,et al.  On the approximation power of convolution-based least squares versus interpolation , 1997, IEEE Trans. Signal Process..

[86]  Michael Unser,et al.  SEPARABLE LEAST-SQUARES DECOMPOSITION OF AFFINE TRANSFORMATIONS , 1997 .

[87]  Thierry BLUzAbstract SIMPLE REGULARITY CRITERIA FOR SUBDIVISION SCHEMES , 1997 .

[88]  Michael Unser,et al.  Fast continuous wavelet transform: A least-squares formulation , 1997, Signal Process..

[89]  Michael Unser,et al.  Ten good reasons for using spline wavelets , 1997, Optics & Photonics.

[90]  Michael Unser,et al.  High-quality image resizing using oblique projection operators , 1998, IEEE Trans. Image Process..

[91]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[92]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[93]  Michael Unser,et al.  Multiresolution approximation using shifted splines , 1998, IEEE Trans. Signal Process..

[94]  Aggelos K. Katsaggelos,et al.  Operationally optimal vertex-based shape coding , 1998 .

[95]  Aggelos K. Katsaggelos,et al.  MPEG-4 and rate-distortion-based shape-coding techniques , 1998, Proc. IEEE.

[96]  Thierry Blu,et al.  Minimum support interpolators with optimum approximation properties , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[97]  S. Mallat A wavelet tour of signal processing , 1998 .

[98]  Michael Unser,et al.  Centered pyramids , 1999, IEEE Trans. Image Process..

[99]  Thierry Blu,et al.  Quantitative Fourier Analysis of Approximation Techniques : Part I — Interpolators and Projectors , 1999 .

[100]  M. Unser,et al.  Quantitative Fourier Analysis of Approximation Techniques : Part II — Wavelets , 1999 .

[101]  M. Unser,et al.  Approximation Error for Quasi-Interpolators and (Multi-)Wavelet Expansions , 1999 .

[102]  Thierry Blu,et al.  Fractional Splines and Wavelets , 2000, SIAM Rev..

[103]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[104]  Michael Unser,et al.  B-spline snakes: a flexible tool for parametric contour detection , 2000, IEEE Trans. Image Process..