Numerical Evaluation of Reproducing Kernel Hilbert Space Inner Products

A new approach to numerically evaluate an inner product or a norm in an arbitrary reproducing kernel Hilbert space (RKHS) is considered. The proposed methodology enables us to approximate the RKHS inner product with the desired accuracy avoiding analytical expressions. Furthermore, its implementation is illustrated by means of some classic examples and compared with the standard iterative method provided by Weiner for this purpose. Finally, applications in both the problem of representing approximately second-order stochastic processes by means of series expansions and in the problem of signal detection are studied.

[1]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[2]  H. Vincent Poor,et al.  Detection of Stochastic Processes , 1998, IEEE Trans. Inf. Theory.

[3]  Stamatis Cambanis,et al.  Representation of Stochastic Processes of Second Order and Linear Operations , 1973 .

[4]  Haobo Ren.  Functional inverse regression and reproducing kernel Hilbert space , 2006 .

[5]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[6]  E. Parzen.  Extraction and Detection Problems and Reproducing Kernel Hilbert Spaces , 1962 .

[7]  K. Phoon,et al.  Implementation of Karhunen-Loeve expansion for simulation using a wavelet-Galerkin scheme , 2002 .

[8]  R. Gray,et al.  Product code vector quantizers for waveform and voice coding , 1984 .

[9]  Jon Hamkins,et al.  Gaussian source coding with spherical codes , 2002, IEEE Trans. Inf. Theory.

[10]  Thomas Kailath,et al.  An RKHS approach to detection and estimation problems- III: Generalized innovations representations and a likelihood-ratio formula , 1972, IEEE Trans. Inf. Theory.

[11]  P. Noll,et al.  Bounds on Quantizer Performance in the Low Bit-Rate Region , 1978, IEEE Trans. Commun..

[12]  Joseph F. Traub,et al.  Complexity and information , 1999, Lezioni Lincee.

[13]  Thomas Kailath,et al.  An RKHS approach to detection and estimation problems-II: Gaussian signal detection , 1975, IEEE Trans. Inf. Theory.

[14]  Milan Lukić,et al.  Stochastic processes with sample paths in reproducing kernel Hilbert spaces , 2001 .

[15]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[16]  H. Vincent Poor,et al.  On generalized signal-to-noise ratios in quadratic detection , 1992, Math. Control. Signals Syst..

[17]  Ronald Cools,et al.  Advances in multidimensional integration , 2002 .

[18]  Luca Gemignani,et al.  Iteration schemes for the divide-and-conquer eigenvalue solver , 1994 .

[19]  Thomas Kailath,et al.  Some relations among RKHS norms, Fredholm equations, and innovations representations , 1972, IEEE Trans. Inf. Theory.

[20]  H. Weiner.  The Gradient Iteration in Time Series Analysis , 1965 .

[21]  Thomas Kailath,et al.  RKHS approach to detection and estimation problems-I: Deterministic signals in Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[22]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[23]  M. Salehi,et al.  Multistage trellis coded quantisation (MS-TCQ) design and performance , 1997 .

[24]  Guanrong Chen,et al.  Approximate Solutions of Operator Equations , 1997 .

[25]  Hamid Jafarkhani,et al.  Design of successively refinable trellis-coded quantizers , 1999, IEEE Trans. Inf. Theory.

[26]  A. Berlinet,et al.  Reproducing kernel Hilbert spaces in probability and statistics , 2004 .

[27]  David J. Sakrison,et al.  A geometric treatment of the source encoding of a Gaussian random variable , 1968, IEEE Trans. Inf. Theory.

[28]  Sanjit K. Mitra,et al.  Successive refinement lattice vector quantization , 2002, IEEE Trans. Image Process..

[29]  Jerry D. Gibson,et al.  Uniform and piecewise uniform lattice vector quantization for memoryless Gaussian and Laplacian sources , 1993, IEEE Trans. Inf. Theory.