Nonparametric decentralized detection using kernel methods

We consider the problem of decentralized detection under constraints on the number of bits that can be transmitted by each sensor. In contrast to most previous work, in which the joint distribution of sensor observations is assumed to be known, we address the problem when only a set of empirical samples is available. We propose a novel algorithm using the framework of empirical risk minimization and marginalized kernels and analyze its computational and statistical properties both theoretically and empirically. We provide an efficient implementation of the algorithm and demonstrate its performance on both simulated and real data sets.

[1]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[2]  J. Davenport Editor , 1960 .

[3]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[4]  Thomas Kailath,et al.  RKHS approach to detection and estimation problems-I: Deterministic signals in Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[5]  Thomas L. Marzetta,et al.  Detection, Estimation, and Modulation Theory , 1976 .

[6]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[7]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[8]  Nils Sandell,et al.  Detection with Distributed Sensors , 1980, IEEE Transactions on Aerospace and Electronic Systems.

[9]  H. Weinert Reproducing kernel Hilbert spaces: Applications in statistical signal processing , 1982 .

[10]  S. Kassam Nonparametric Hard Limiting and Sign Detection of Narrow-Band Deterministic and Random Signals , 1987 .

[11]  Saburou Saitoh,et al.  Theory of Reproducing Kernels and Its Applications , 1988 .

[12]  R. Viswanathan,et al.  Distributed detection of a signal in generalized Gaussian noise , 1989, IEEE Trans. Acoust. Speech Signal Process..

[13]  P. Varshney,et al.  Some results on distributed nonparametric detection , 1990, 29th IEEE Conference on Decision and Control.

[14]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992, 1992 American Control Conference.

[15]  J. Tsitsiklis Decentralized Detection' , 1993 .

[16]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[17]  Emad K. Al-Hussaini,et al.  Decentralized CFAR signal detection , 1995, Signal Process..

[18]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[19]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[20]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[21]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[22]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[23]  Sawasd Tantaratana,et al.  Nonparametric distributed detector using Wilcoxon statistics , 1997, Signal Process..

[24]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[25]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[26]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[27]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[28]  P. Massart Some applications of concentration inequalities to statistics , 2000 .

[29]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[30]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[31]  Kiyoshi Asai,et al.  Marginalized kernels for biological sequences , 2002, ISMB.

[32]  V. Koltchinskii,et al.  Empirical margin distributions and bounding the generalization error of combined classifiers , 2002, math/0405343.

[33]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[34]  Tong Zhang Statistical behavior and consistency of classification methods based on convex risk minimization , 2003 .

[35]  H. Vincent Poor,et al.  Consistency in Models for Communication Constrained Distributed Learning , 2004, COLT.

[36]  Baver Okutmustur Reproducing kernel Hilbert spaces , 2005 .

[37]  Michael I. Jordan,et al.  Convexity, Classification, and Risk Bounds , 2006 .