Decentralized detection and classification using kernel methods

We consider the problem of decentralized detection under constraints on the number of bits that can be transmitted by each sensor. In contrast to most previous work, in which the joint distribution of sensor observations is assumed to be known, we address the problem when only a set of empirical samples is available. We propose a novel algorithm using the framework of empirical risk minimization and marginalized kernels, and analyze its computational and statistical properties both theoretically and empirically. We provide an efficient implementation of the algorithm, and demonstrate its performance on both simulated and real data sets.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[4]  Saburou Saitoh,et al.  Theory of Reproducing Kernels and Its Applications , 1988 .

[5]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[6]  Kiyoshi Asai,et al.  Marginalized kernels for biological sequences , 2002, ISMB.

[7]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[10]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[11]  Sawasd Tantaratana,et al.  Nonparametric distributed detector using Wilcoxon statistics , 1997, Signal Process..

[12]  Thomas L. Marzetta,et al.  Detection, Estimation, and Modulation Theory , 1976 .

[13]  P. Massart Some applications of concentration inequalities to statistics , 2000 .

[14]  Nils Sandell,et al.  Detection with Distributed Sensors , 1980, IEEE Transactions on Aerospace and Electronic Systems.

[15]  P. Gänssler Weak Convergence and Empirical Processes - A. W. van der Vaart; J. A. Wellner. , 1997 .

[16]  R. Viswanathan,et al.  Distributed detection of a signal in generalized Gaussian noise , 1989, IEEE Trans. Acoust. Speech Signal Process..

[17]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[18]  H. Weinert Reproducing kernel Hilbert spaces: Applications in statistical signal processing , 1982 .

[19]  Michael I. Jordan,et al.  Convexity, Classification, and Risk Bounds , 2006 .

[20]  V. Koltchinskii,et al.  Empirical margin distributions and bounding the generalization error of combined classifiers , 2002, math/0405343.

[21]  P. Varshney,et al.  Some results on distributed nonparametric detection , 1990, 29th IEEE Conference on Decision and Control.

[22]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[23]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[24]  J. Davenport Editor , 1960 .

[25]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[26]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[27]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[28]  H. Vincent Poor,et al.  Detection of Stochastic Processes , 1998, IEEE Trans. Inf. Theory.

[29]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[30]  Emad K. Al-Hussaini,et al.  Decentralized CFAR signal detection , 1995, Signal Process..

[31]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[32]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992, 1992 American Control Conference.

[33]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[34]  Tong Zhang Statistical behavior and consistency of classification methods based on convex risk minimization , 2003 .

[35]  Thomas Kailath,et al.  RKHS approach to detection and estimation problems-I: Deterministic signals in Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[36]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[37]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory: Radar-Sonar Signal Processing and Gaussian Signals in Noise , 1992 .

[38]  J. Tsitsiklis Decentralized Detection' , 1993 .