A Parametric Copula-Based Framework for Hypothesis Testing Using Heterogeneous Data

We present a parametric framework for the joint processing of heterogeneous data, specifically for a binary classification problem. Processing such a data set is not straightforward as heterogeneous data may not be commensurate. In addition, the signals may also exhibit statistical dependence due to overlapping fields of view. We propose a copula-based solution to incorporate statistical dependence between disparate sources of information. The important problem of identifying the best copula for binary classification problems is also addressed. Computer simulation results are presented to demonstrate the feasibility of our approach. The method is also tested on real-data provided by the National Institute of Standards and Technology (NIST) for a multibiometric face recognition application. Finally, performance limits are derived to study the influence of statistical dependence on classification performance.

[1]  Jean-Philippe Thiran,et al.  Extraction of Audio Features Specific to Speech Production for Multimodal Speaker Detection , 2008, IEEE Transactions on Multimedia.

[2]  Nebojsa Jojic,et al.  A Graphical Model for Audiovisual Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yannick Berthoumieu,et al.  Copulas based multivariate gamma modeling for texture classification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[5]  Trevor Darrell,et al.  Speaker association with signal-level audiovisual fusion , 2004, IEEE Transactions on Multimedia.

[6]  B. Rémillard,et al.  Goodness-of-fit tests for copulas: A review and a power study , 2006 .

[7]  Gabriele Moser,et al.  Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Roger M. Cooke,et al.  Uncertainty Analysis with High Dimensional Dependence Modelling: Kurowicka/Uncertainty Analysis with High Dimensional Dependence Modelling , 2006 .

[9]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  C. Genest,et al.  Statistical Inference Procedures for Bivariate Archimedean Copulas , 1993 .

[11]  Eric Bouyé,et al.  Copulas for Finance - A Reading Guide and Some Applications , 2000 .

[12]  Luca Benini,et al.  An integrated multi-modal sensor network for video surveillance , 2005, VSSN '05.

[13]  Krzysztof Kryszczuk,et al.  Impact of feature correlations on separation between bivariate normal distributions , 2008, 2008 19th International Conference on Pattern Recognition.

[14]  Jean-Philippe Thiran,et al.  From error probability to information theoretic (multi-modal) signal processing , 2005, Signal Process..

[15]  J. Hurtado Structural Reliability: Statistical Learning Perspectives , 2004 .

[16]  Thierry Pun,et al.  Analysis of multimodal binary detection systems based on dependent/independent modalities , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[17]  Collin Carbno,et al.  Uncertainty Analysis With High Dimensional Dependence Modelling , 2007, Technometrics.

[18]  S. Kotz,et al.  Correlation and dependence , 2001 .

[19]  Salah Bourennane,et al.  Pearson-based mixture model for color object tracking , 2008, Machine Vision and Applications.

[20]  Nicolas Brunel,et al.  Copulas in vectorial hidden Markov chains for multicomponent image segmentation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[21]  Yong Rui,et al.  Better proposal distributions: object tracking using unscented particle filter , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  J. Copas,et al.  Interpreting Kullback-Leibler divergence with the Neyman-Pearson lemma , 2006 .

[23]  Michael I. Jordan Learning in Graphical Models , 1999, NATO ASI Series.

[24]  P.K. Varshney,et al.  On the Detection of Footsteps Based on Acoustic and Seismic Sensing , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[25]  Stéphane Marchand-Maillet,et al.  Can feature information interaction help for information fusion in multimedia problems? , 2009, Multimedia Tools and Applications.

[26]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[27]  Roger M. Cooke,et al.  Uncertainty Analysis with High Dimensional Dependence Modelling , 2006 .

[28]  Larry S. Davis,et al.  Look who's talking: speaker detection using video and audio correlation , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[29]  A. Simpson,et al.  What is the best index of detectability? , 1973, Psychological Bulletin.

[30]  Mehryar Mohri,et al.  AUC Optimization vs. Error Rate Minimization , 2003, NIPS.

[31]  C. Genest,et al.  Detecting Dependence With Kendall Plots , 2003 .

[32]  Michael Elad,et al.  Pixels that sound , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Alfred O. Hero,et al.  High-rate vector quantization for detection , 2003, IEEE Trans. Inf. Theory.

[34]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[35]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[36]  Samy Bengio,et al.  How do correlation and variance of base-experts affect fusion in biometric authentication tasks? , 2005, IEEE Transactions on Signal Processing.

[37]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[38]  H. Joe,et al.  The Estimation Method of Inference Functions for Margins for Multivariate Models , 1996 .

[39]  A. Murat Tekalp,et al.  Lip feature extraction based on audio-visual correlation , 2005, 2005 13th European Signal Processing Conference.

[40]  H. Chernoff LARGE-SAMPLE THEORY: PARAMETRIC CASE' , 1956 .

[41]  Anil K. Jain,et al.  A Principled Approach to Score Level Fusion in Multimodal Biometric Systems , 2005, AVBPA.