Variational Gaussian process for sensor fusion

In this paper, we introduce a new Gaussian Process (GP) classification method for multisensory data. The proposed approach can deal with noisy and missing data. It is also capable of estimating the contribution of each sensor towards the classification task. We use Bayesian modeling to build a GP-based classifier which combines the information provided by all sensors and approximates the posterior distribution of the GP using variational Bayesian inference. During its training phase, the algorithm estimates each sensor's weight and then uses this information to assign a label to each new sample. In the experimental section, we evaluate the classiication performance of the proposed method on both synthetic and real data and show its applicability to different scenarios.

[1]  Ashish Kapoor,et al.  Mixture of Gaussian Processes for Combining Multiple Modalities , 2005, Multiple Classifier Systems.

[2]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[3]  Luis Gómez-Chova,et al.  Urban monitoring using multi-temporal SAR and multi-spectral data , 2006, Pattern Recognit. Lett..

[4]  Lucia Specia,et al.  Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation , 2013, ACL.

[5]  S Roberts,et al.  Gaussian processes for time-series modelling , 2013, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[7]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[8]  Bernardete Ribeiro,et al.  Gaussian Process Classification and Active Learning with Multiple Annotators , 2014, ICML.

[9]  Carl E. Rasmussen,et al.  Additive Gaussian Processes , 2011, NIPS.

[10]  David B. Dunson,et al.  Multiresolution Gaussian Processes , 2012, NIPS.

[11]  Ieee Staff 2017 25th European Signal Processing Conference (EUSIPCO) , 2017 .

[12]  Mark Girolami Bayesian Data Fusion with Gaussian Process Priors : An Application to Protein Fold Recognition ? , 2006 .

[13]  Mark W. Woolrich,et al.  Linked independent component analysis for multimodal data fusion , 2011, NeuroImage.

[14]  Marcos P. Gerardo-Castro,et al.  Robust multiple-sensing-modality data fusion using Gaussian Process Implicit Surfaces , 2014, 17th International Conference on Information Fusion (FUSION).