Multiple-Instance Hidden Markov Models With Applications to Landmine Detection

A novel multiple-instance hidden Markov model (MI-HMM) is introduced for classification of time-series data, and its training is developed using stochastic expectation maximization. The MI-HMM provides a single statistical form to learn the parameters of an HMM in a multiple-instance learning framework without introducing any additional parameters. The efficacy of the model is shown both on synthetic data and on a real landmine data set. Experiments on both the synthetic data and the landmine data set show that an MI-HMM can achieve statistically significant performance gains when compared with the best existing HMM for the landmine detection problem, eliminate the ad hoc approaches in training set selection, and introduce a principled way to work with ambiguous time-series data.

[1]  Paul D. Gader,et al.  Cross Entropy Optimization of the Random Set Framework for Multiple Instance Learning , 2010, 2010 20th International Conference on Pattern Recognition.

[2]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[3]  James M. Rehg,et al.  Learning to recognize objects in egocentric activities , 2011, CVPR 2011.

[4]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[5]  Mark Johnson,et al.  Why Doesn’t EM Find Good HMM POS-Taggers? , 2007, EMNLP.

[6]  Paul D. Gader,et al.  Landmine detection with Multiple Instance Hidden Markov Models , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[7]  Zhi-Hua Zhou Multi-Instance Learning : A Survey , 2004 .

[8]  Gozde Bozdagi Akar,et al.  Fusion of forward-looking infrared camera and down-looking ground penetrating radar for buried target detection , 2015, Defense + Security Symposium.

[9]  Kristin P. Bennett,et al.  Fast Bundle Algorithm for Multiple-Instance Learning , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Qi Zhang,et al.  Content-Based Image Retrieval Using Multiple-Instance Learning , 2002, ICML.

[11]  Paul D. Gader,et al.  Real-Time Landmine Detection with Ground-Penetrating Radar Using Discriminative and Adaptive Hidden Markov Models , 2005, EURASIP J. Adv. Signal Process..

[12]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  S. L. Scott Bayesian Methods for Hidden Markov Models , 2002 .

[14]  Paul D. Gader,et al.  Generalized hidden Markov models. I. Theoretical frameworks , 2000, IEEE Trans. Fuzzy Syst..

[15]  William H. Majoros Methods for Computational Gene Prediction: Generalized hidden Markov models , 2007 .

[16]  Ping Chen,et al.  Training DHMMs of mine and clutter to minimize landmine detection errors , 2003, IEEE Trans. Geosci. Remote. Sens..

[17]  Paul D. Gader,et al.  A linear prediction land mine detection algorithm for hand held ground penetrating radar , 2002, IEEE Trans. Geosci. Remote. Sens..

[18]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[19]  Paul D. Gader,et al.  Landmine detection with ground penetrating radar using hidden Markov models , 2001, IEEE Trans. Geosci. Remote. Sens..

[20]  Paul D. Gader,et al.  Land-Mine Detection With Ground-Penetrating Radar Using Multistream Discrete Hidden Markov Models , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Paul D. Gader,et al.  Minimum Classification Error Training for Choquet Integrals With Applications to Landmine Detection , 2008, IEEE Transactions on Fuzzy Systems.

[22]  S. Eddy Hidden Markov models. , 1996, Current opinion in structural biology.

[23]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[24]  Biing-Hwang Juang,et al.  Minimum classification error rate methods for speech recognition , 1997, IEEE Trans. Speech Audio Process..

[25]  Jordan L. Boyd-Graber,et al.  Dirichlet Mixtures, the Dirichlet Process, and the Structure of Protein Space , 2013, J. Comput. Biol..

[26]  Paul D. Gader,et al.  Random set framework for multiple instance learning , 2011, Inf. Sci..

[27]  Peter A. Torrione,et al.  Application of the LMC algorithm to anomaly detection using the Wichmann/NIITEK ground-penetrating radar , 2003, SPIE Defense + Commercial Sensing.

[28]  Paul D. Gader,et al.  A New Learning Method for Continuous Hidden Markov Models for Subsurface Landmine Detection in Ground Penetrating Radar , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[30]  Paul D. Gader,et al.  Mixture of HMM Experts with applications to landmine detection , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[31]  Paul Gader,et al.  Simultaneous feature and HMM Model learning for landmine detection using Ground Penetrating Radar , 2010, 2010 IAPR Workshop on Pattern Recognition in Remote Sensing.

[32]  Paul D. Gader,et al.  Fuzzy spatial pattern processing using linguistic hidden Markov models , 2006, IEEE Transactions on Fuzzy Systems.

[33]  Lawrence Carin,et al.  Hidden Markov Models With Stick-Breaking Priors , 2009, IEEE Transactions on Signal Processing.

[34]  David Haussler,et al.  Dirichlet mixtures: a method for improved detection of weak but significant protein sequence homology , 1996, Comput. Appl. Biosci..

[35]  Paul D. Gader,et al.  Context-Dependent Multisensor Fusion and Its Application to Land Mine Detection , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Mubarak Shah,et al.  Human Action Recognition in Videos Using Kinematic Features and Multiple Instance Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  James T. Kwok,et al.  Online multiple instance learning with no regret , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Paul D. Gader,et al.  Variational Mixture of Experts for Classification with Applications to Landmine Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[39]  Murat Dundar,et al.  Bayesian multiple instance learning: automatic feature selection and inductive transfer , 2008, ICML '08.

[40]  Leslie M. Collins,et al.  Application of Markov random fields to landmine detection in ground penetrating radar data , 2008, SPIE Defense + Commercial Sensing.

[41]  P.A. Torrione,et al.  Performance of an adaptive feature-based processor for a wideband ground penetrating radar system , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[42]  Joseph N. Wilson,et al.  A Large-Scale Systematic Evaluation of Algorithms Using Ground-Penetrating Radar for Landmine Detection and Discrimination , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[44]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[45]  Joseph N. Wilson,et al.  Detecting landmines with ground-penetrating radar using feature-based rules, order statistics, and adaptive whitening , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Zhiquan Qi,et al.  Online multiple instance boosting for object detection , 2011, Neurocomputing.

[47]  Alain Biem,et al.  Minimum classification error training for online handwriting recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Paul D. Gader,et al.  Generalized hidden Markov models. II. Application to handwritten word recognition , 2000, IEEE Trans. Fuzzy Syst..

[49]  Joseph N. Wilson,et al.  An evaluation of several fusion algorithms for anti-tank landmine detection and discrimination , 2012, Inf. Fusion.

[50]  Joseph N. Wilson,et al.  Hierarchical Methods for Landmine Detection with Wideband Electro-Magnetic Induction and Ground Penetrating Radar Multi-Sensor Systems , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[51]  Thomas L. Griffiths,et al.  A fully Bayesian approach to unsupervised part-of-speech tagging , 2007, ACL.

[52]  Paul D. Gader,et al.  Detection and Discrimination of Land Mines in Ground-Penetrating Radar Based on Edge Histogram Descriptors and a Possibilistic $K$-Nearest Neighbor Classifier , 2009, IEEE Transactions on Fuzzy Systems.

[53]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[54]  Jun Yang Review of Multi-Instance Learning and Its applications , 2005 .

[55]  Petar M. Djuric,et al.  An MCMC sampling approach to estimation of nonstationary hidden Markov models , 2002, IEEE Trans. Signal Process..

[56]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[57]  Zhi-Hua Zhou,et al.  Multi-instance multi-label learning , 2008, Artif. Intell..