Subcategory Classifiers for Multiple-Instance Learning and Its Application to Retinal Nerve Fiber Layer Visibility Classification

We propose a novel multiple-instance learning (MIL) method to assess the visibility (visible/not visible) of the retinal nerve fiber layer (RNFL) in fundus camera images. Using only image-level labels, our approach learns to classify the images as well as to localize the RNFL visible regions. We transform the original feature space into a discriminative subspace, and learn a region-level classifier in that subspace. We propose a margin-based loss function to jointly learn this subspace and the region-level classifier. Experiments with an RNFL data set containing 884 images annotated by two ophthalmologists give a system-annotator agreement (kappa values) of 0.73 and 0.72, respectively, with an interannotator agreement of 0.73. Our system agrees better with the more experienced annotator. Comparative tests with three public data sets (MESSIDOR and DR for diabetic retinopathy, and UCSB for breast cancer) show that our novel MIL approach improves performance over the state of the art. Our MATLAB code is publicly available at https://github.com/ManiShiyam/Sub-category-classifiers-for-Multiple-Instance-Learning/wiki.

[1]  J. Jonas,et al.  Localised wedge shaped defects of the retinal nerve fibre layer in glaucoma. , 1994, The British journal of ophthalmology.

[2]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[3]  E Peli,et al.  Retinal nerve fiber layer abnormalities in Alzheimer's disease. , 2009, Acta ophthalmologica Scandinavica.

[4]  Paul A. Viola,et al.  Multiple Instance Boosting for Object Detection , 2005, NIPS.

[5]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[6]  Marian Stewart Bartlett,et al.  Joint Clustering and Classification for Multiple Instance Learning , 2015, BMVC.

[7]  Xin Xu,et al.  Statistical Learning in Multiple Instance Problems , 2003 .

[8]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[9]  Jinyu Li,et al.  Beyond cross-entropy: towards better frame-level objective functions for deep neural network training in automatic speech recognition , 2014, INTERSPEECH.

[10]  Hsuan-Tien Lin,et al.  A note on Platt’s probabilistic outputs for support vector machines , 2007, Machine Learning.

[11]  Melih Kandemir,et al.  Computer-aided diagnosis from weak supervision: A benchmarking study , 2015, Comput. Medical Imaging Graph..

[12]  Jiajun Wu,et al.  Deep multiple instance learning for image classification and auto-annotation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Zhuowen Tu,et al.  Multiple clustered instance learning for histopathology cancer image classification, segmentation and clustering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Yichuan Tang,et al.  Deep Learning using Support Vector Machines , 2013, ArXiv.

[15]  Hiroshi Fujita,et al.  Computerized Detection of Retinal Nerve Fiber Layer Defects in Retinal Fundus Images by Modified Polar Transformation and Gabor Filtering , 2009 .

[16]  Suvankar Pal,et al.  A systematic review and meta-analysis of retinal nerve fiber layer change in dementia, using optical coherence tomography , 2015, Alzheimer's & dementia.

[17]  Lauge Sørensen,et al.  Label Stability in Multiple Instance Learning , 2015, MICCAI.

[18]  Hiroshi Fujita,et al.  Detection of retinal nerve fiber layer defects in retinal fundus images using Gabor filtering , 2007, SPIE Medical Imaging.

[19]  Christopher Bowd,et al.  Retinal nerve fiber layer analysis in the diagnosis of glaucoma. , 2006, Current opinion in ophthalmology.

[20]  Jeong-Min Hwang,et al.  Automatic computer-aided diagnosis of retinal nerve fiber layer defects using fundus photographs in optic neuropathy. , 2015, Investigative ophthalmology & visual science.

[21]  Joost van de Weijer,et al.  Regularized Multi-Concept MIL for weakly-supervised facial behavior categorization , 2014, BMVC.

[22]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[23]  Jan Ramon,et al.  Multi instance neural networks , 2000, ICML 2000.

[24]  Quoc V. Le,et al.  On optimization methods for deep learning , 2011, ICML.

[25]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[27]  Baoxin Li,et al.  Simpler Non-Parametric Methods Provide as Good or Better Results to Multiple-Instance Learning , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Alejandro F Frangi,et al.  Multiple instance cancer detection by boosting regularised trees , 2015 .

[29]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[30]  Zhi-Hua Zhou,et al.  Multi-instance learning by treating instances as non-I.I.D. samples , 2008, ICML '09.

[31]  Qi Zhang,et al.  EM-DD: An Improved Multiple-Instance Learning Technique , 2001, NIPS.

[32]  Jaume Amores,et al.  Multiple instance classification: Review, taxonomy and comparative study , 2013, Artif. Intell..

[33]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Jirí Jan,et al.  Retinal nerve fiber layer analysis via Markov random fields texture modelling , 2010, 2010 18th European Signal Processing Conference.

[35]  Yixin Chen,et al.  MILES: Multiple-Instance Learning via Embedded Instance Selection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[37]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[38]  Emanuele Trucco,et al.  Subcategory Classifiers for Multiple-Instance Learning and Its Application to Retinal Nerve Fiber Layer Visibility Classification , 2016, IEEE Transactions on Medical Imaging.

[39]  Anonymous Authors Empowering Multiple Instance Histopathology Cancer Diagnosis by Cell Graphs , 2014 .

[40]  Fatmire Berisha,et al.  Retinal abnormalities in early Alzheimer's disease. , 2007, Investigative ophthalmology & visual science.