Image Classification with Rejection using Contextual Information

We introduce a new supervised algorithm for image classification with rejection using multiscale contextual information. Rejection is desired in image-classification applications that require a robust classifier but not the classification of the entire image. The proposed algorithm combines local and multiscale contextual information with rejection, improving the classification performance. As a probabilistic model for classification, we adopt a multinomial logistic regression. The concept of rejection with contextual information is implemented by modeling the classification problem as an energy minimization problem over a graph representing local and multiscale similarities of the image. The rejection is introduced through an energy data term associated with the classification risk and the contextual information through an energy smoothness term associated with the local and multiscale similarities within the image. We illustrate the proposed method on the classification of images of H&E-stained teratoma tissues.

[1]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[6]  Jelena Kovacevic,et al.  Performance measures for classification systems with rejection , 2015, Pattern Recognit..

[7]  Fabio Roli,et al.  Support Vector Machines with Embedded Reject Option , 2002, SVM.

[8]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[9]  M. Wegkamp.  Lasso type classifiers with a reject option , 2007, 0705.2363.

[10]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[11]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[12]  Mario Vento,et al.  Multiclassification: reject criteria for the Bayesian combiner , 1999, Pattern Recognit..

[13]  Jelena Kovacevic,et al.  Automatic identification and delineation of germ layer components in H&E stained images of teratomas derived from human and nonhuman primate embryonic stem cells , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  Ming Yuan,et al.  Classification Methods with Reject Option Based on Convex Risk Minimization , 2010, J. Mach. Learn. Res..

[15]  Fabio Roli,et al.  Multi-label classification with a reject option , 2013, Pattern Recognit..

[16]  Jelena Kovacevic,et al.  Automated colitis detection from endoscopic biopsies as a tissue screening tool in diagnostic pathology , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Radu Herbei,et al.  Classification with reject option , 2006 .

[18]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[20]  D. Böhning.  Multinomial logistic regression algorithm , 1992 .

[21]  Lawrence Carin,et al.  Sparse multinomial logistic regression: fast algorithms and generalization bounds , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Mario Vento,et al.  On Rejecting Unreliably Classified Patterns , 2007, MCS.

[23]  Jelena Kovacevic,et al.  Classification with reject option using contextual information , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[24]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[25]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Sanjiv Kumar,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.