Object recognition under severe occlusions with a hidden Markov model approach

The main contributions of this paper are: A new method for recognition of non-deformable severe occluded objects.Local shape descriptor from the wavelet coefficients of the tangent angle signature.Most likely object retrieval based on an ensemble of Hidden Markov Models.Two new area restrictions for consistency checking between hypotheses and occlusion. Shape classification has multiple applications. In real scenes, shapes may contain severe occlusions, hardening the identification of objects. In this paper, a method for object recognition under severe occlusion is proposed. Occlusion is dealt with separating shapes into parts through high curvature points, then tangent angle signature is found for each part and continuous wavelet transform is calculated for each signature. Next, the best matching object is calculated for each part using Pearsons correlation coefficient as similarity measure between wavelets of the part and of the most probable objects in the database. For each probable class, a hidden Markov model is created in an ensemble through training with the one-class approach. For hypotheses validation, two area restrictions are set to enhance recognition performance. Experiments were conducted with 1500 test shape instances with different scenarios of object occlusion. Results showed the method not only was capable of identifying highly occluded shapes (60%80% overlapping) but also present several advantages over previous methods.

[1]  Qiang Wang,et al.  An elastic partial shape matching technique , 2007, Pattern Recognit..

[2]  Jan Flusser,et al.  Recognition of partially occluded and deformed binary objects , 2005, Pattern Recognit. Lett..

[3]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[4]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[5]  Haibin Ling,et al.  Using the inner-distance for classification of articulated shapes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Rogério Schmidt Feris,et al.  Efficient partial shape matching using Smith-Waterman algorithm , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Manuele Bicego,et al.  Investigating hidden Markov models' capabilities in 2D shape classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[9]  Peter Wonka,et al.  Curve matching for open 2D curves , 2009, Pattern Recognit. Lett..

[10]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[11]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[12]  Michael J. Black,et al.  Occlusion Boundary Detection via Deep Exploration of Context , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Manuel González Hidalgo,et al.  Red Blood Cell Cluster Separation From Digital Images for Use in Sickle Cell Disease , 2015, IEEE Journal of Biomedical and Health Informatics.

[14]  Mohamad Khalil,et al.  An optimal elastic partial shape matching via shape geodesics , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  A. Murat Tekalp,et al.  Partial shape recognition by sub-matrix matching for partial matching guided image labeling , 2005, Pattern Recognit..

[16]  Yu Cao,et al.  2D nonrigid partial shape matching using MCMC and contour subdivision , 2011, CVPR 2011.

[17]  M. M. Moya,et al.  Cueing, feature discovery, and one-class learning for synthetic aperture radar automatic target recognition , 1995, Neural Networks.

[18]  Antonis A. Argyros,et al.  Scale invariant and deformation tolerant partial shape matching , 2011, Image Vis. Comput..

[19]  S. R. Mahadeva Prasanna,et al.  Curvature point based HMM state prediction for online handwritten assamese strokes recognition , 2015, 2015 Twenty First National Conference on Communications (NCC).

[20]  Jianxin Liu,et al.  A New Method for Recognition Partially Occluded Curved Objects under Affine Transformation , 2015, 2015 10th International Conference on Intelligent Systems and Knowledge Engineering (ISKE).

[21]  Lena Gorelick,et al.  GrabCut in One Cut , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[23]  Martial Hebert,et al.  Occlusion Reasoning for Object Detectionunder Arbitrary Viewpoint , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[25]  Durbin,et al.  Biological Sequence Analysis , 1998 .