Recognition of occluded objects by feature interactions

The main challenge for occlusion problem is that features from different objects tend to interact and cause recognition failures for traditional object recognition algorithms where even matched feature points do not necessarily lead to successful recognitions. Feature interactions may be the key to recognize occluded objects. In this paper, we propose a framework to integrate local feature interactions in terms of color, texture and geometry into spectral matching. Appearance similarity will serve as a prior to compensate the sensitivity of spectral matching towards noisy data caused by occlusions. Accordingly incorrect correspondences can be discarded by remaining the geometrical consistency in the formed affinity matrix. Because of our informative similarity matrix, objects under severe occlusions can still be recognized and matching errors dramatically reduced in recognizing both 2D and 3D occluded objects.

[1]  Ronen Basri,et al.  Texture segmentation by multiscale aggregation of filter responses and shape elements , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Geok Soon Hong,et al.  2D occluded object recognition using wavelets , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[3]  Fred Rothganger.  3 D Object Modeling and Recognition Using Local Affine-Invariant Image Descriptors and MultiView Spatial Constraints , 2004 .

[4]  Martial Hebert,et al.  Local detection of occlusion boundaries in video , 2009, Image Vis. Comput..

[5]  Vincent Lepetit,et al.  Appearance-based keypoint clustering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Salih O. Duffuaa,et al.  A Linear Programming Approach for the Weighted Graph Matching Problem , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  H. C. Sim,et al.  Recognition of Partially Occluded Objects with Back-Propagation Neural Network , 1998, Int. J. Pattern Recognit. Artif. Intell..

[8]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[9]  K. M. Tsang.  Recognition of 2D Standalone and Occluded Objects Using Wavelet Transform , 2001, Int. J. Pattern Recognit. Artif. Intell..

[10]  Jitendra Malik,et al.  Textons, contours and regions: cue integration in image segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Cordelia Schmid,et al.  3D Object Modeling and Recognition Using Local Affine-Invariant Image Descriptors and Multi-View Spatial Constraints , 2006, International Journal of Computer Vision.

[12]  Edwin R. Hancock,et al.  Point pattern matching with robust spectral correspondence , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Shuicheng Yan,et al.  Correspondence Propagation with Weak Priors , 2009, IEEE Transactions on Image Processing.

[15]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[16]  Xianhui Lu,et al.  A Tight Security Reduction Identity-Based Signature Scheme , 2007 .

[17]  John Krumm,et al.  Object recognition with color cooccurrence histograms , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[20]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Dong Liang,et al.  Spectral Correspondence Using Local Similarity Analysis , 2007, 2007 International Conference on Computational Intelligence and Security (CIS 2007).

[22]  Nian Wang,et al.  Spectral Correspondence Using Local Similarity Analysis , 2007 .