Multi-feature Based Object Class Recognition

In object class recognition, lots of past researches focused on the local descriptors such as SIFT to categorize the variation of objects belonging to the same category in different poses, sizes, and appearance. However, SIFT descriptors may produce poor result especially if the object does not have enough information of its texture features. Due to this problem, we hypothesize that the use multi feature may increase the performance of object class recognition. In this paper, we use additional global shape features, Fourier Descriptors combined with SIFT descriptors to help in improving the performance of object class recognition. The selection of shape features is chosen due to the objects are easier to describe based on this features from human perspective compare to other features. We have divided our experiments into two: Experiment E1 is limited to the side view of bike, car, horse, and cow images whereas Experiment E2 consists of similar categories of dataset but in arbitrary views, rotations, and scales. The dataset we used in our experimentation are obtained from PASCAL, Weizmann and TU Darmstadt database. We assume that all objects are segmented manually before the feature extraction process. We validate our selection features using K-Means algorithm to evaluate the features for the purpose of object class recognition. Our results indicate that the combination of additional shape features together with SIFT descriptors performs better than using SIFT descriptors alone by up to 15% with limitation views of images.

[1]  CipollaRoberto,et al.  Multiscale Categorical Object Recognition Using Contour Fragments , 2008 .

[2]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[6]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[7]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[8]  Andrew Zisserman,et al.  Fusing Shape and Appearance Information for Object Category Detection , 2006, BMVC.

[9]  Matthew B. Blaschko,et al.  Combining Local and Global Image Features for Object Class Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  Antonio Criminisi,et al.  Object Class Recognition at a Glance , 2006 .

[11]  Y. Kuno,et al.  Integration of multiple methods for robust object recognition , 2007, SICE Annual Conference 2007.

[12]  Wei Zhang,et al.  Object class recognition using multiple layer boosting with heterogeneous features , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Bernt Schiele,et al.  Local features for object class recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Andrew Blake,et al.  Multiscale Categorical Object Recognition Using Contour Fragments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mandava Rajeswari,et al.  Object Based Clustering Using Hybrid Algorithms , 2008, 2008 Fifth International Conference on Computer Graphics, Imaging and Visualisation.

[16]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.