Investigating 3D model and part information for improving content-based and attribute-based object retrieval

Content-based and attribute-based image/object retrieval are the key techniques for managing and analyzing the exponentially growing media collections. However, due to large variations in viewing angle/position, illumination, occlusion, and background, traditional object retrieval is extremely challenging. This article discusses an ongoing research in investigating the value of 3D models and informative parts for the object retrieval system. To show the feasibility of the proposed method, we apply it to the problem of multi-view vehicle retrieval. Preliminary results on vehicle retrieval demonstrate that our approach significantly outperforms the prior content-based image retrieval (CBIR) methods. Motivated by the proposed method, we are now extending the framework to attribute-based retrieval system over other domains (e.g., people) with 3D information augmented by Kinect devices.

[1]  Joseph L. Mundy,et al.  Predicting high resolution image edges with a generic, adaptive, 3-D vehicle model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Timothy F. Cootes,et al.  Analysis of Features for Rigid Structure Vehicle Type Recognition , 2004, BMVC.

[3]  Hui Cheng,et al.  3D model based vehicle classification in aerial imagery , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Ronen Basri,et al.  Constructing implicit 3D shape models for pose estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Maurice Milgram,et al.  An Oriented-Contour Point Based Voting Algorithm for Vehicle Type Classification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Cordelia Schmid,et al.  Viewpoint-independent object class detection using 3D Feature Maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[8]  Sharath Pankanti,et al.  Attribute-based vehicle search in crowded surveillance videos , 2011, ICMR.

[9]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  I. Zafar,et al.  Localized contourlet features in vehicle make and model recognition , 2009, Electronic Imaging.

[11]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Shree K. Nayar,et al.  FaceTracer: A Search Engine for Large Collections of Images with Faces , 2008, ECCV.

[13]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[14]  Geoffrey D. Sullivan,et al.  A Generic Deformable Model for Vehicle Recognition , 1995, BMVC.

[15]  Chih-Wei Chen,et al.  Content-based vehicle retrieval using 3D model and part information , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Saeid Rahati,et al.  Vehicle Recognition Using Contourlet Transform and SVM , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[17]  Yakup Genc,et al.  Explicit 3D Modeling for Vehicle Monitoring in Non-overlapping Cameras , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Takeo Kanade,et al.  A Correlation-Based Approach to Robust Point Set Registration , 2004, ECCV.

[20]  Harpreet S. Sawhney,et al.  PEET: Prototype Embedding and Embedding Transition for Matching Vehicles over Disparate Viewpoints , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[23]  Rogério Schmidt Feris,et al.  Attribute-based people search in surveillance environments , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[24]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[25]  Hamid Reza Pourreza,et al.  Vehicle Recognition Based on Fourier, Wavelet and Curvelet Transforms - a Comparative Study , 2007, Fourth International Conference on Information Technology (ITNG'07).