Camera Constraint-Free View-Based 3-D Object Retrieval

Recently, extensive research efforts have been dedicated to view-based methods for 3-D object retrieval due to the highly discriminative property of multiviews for 3-D object representation. However, most of state-of-the-art approaches highly depend on their own camera array settings for capturing views of 3-D objects. In order to move toward a general framework for 3-D object retrieval without the limitation of camera array restriction, a camera constraint-free view-based (CCFV) 3-D object retrieval algorithm is proposed in this paper. In this framework, each object is represented by a free set of views, which means that these views can be captured from any direction without camera constraint. For each query object, we first cluster all query views to generate the view clusters, which are then used to build the query models. For a more accurate 3-D object comparison, a positive matching model and a negative matching model are individually trained using positive and negative matched samples, respectively. The CCFV model is generated on the basis of the query Gaussian models by combining the positive matching model and the negative matching model. The CCFV removes the constraint of static camera array settings for view capturing and can be applied to any view-based 3-D object database. We conduct experiments on the National Taiwan University 3-D model database and the ETH 3-D object database. Experimental results show that the proposed scheme can achieve better performance than state-of-the-art methods.

[1]  Dietmar Saupe,et al.  3D Model Retrieval , 2001 .

[2]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Kostas Daniilidis,et al.  Spherical Correlation of Visual Representations for 3D Model Retrieval , 2009, International Journal of Computer Vision.

[4]  Ryutarou Ohbuchi,et al.  Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Ryutarou Ohbuchi,et al.  Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features , 2009, CIVR '09.

[6]  Yue Gao,et al.  3D model retrieval using weighted bipartite graph matching , 2011, Signal Process. Image Commun..

[7]  Wen Gao,et al.  Location Discriminative Vocabulary Coding for Mobile Landmark Search , 2012, International Journal of Computer Vision.

[8]  Yue Gao,et al.  Representative views re-ranking for 3D model retrieval with multi-bipartite graph reinforcement model , 2010, ACM Multimedia.

[9]  Tao,et al.  MATE: A Visual Based 3D Shape Descriptor , 2009 .

[10]  Remco C. Veltkamp,et al.  Polyhedral model retrieval using weighted point sets , 2003, 2003 Shape Modeling International..

[11]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Zhang Yao,et al.  Content-Based 3-D Model Retrieval: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Yue Gao,et al.  3D object retrieval with bag-of-region-words , 2010, ACM Multimedia.

[14]  Douglas Lanman,et al.  BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields , 2009, SIGGRAPH 2009.

[15]  Marc Rioux,et al.  Nefertiti: A tool for 3-D shape databases management , 1999 .

[16]  Mohamed Daoudi,et al.  3D models retrieval by using characteristic views , 2002, Object recognition supported by user interaction for service robots.

[17]  P. Papadakis,et al.  PANORAMA : A 3 D Shape Descriptor based on Panoramic Views for Unsupervised 3 D Object Retrieval , 2009 .

[18]  Silvio Savarese,et al.  Learning a dense multi-view representation for detection, viewpoint classification and synthesis of object categories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[20]  Rongrong Ji,et al.  Actor-independent action search using spatiotemporal vocabulary with appearance hashing , 2011, Pattern Recognit..

[21]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[22]  Yue Gao,et al.  3D model comparison using spatial structure circular descriptor , 2010, Pattern Recognit..

[23]  Xian-Sheng Hua,et al.  Towards a Relevant and Diverse Search of Social Images , 2010, IEEE Transactions on Multimedia.

[24]  Luc Van Gool,et al.  Towards Multi-View Object Class Detection , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[26]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[27]  Céline Loscos,et al.  3D Model Retrieval , 2013 .

[28]  Silvio Savarese,et al.  3D generic object categorization, localization and pose estimation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Yue Gao,et al.  View-based 3D model retrieval with probabilistic graph model , 2010, Neurocomputing.

[30]  Dejan V. VraniC An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Qionghai Dai,et al.  Weighted Subspace Distance and Its Applications to Object Recognition and Retrieval With Image Sets , 2009, IEEE Signal Processing Letters.

[32]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[33]  Ioannis Pratikakis,et al.  PANORAMA: A 3D Shape Descriptor Based on Panoramic Views for Unsupervised 3D Object Retrieval , 2010, International Journal of Computer Vision.

[34]  Chang-Hsing Lee,et al.  A new 3D model retrieval approach based on the elevation descriptor , 2007, Pattern Recognit..

[35]  Wen Gao,et al.  Towards semantic embedding in visual vocabulary , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Qionghai Dai,et al.  Statistical modeling and many-to-many matching for view-based 3D object retrieval , 2010, Signal Process. Image Commun..

[37]  Alberto Del Bimbo,et al.  Content-based retrieval of 3D models , 2006, TOMCCAP.

[38]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[39]  Bernt Schiele,et al.  Analyzing appearance and contour based methods for object categorization , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[40]  Y. Zhang,et al.  Content-Based 3-D Model Retrieval: A Survey , 2007, IEEE Trans. Syst. Man Cybern. Part C.

[41]  Zheng Qin,et al.  A powerful relevance feedback mechanism for content-based 3D model retrieval , 2007, Multimedia Tools and Applications.

[42]  QinZheng,et al.  A powerful relevance feedback mechanism for content-based 3D model retrieval , 2008 .

[43]  Zhang Xiong,et al.  A 3D shape retrieval framework for 3D smart cities , 2010, Frontiers of Computer Science in China.

[44]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[45]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[46]  William C. Regli,et al.  Using shape distributions to compare solid models , 2002, SMA '02.

[47]  Michael G. Strintzis,et al.  3D object retrieval using the 3D shape impact descriptor , 2009, Pattern Recognit..

[48]  Silvio Savarese,et al.  A multi-view probabilistic model for 3D object classes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Meng Wang,et al.  Intelligent query: open another door to 3d object retrieval , 2010, ACM Multimedia.

[50]  Zhang Xiong,et al.  ModelSeek: an effective 3D model retrieval system , 2011, Multimedia Tools and Applications.

[51]  Petros Daras,et al.  A 3D Shape Retrieval Framework Supporting Multimodal Queries , 2010, International Journal of Computer Vision.

[52]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[53]  Renato Pajarola,et al.  Confetti: object-space point blending and splatting , 2004, IEEE Transactions on Visualization and Computer Graphics.

[54]  T. Furuya,et al.  Accelerating Bag-of-Features SIFT Algorithm for 3 D Model Retrieval , 2008 .

[55]  Qionghai Dai,et al.  View-based 3-D Object Retrieval , 2014 .

[56]  Yue Gao,et al.  3D object retrieval based on a graph model descriptor , 2011, Neurocomputing.

[57]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[58]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[61]  Meng Wang,et al.  Beyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation , 2009, IEEE Transactions on Multimedia.

[62]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.