3D Object retrieval based on viewpoint segmentation

In the last decades, extensive efforts have been dedicated to develop better 3D object retrieval methods. View-based methods have attracted a significant amount of attention, not only because of their state-of-the-art performance, but also they merely require some of a 3D object’s 2D view images. However, most recent approaches only deal with the images’ content difference without the discrepancy of view relative positions. In this paper, we propose a normal method for view segmentation, based on Markov random field (MRF) model, which consider not only the difference between the content of views but also the relative locations. Each view is obtained by projecting at certain viewpoints and angels, therefore, these locations can be applied to depict each view, with content of views. We use the MRF to implement view segmentation and choose the representative views. Finally, we present a framework based on the proposed view segmentation method for 3D object retrieval and the experimental results demonstrate that the proposed method can achieve better retrieval effectiveness than state-of-the-art methods under several standard evaluation measures.

[1]  Michael G. Strintzis,et al.  3D object retrieval using the 3D shape impact descriptor , 2009, Pattern Recognit..

[2]  Yue Gao,et al.  Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation , 2014, IEEE Transactions on Multimedia.

[3]  Tao,et al.  MATE: A Visual Based 3D Shape Descriptor , 2009 .

[4]  Cunbao Ma,et al.  Shape alignment and shape orientation analysis-based 3D shape retrieval system , 2010, Multimedia Systems.

[5]  Xiao Wang,et al.  Indirect shape analysis for 3D shape retrieval , 2015, Comput. Graph..

[6]  Yue Gao,et al.  View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition , 2013, IEEE Transactions on Image Processing.

[7]  Jianfei Cai,et al.  Flexible Image Similarity Computation Using Hyper-Spatial Matching , 2014, IEEE Transactions on Image Processing.

[8]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[9]  Yue Gao,et al.  Feature Correlation Hypergraph: Exploiting High-order Potentials for Multimodal Recognition , 2014, IEEE Transactions on Cybernetics.

[10]  Kostas Daniilidis,et al.  Spherical Correlation of Visual Representations for 3D Model Retrieval , 2009, International Journal of Computer Vision.

[11]  Rongrong Ji,et al.  Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition , 2014, IEEE Transactions on Multimedia.

[12]  Ioannis Pratikakis,et al.  Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation , 2007, Pattern Recognit..

[13]  Xuelong Li,et al.  A Fine-Grained Image Categorization System by Cellet-Encoded Spatial Pyramid Modeling , 2015, IEEE Transactions on Industrial Electronics.

[14]  Michael G. Strintzis,et al.  3D Model Search and Retrieval Using the Spherical Trace Transform , 2007, EURASIP J. Adv. Signal Process..

[15]  Kun Zhou,et al.  Automatic 3D Indoor Scene Updating with RGBD Cameras , 2014, Comput. Graph. Forum.

[16]  Zheng Qin,et al.  A powerful relevance feedback mechanism for content-based 3D model retrieval , 2007, Multimedia Tools and Applications.

[17]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[18]  Zhang Xiong,et al.  A 3D model recognition mechanism based on deep Boltzmann machines , 2015, Neurocomputing.

[19]  Zhang Xiong,et al.  ModelSeek: an effective 3D model retrieval system , 2011, Multimedia Tools and Applications.

[20]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[21]  Yi Yang,et al.  Discriminative Cellets Discovery for Fine-Grained Image Categories Retrieval , 2014, ICMR.

[22]  Yue Gao,et al.  k-Partite graph reinforcement and its application in multimedia information retrieval , 2012, Inf. Sci..

[23]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[24]  Hao Zhang,et al.  New evaluation metrics for mesh segmentation , 2013, Comput. Graph..

[25]  Xiao Liu,et al.  Recognizing architecture styles by hierarchical sparse coding of blocklets , 2014, Inf. Sci..

[26]  Bülent Sankur,et al.  3D Model Retrieval Using Probability Density-Based Shape Descriptors , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[28]  Ryutarou Ohbuchi,et al.  SHREC’08 entry: Local volumetric features for 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[29]  Biao Leng,et al.  Support Vector Machine active learning for 3D model retrieval , 2007 .

[30]  Yue Gao,et al.  Camera Constraint-Free View-Based 3-D Object Retrieval , 2012, IEEE Transactions on Image Processing.

[31]  Karthik Ramani,et al.  On visual similarity based 2D drawing retrieval , 2006, Comput. Aided Des..

[32]  Masayuki Nakajima,et al.  Spherical Wavelet Descriptors for Content-based 3D Model Retrieval , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[33]  Yi Yang,et al.  A Probabilistic Associative Model for Segmenting Weakly Supervised Images , 2014, IEEE Transactions on Image Processing.

[34]  Zhang Xiong,et al.  3D Object Classification Using Deep Belief Networks , 2014, MMM.

[35]  Yi Yang,et al.  Discovering Discriminative Graphlets for Aerial Image Categories Recognition , 2013, IEEE Transactions on Image Processing.

[36]  Zhang Xiong,et al.  3D Object Retrieval With Multitopic Model Combining Relevance Feedback and LDA Model , 2015, IEEE Transactions on Image Processing.

[37]  Chang-Hsing Lee,et al.  A new 3D model retrieval approach based on the elevation descriptor , 2007, Pattern Recognit..

[38]  Petros Daras,et al.  SHREC '11 Track: Generic Shape Retrieval , 2009, 3DOR@Eurographics.

[39]  Guojun Lu,et al.  Generic Fourier descriptor for shape-based image retrieval , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[40]  Yi Yang,et al.  Weakly Supervised Photo Cropping , 2014, IEEE Transactions on Multimedia.

[41]  Xiao Liu,et al.  Fast multi-view segment graph kernel for object classification , 2013, Signal Process..

[42]  Michael G. Strintzis,et al.  Efficient 3-D model search and retrieval using generalized 3-D radon transforms , 2006, IEEE Transactions on Multimedia.

[43]  Ioannis Pratikakis,et al.  PANORAMA: A 3D Shape Descriptor Based on Panoramic Views for Unsupervised 3D Object Retrieval , 2010, International Journal of Computer Vision.

[44]  Hongxun Yao,et al.  View-based 3D object retrieval via multi-modal graph learning , 2015, Signal Process..

[45]  XiongZhang,et al.  3D object retrieval with stacked local convolutional autoencoder , 2015 .

[46]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[47]  Guillermo Sapiro,et al.  Three-dimensional point cloud recognition via distributions of geometric distances , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[48]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[49]  Zhang Xiong,et al.  3D object retrieval with stacked local convolutional autoencoder , 2015, Signal Process..

[50]  Yue Gao,et al.  View-based 3D model retrieval with probabilistic graph model , 2010, Neurocomputing.

[51]  Zhang Xiong,et al.  3-D object retrieval using topic model , 2014, Multimedia Tools and Applications.

[52]  Dejan V. VraniC An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[53]  Andrea Fusiello,et al.  The bag of words approach for retrieval and categorization of 3D objects , 2010, The Visual Computer.

[54]  Zhang Xiong,et al.  A 3D shape retrieval framework for 3D smart cities , 2010, Frontiers of Computer Science in China.

[55]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[56]  Liqun Li,et al.  MADE: A Composite Visual-Based 3D Shape Descriptor , 2007, MIRAGE.

[57]  Petros Daras,et al.  A 3D Shape Retrieval Framework Supporting Multimodal Queries , 2010, International Journal of Computer Vision.

[58]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[59]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[60]  Yue Gao,et al.  3D object retrieval with bag-of-region-words , 2010, ACM Multimedia.

[61]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[62]  Yue Gao,et al.  View-Based 3D Object Retrieval: Challenges and Approaches , 2014, IEEE MultiMedia.

[63]  Junwei Han,et al.  Locality-constrained sparse patch coding for 3D shape retrieval , 2015, Neurocomputing.

[64]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[65]  Yue Gao,et al.  3D model comparison using spatial structure circular descriptor , 2010, Pattern Recognit..

[66]  Ioannis A. Kakadiaris,et al.  PTK: A novel depth buffer-based shape descriptor for three-dimensional object retrieval , 2006, The Visual Computer.

[67]  Yue Gao,et al.  3D model retrieval using weighted bipartite graph matching , 2011, Signal Process. Image Commun..

[68]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[69]  Yue Gao,et al.  View-based 3D object retrieval by bipartite graph matching , 2012, ACM Multimedia.