Graph-based characteristic view set extraction and matching for 3D model retrieval

In recent times, multi-view representation of the 3D model has led to extensive research in view-based methods for 3D model retrieval. However, most approaches focus on feature extraction from 2D images while ignoring the spatial information of the 3D model. In order to improve the effectiveness of view-based methods on 3D model retrieval, this paper proposes a novel method for characteristic view extraction and similarity measurement. First, the graph clustering method is used for view grouping and the random-walk algorithm is applied to adaptively update the weight of each view. The spatial information of the 3D object is utilized to construct a view-graph model, thus enabling each characteristic view to represent the discriminative visual feature in terms of specific spatial context. Next, by considering the view set as a graph model, the similarity measurement of two models can be converted into a graph matching problem. This problem is solved by mathematically formulating it as a Rayleigh quotient maximization with affinity constraints for similarity measurement. Extensive comparison experiments were conducted on the popular ETH, NTU, PSB, and MV-RED 3D model datasets. The results demonstrate the superiority of the proposed method.

[1]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[2]  Bo Li,et al.  3D model retrieval using hybrid features and class information , 2013, Multimedia Tools and Applications.

[3]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[4]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[5]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.

[6]  Yue Gao,et al.  Camera Constraint-Free View-Based 3-D Object Retrieval , 2012, IEEE Transactions on Image Processing.

[7]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[8]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[9]  Yue Gao,et al.  3D model retrieval using weighted bipartite graph matching , 2011, Signal Process. Image Commun..

[10]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  ChangHwan Kim,et al.  A 3D-grasp synthesis algorithm to grasp unknown objects based on graspable boundary and convex segments , 2015, Inf. Sci..

[12]  Bernt Schiele,et al.  Analyzing appearance and contour based methods for object categorization , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Yue Gao,et al.  View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition , 2013, IEEE Transactions on Image Processing.

[14]  Qionghai Dai,et al.  View-based 3-D Object Retrieval , 2014 .

[15]  Chang-Hsing Lee,et al.  A new 3D model retrieval approach based on the elevation descriptor , 2007, Pattern Recognit..

[16]  Amir Averbuch,et al.  3-D Symmetry Detection and Analysis Using the Pseudo-polar Fourier Transform , 2010, International Journal of Computer Vision.

[17]  Wei Gong,et al.  3D Model Retrieval Based on Wavelet Transform , 2014 .

[18]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[20]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[21]  Bo Li,et al.  Extended Large Scale Sketch-Based 3D Shape Retrieval , 2014, 3DOR@Eurographics.

[22]  Yueting Zhuang,et al.  Fast view-based 3D model retrieval via unsupervised multiple feature fusion and online projection learning , 2016, Signal Process..

[23]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[24]  Dejan V. VraniC.  An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[25]  Fernando De la Torre,et al.  Factorized Graph Matching , 2016, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ming Quan Zhou,et al.  3D Model Retrieval Based on Distance Classification Histogram , 2015 .

[27]  Takahiro Okabe,et al.  From Intensity Profile to Surface Normal: Photometric Stereo for Unknown Light Sources and Isotropic Reflectances , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Petros Daras,et al.  A 3D Shape Retrieval Framework Supporting Multimodal Queries , 2010, International Journal of Computer Vision.

[29]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Karthik Ramani,et al.  Shape-It-Up: Hand gesture based creative expression of 3D shapes using intelligent generalized cylinders , 2013, Comput. Aided Des..

[31]  Lanfen Lin,et al.  A new sketch-based 3D model retrieval approach by using global and local features , 2014, Graph. Model..

[32]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[33]  Qionghai Dai,et al.  Multi-View Stereo Reconstruction with High Dynamic Range Texture , 2010, ACCV.

[34]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.

[35]  Ke Lu,et al.  3D model retrieval and classification by semi-supervised learning with content-based similarity , 2014, Inf. Sci..

[36]  Min-Chun Hu,et al.  Real-Time Human Movement Retrieval and Assessment With Kinect Sensor , 2015, IEEE Transactions on Cybernetics.

[37]  Mateu Sbert,et al.  Browsing and exploration of video sequences: A new scheme for key frame extraction and 3D visualization using entropy based Jensen divergence , 2014, Inf. Sci..

[38]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[39]  Xiangyu Wang,et al.  3D Model Retrieval with Weighted Locality-constrained Group Sparse Coding , 2015, Neurocomputing.

[40]  Andrew V. Goldberg,et al.  A new approach to the maximum flow problem , 1986, STOC '86.

[41]  Fernando De la Torre,et al.  Factorized Graph Matching , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Mohammed Bennamoun,et al.  A novel local surface feature for 3D object recognition under clutter and occlusion , 2015, Inf. Sci..

[43]  Hongxun Yao,et al.  Affective Image Retrieval via Multi-Graph Learning , 2014, ACM Multimedia.

[44]  R. Munos,et al.  Kullback–Leibler upper confidence bounds for optimal sequential allocation , 2012, 1210.1136.

[45]  Mohamed Daoudi,et al.  A practical approach for 3D model indexing by combining local and global invariants , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[46]  Chao-Hung Lin,et al.  Point Cloud Encoding for 3D Building Model Retrieval , 2014, IEEE Transactions on Multimedia.

[47]  Yue Gao,et al.  Learning for 3D understanding , 2015, Neurocomputing.

[48]  Dejan V. Vranic,et al.  3D model retrieval , 2004 .

[49]  Ching-Yuen Chan,et al.  A novel 3D model retrieval approach using combined shape distribution , 2012, Multimedia Tools and Applications.

[50]  Yunhui Liu,et al.  A Probabilistic 3D Model Retrieval System Using Sphere Image , 2012, ACCV.

[51]  Takahiro Okabe,et al.  Uncalibrated Photometric Stereo for Unknown Isotropic Reflectances , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[53]  Dacheng Tao,et al.  Locally regularized sliced inverse regression based 3D hand gesture recognition on a dance robot , 2013, Inf. Sci..

[54]  Alberto Del Bimbo,et al.  Retrieval of 3D objects using curvature correlograms , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[55]  Hans-Peter Kriegel,et al.  3D Shape Histograms for Similarity Search and Classification in Spatial Databases , 1999, SSD.

[56]  Yue Gao,et al.  3D model comparison using spatial structure circular descriptor , 2010, Pattern Recognit..

[57]  Remco C. Veltkamp,et al.  Polyhedral model retrieval using weighted point sets , 2003, 2003 Shape Modeling International..

[58]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[59]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[60]  Yue Gao,et al.  View-Based 3D Object Retrieval: Challenges and Approaches , 2014, IEEE MultiMedia.

[61]  Bo Li,et al.  Shape Retrieval of Non-Rigid 3D Human Models , 2014, 3DOR@Eurographics.

[62]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.