Dempster-Shafer evidence theory-based multi-feature learning and fusion method for non-rigid 3D model retrieval

This study introduces a novel multi-feature-based non-rigid three-dimensional (3D) model retrieval method. First, for each 3D model, compute the scale-invariant heat kernel signature (SI-HKS) descriptor and the wave kernel signature (WKS) descriptor of each vertex. Then, the normalised weighted bags of phrases feature is obtained and they are fed to the convolutional neural networks. The trust degree of each kind of descriptor is computed, and the total trust degree can be obtained. Finally, the fusion network is trained and the retrieval results can be obtained according to the ranking of the total trust degrees. For the training phase and the testing phase, the authors define different computation methods of the trust degrees and the total trust degrees. The Dempster-Shafer (DS) evidence-based total trust degrees are used not only in the feature layer but also in the decision layer. The final decision results of the total trust degrees are used in the process of the network learning. So the proposed method can make full use of the complementary information of the SI-HKS descriptor and the WKS descriptor. Extensive experiments have shown that the proposed multi-feature fusion method has better performance than a single feature-based method, and also outperforms other existing state-of-the-art methods.

[1]  Guillaume Lavoué,et al.  Combination of bag-of-words descriptors for robust partial shape retrieval , 2012, The Visual Computer.

[2]  Ju Wang and Fuxian Liu,et al.  Temporal evidence combination method for multi-sensor target recognition based on DS theory and IFS#br# , 2017 .

[3]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[4]  Ling Shao,et al.  Progressive Shape-Distribution-Encoder for Learning 3D Shape Representation , 2017, IEEE Transactions on Image Processing.

[5]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[6]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Edward K. Wong,et al.  DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[9]  Hui Chen,et al.  Human Ear Recognition in 3D , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ling Shao,et al.  Learning View-Model Joint Relevance for 3D Object Retrieval , 2015, IEEE Transactions on Image Processing.

[11]  Ali Shokoufandeh,et al.  Retrieving articulated 3-D models using medial surfaces , 2008, Machine Vision and Applications.

[12]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[13]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .