3D object retrieval based on sparse coding in weak supervision

The proposed method does not require the explicit virtual model information.We utilized FDDL to learn dictionary to reconstruct query sample for retrieval.Our approach has high generalization ability and can be used on other applications. With the rapid development of computer vision and digital capture equipment, we can easily record the 3D information of objects. In the recent years, more and more 3D data are generated, which makes it desirable to develop effective 3D retrieval algorithms. In this paper, we apply the sparse coding method in a weakly supervision manner to address 3D model retrieval. First, each 3D object, which is represented by a set of 2D images, is used to learn dictionary. Then, sparse coding is used to compute the reconstruction residual for each query object. Finally, the residual between the query model and the candidate model is used for 3D model retrieval. In the experiment, ETH, NTU and ALOL dataset are used to evaluate the performance of the proposed method. The results demonstrate the superiority of the proposed method.

[1]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[2]  Xiao Liu,et al.  Probabilistic Graphlet Transfer for Photo Cropping , 2013, IEEE Transactions on Image Processing.

[3]  Ryutarou Ohbuchi,et al.  Ranking on Cross-Domain Manifold for Sketch-Based 3D Model Retrieval , 2013, 2013 International Conference on Cyberworlds.

[4]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR Forum.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Ivan Laptev,et al.  Weakly supervised object recognition with convolutional neural networks , 2014 .

[7]  Xiangyu Wang,et al.  3D Model Retrieval with Weighted Locality-constrained Group Sparse Coding , 2015, Neurocomputing.

[8]  Rongrong Ji,et al.  Visual tracking via weakly supervised learning from multiple imperfect oracles , 2014, Pattern Recognit..

[9]  Bo Li,et al.  Sketch-Based 3D Model Retrieval by Viewpoint Entropy-Based Adaptive View Clustering , 2013, 3DOR@Eurographics.

[10]  Alberto Del Bimbo,et al.  Content-Based Retrieval of 3-D Objects Using Spin Image Signatures , 2007, IEEE Transactions on Multimedia.

[11]  Alistair Sutherland,et al.  Charge Density-Based 3D Model Retrieval Using Bag-of-Feature , 2013, 3DOR@Eurographics.

[12]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[13]  Ying Zhang,et al.  Learning a Probabilistic Topology Discovering Model for Scene Categorization , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Chang-Hsing Lee,et al.  A new 3D model retrieval approach based on the elevation descriptor , 2007, Pattern Recognit..

[15]  Gerhard Rigoll,et al.  An Integrated Approach to Shape and Color-Based Image Retrieval of Rotated Objects Using Hidden Markov Models , 2001, Int. J. Pattern Recognit. Artif. Intell..

[16]  Renato Pajarola,et al.  Confetti: object-space point blending and splatting , 2004, IEEE Transactions on Visualization and Computer Graphics.

[17]  Richard C. T. Lee,et al.  Application of Principal Component Analysis to Multikey Searching , 1976, IEEE Transactions on Software Engineering.

[18]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[19]  M. Alarmel Mangai,et al.  Subspace-based clustering and retrieval of 3-D objects , 2013, Comput. Electr. Eng..

[20]  Yue Gao,et al.  3D model retrieval using weighted bipartite graph matching , 2011, Signal Process. Image Commun..

[21]  Yue Gao,et al.  3D model comparison using spatial structure circular descriptor , 2010, Pattern Recognit..

[22]  Yi Yang,et al.  Discriminative Cellets Discovery for Fine-Grained Image Categories Retrieval , 2014, ICMR.

[23]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[24]  Xiao Liu,et al.  Probabilistic Graphlet Cut: Exploiting Spatial Structure Cue for Weakly Supervised Image Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[26]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[27]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[28]  Chun Chen,et al.  Feature selection for fast speech emotion recognition , 2009, ACM Multimedia.

[29]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[30]  Herna L. Viktor,et al.  NRC Publications Archive Archives des publications du CNRC , 2022 .

[31]  Yi Yang,et al.  Weakly Supervised Photo Cropping , 2014, IEEE Transactions on Multimedia.

[32]  Yi Yang,et al.  Discovering Discriminative Graphlets for Aerial Image Categories Recognition , 2013, IEEE Transactions on Image Processing.

[33]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[34]  Petros Daras,et al.  Investigating the Effects of Multiple Factors Towards More Accurate 3-D Object Retrieval , 2012, IEEE Transactions on Multimedia.

[35]  Yue Gao,et al.  Camera Constraint-Free View-Based 3-D Object Retrieval , 2012, IEEE Transactions on Image Processing.

[36]  Yue Gao,et al.  Learning-Based Bipartite Graph Matching for View-Based 3D Model Retrieval , 2014, IEEE Transactions on Image Processing.

[37]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[38]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[40]  Yue Gao,et al.  3D object retrieval with bag-of-region-words , 2010, ACM Multimedia.

[41]  Bo Li,et al.  Hybrid shape descriptor and meta similarity generation for non-rigid and partial 3D model retrieval , 2014, Multimedia Tools and Applications.

[42]  Zhang Xiong,et al.  3D Object Retrieval With Multitopic Model Combining Relevance Feedback and LDA Model , 2015, IEEE Transactions on Image Processing.

[43]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.