3D CNN based Partial 3D Shape Retrieval Focusing on Local Features

In this paper, we propose a new method for 3D CNN based partial 3D shape retrieval focusing on local features. A 3D partial shape in our approach is defined by a collection of points on the visible surface projected on the view-screen, during the rendering of a given 3D shape. We construct a voxel from the partial 3D points after extracting the local feature vectors and subsequent dimensional reduction by PCA (Principla Component Analysis) and feeding the reduced feature vectors to 3D CNN. This is a unique approach in contrast to the traditional approach to 3D CNN where the voxels have their values either Os or 1s (i.e. binary voxels). We conducted experiments with a SHREC2016 partial 3D dataset. Our proposed approach outperformed the VoxNet. We also compared our proposed method with other previous methods for partial 3D shape search.

[1]  Andrew Owens,et al.  SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Matthias Nießner,et al.  3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ryutarou Ohbuchi,et al.  SHREC'10 Track: Range Scan Retrieval , 2010, 3DOR@Eurographics.

[5]  Bo Li,et al.  RGB-D to CAD Retrieval with ObjectNN Dataset , 2017, 3DOR@Eurographics.

[6]  George Pavlidis,et al.  3D Pottery content-based retrieval based on pose normalisation and segmentation , 2010 .

[7]  Ryutarou Ohbuchi,et al.  Randomized Sub-Volume Partitioning for Part-Based 3D Model Retrieval , 2015, 3DOR@Eurographics.

[8]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Andrew W. Fitzgibbon,et al.  Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Huarui Yin,et al.  Range Scans based 3D Shape Retrieval , 2015, 3DOR@Eurographics.

[11]  Paul Bratley,et al.  Algorithm 659: Implementing Sobol's quasirandom sequence generator , 1988, TOMS.

[12]  Paul L. Rosin,et al.  SHREC’16 Track: Partial Shape Queries for 3D Object Retrieval , 2016 .

[13]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[14]  Matthias Nießner,et al.  Learning to Navigate the Energy Landscape , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[15]  Tobias Schreck,et al.  SHREC'13 Track: Large-Scale Partial Shape Retrieval Using Simulated Range Images , 2013, 3DOR@Eurographics.

[16]  Dieter Fox,et al.  Unsupervised feature learning for 3D scene labeling , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[18]  Thomas A. Funkhouser,et al.  Structured Global Registration of RGB-D Scans in Indoor Environments , 2016, ArXiv.

[19]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).