Retrieval of Objects Captured with Kinect One Camera

Low-cost RGB-D sensing technology, such as the Microsoft Kinect, is gaining acceptance in the scientific community and even entering into our homes. This technology enables ordinary users to capture everyday object into digital 3D representations. Considering the image retrieval context, whereas the ability to digitalize photos led to a rapid increase of large collections of images, which in turn raised the need of efficient search and retrieval techniques. We believe the same is happening now for the 3D domain. Therefore, it is essential to identify which 3D shape descriptors, provide better matching and retrieval of such digitalized objects. In this paper, we start by presenting a collection of 3D objects acquired using the latest version of Microsoft Kinect, namely, Kinect One. This dataset, comprising 175 common household objects classified into 18 different classes, was then used for the SHape REtrieval Contest (SHREC). Two groups have submitted their 3D matching techniques, providing the rank list with top 10 results, using the complete set of 175 objects as queries.

[1]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[2]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[3]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[4]  Masaki Aono,et al.  Multi-Fourier spectra descriptor and augmentation with spectral clustering for 3D shape retrieval , 2009, The Visual Computer.

[5]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[6]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[7]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[9]  Marc Rioux,et al.  Nefertiti: a query by content software for three-dimensional models databases management , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[10]  Agnes Swadzba,et al.  3D Implicit Shape Models Using Ray Based Hough Voting for Furniture Recognition , 2013, 2013 International Conference on 3D Vision.

[11]  Aly A. Farag,et al.  SHREC'13 Track: Retrieval of Objects Captured with Low-Cost Depth-Sensing Cameras , 2013, 3DOR@Eurographics.

[12]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[13]  Luc Van Gool,et al.  Hough Transform and 3D SURF for Robust Three Dimensional Classification , 2010, ECCV.

[14]  Federico Tombari,et al.  On the Use of Implicit Shape Models for Recognition of Object Categories in 3D Data , 2010, ACCV.

[15]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[16]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[17]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[18]  Masaki Aono,et al.  3D Object Retrieval based on Correlation of Multi-view Image Local Feature , 2013 .