View selection for sketch-based 3D model retrieval using visual part shape description

Hand drawings are the imprints of shapes in human’s mind. How a human expresses a shape is a consequence of how he or she visualizes it. A query-by-sketch 3D object retrieval application is closely tied to this concept from two aspects. First, describing sketches must involve elements in a figure that matter most to a human. Second, the representative 2D projection of the target 3D objects should be limited to “the canonical views” from a human cognition perspective. We advocate for these two rules by presenting a new approach for sketch-based 3D object retrieval that describes a 2D shape by the visual protruding parts of its silhouette. Furthermore, we present a list of candidate 2D projections that represent the canonical views of a 3D object. The general rule is that humans would visually avoid part occlusion and symmetry. We quantify the extent of part occlusion of the projected silhouettes of 3D objects by skeletal length computations. Sorting the projected views in the decreasing order of skeletal lengths gives access to a subset of the best representative views. We experimentally show how views that cause misinterpretation and mismatching can be detected according to the part occlusion criteria. We also propose criteria for locating side, off axis, or asymmetric views.

[1]  Daniel Lemire,et al.  Faster retrieval with a two-pass dynamic-time-warping lower bound , 2008, Pattern Recognit..

[2]  Tobias Schreck,et al.  STELA: sketch-based 3D model retrieval using a structure-based local approach , 2011, ICMR '11.

[3]  Manish Singh,et al.  Geometric determinants of shape segmentation: Tests using segment identification , 2007, Vision Research.

[4]  Yichen Wei,et al.  Learning best views of 3D shapes from sketch contour , 2015, The Visual Computer.

[5]  T. K. Vintsyuk Speech discrimination by dynamic programming , 1968 .

[6]  Kun Zhou,et al.  Discriminative Sketch‐based 3D Model Retrieval via Robust Shape Matching , 2011, Comput. Graph. Forum.

[7]  Bo Li,et al.  Sketch-Based 3D Model Retrieval by Viewpoint Entropy-Based Adaptive View Clustering , 2013, 3DOR@Eurographics.

[8]  Zahraa Yasseen,et al.  Shape matching by part alignment using extended chordal axis transform , 2016, Pattern Recognit..

[9]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[10]  Tobias Schreck,et al.  Sketch-based 3D Model Retrieval using Keyshapes for Global and Local Representation , 2012, 3DOR@Eurographics.

[11]  Peter Neri,et al.  Wholes and subparts in visual processing of human agency , 2008, Proceedings of the Royal Society B: Biological Sciences.

[12]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[13]  Bo Li,et al.  Semantic sketch-based 3D model retrieval , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[14]  Bo Li,et al.  A comparison of methods for sketch-based 3D shape retrieval , 2014, Comput. Vis. Image Underst..

[15]  Ryutarou Ohbuchi,et al.  Ranking on Cross-Domain Manifold for Sketch-Based 3D Model Retrieval , 2013, 2013 International Conference on Cyberworlds.

[16]  M. Bertamini,et al.  Processing convexity and concavity along a 2-D contour: figure–ground, structural shape, and attention , 2013, Psychonomic bulletin & review.

[17]  Frédo Durand,et al.  Apparent ridges for line drawing , 2007, ACM Trans. Graph..

[18]  Yair Weiss,et al.  Learning about Canonical Views from Internet Image Collections , 2012, NIPS.

[19]  Bo Li,et al.  Extended Large Scale Sketch-Based 3D Shape Retrieval , 2014, 3DOR@Eurographics.

[20]  Lakshman Prasad Rectification of the chordal axis transform skeleton and criteria for shape decomposition , 2007, Image Vis. Comput..

[21]  Javid Taheri,et al.  SparseDTW: A Novel Approach to Speed up Dynamic Time Warping , 2009, AusDM.

[22]  Zahraa Yasseen,et al.  Sketch-based 3D Object Retrieval Using Two Views and a Visual Part Alignment , 2015, 3DOR@Eurographics.

[23]  Masaki Aono,et al.  3D shape retrieval from a 2D image as query , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[24]  Changhu Wang,et al.  Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval , 2014, IEEE Signal Processing Letters.

[25]  Johan Wagemans,et al.  The Awakening of Attneave's Sleeping cat: Identification of Everyday Objects on the Basis of Straight-Line Versions of Outlines , 2008, Perception.

[26]  Ryutarou Ohbuchi,et al.  Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[27]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[28]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Hichem Sahbi,et al.  From 2D Silhouettes to 3D Object Retrieval: Contributions and Benchmarking , 2010, EURASIP J. Image Video Process..

[30]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[31]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[32]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[33]  Eamonn J. Keogh,et al.  Experimental comparison of representation methods and distance measures for time series data , 2010, Data Mining and Knowledge Discovery.

[34]  Arjan Kuijper,et al.  Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours , 2010, ACM Multimedia.

[35]  Bo Li,et al.  SHREC'13 Track: Large Scale Sketch-Based 3D Shape Retrieval , 2013, 3DOR@Eurographics.

[36]  Bo Li,et al.  Sketch-based 3D model retrieval by incorporating 2D-3D alignment , 2012, Multimedia Tools and Applications.

[37]  M J Tarr,et al.  What Object Attributes Determine Canonical Views? , 1999, Perception.

[38]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[39]  Donald D. Hoffman,et al.  Salience of visual parts , 1997, Cognition.

[40]  Marc Alexa,et al.  SHREC'12 Track: Sketch-Based 3D Shape Retrieval , 2012, 3DOR@Eurographics.

[41]  Anne Verroust-Blondet,et al.  Alignment of 3D models , 2009, Graph. Model..