Learning best views of 3D shapes from sketch contour

In this paper, we introduce a novel learning-based approach to automatically select the best views of 3D shapes using a new prior. We think that a viewpoint of the 3D shape is reasonable if a human usually draws the shape from it. Hand-drawn sketches collected from relevant datasets are used to model this concept. We reveal the connection between sketches and viewpoints by taking context information of their contours into account. Furthermore, a learning framework is proposed to generalize this connection which aims to learn an automatic best view selector for different kinds of 3D shapes. Experiments on the Princeton Shape Benchmark dataset are conducted to demonstrate the superiority of our approach. The results show that compared with other state-of-the-art methods, our approach is not only robust but also efficient when applied to shape retrieval tasks.

[1]  Bin Fang,et al.  A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries , 2015, Comput. Vis. Image Underst..

[2]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[3]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[4]  Kun Zhou,et al.  Discriminative Sketch‐based 3D Model Retrieval via Robust Shape Matching , 2011, Comput. Graph. Forum.

[5]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[6]  Hamid Laga,et al.  Data-driven approach for automatic orientation of 3D shapes , 2011, The Visual Computer.

[7]  Yichen Wei,et al.  Sketch-Based Retrieval Using Content-Aware Hashing , 2014, PCM.

[8]  Hong Liu,et al.  Web-image driven best views of 3D shapes , 2011, The Visual Computer.

[9]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[10]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Masayuki Nakajima,et al.  Supervised Learning of Salient 2D Views of 3D Models , 2008 .

[12]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[13]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark (Figures 1 and 2) , 2004, Shape Modeling International Conference.

[14]  Ajay Joneja,et al.  User-Adaptive Sketch-Based 3-D CAD Model Retrieval , 2013, IEEE Transactions on Automation Science and Engineering.

[15]  Bo Li,et al.  SHREC'13 Track: Large Scale Sketch-Based 3D Shape Retrieval , 2013, 3DOR@Eurographics.

[16]  Hae-Sang Park,et al.  A simple and fast algorithm for K-medoids clustering , 2009, Expert Syst. Appl..

[17]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[18]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[19]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[20]  Mongi A. Abidi,et al.  Shape analysis algorithm based on information theory , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[22]  Hamid Laga,et al.  Geometry and context for semantic correspondences and functionality recognition in man-made 3D shapes , 2013, TOGS.

[23]  Mateu Sbert,et al.  Viewpoint Selection using Viewpoint Entropy , 2001, VMV.

[24]  Jianjun Shi,et al.  A Data-Level Fusion Model for Developing Composite Health Indices for Degradation Modeling and Prognostic Analysis , 2013, IEEE Transactions on Automation Science and Engineering.

[25]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[26]  Alexei A. Efros,et al.  Beyond Categories: The Visual Memex Model for Reasoning About Object Relationships , 2009, NIPS.

[27]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[28]  Pat Hanrahan,et al.  Context-based search for 3D models , 2010, ACM Trans. Graph..

[29]  Lanfen Lin,et al.  A new sketch-based 3D model retrieval approach by using global and local features , 2014, Graph. Model..

[30]  Ayellet Tal,et al.  Saliency Detection in Large Point Sets , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Derek Hoiem,et al.  Category-Independent Object Proposals with Diverse Ranking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  Shanghong Zhao,et al.  Bandwidth adaptation for 3D mesh preview streaming , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[34]  Daniela Giorgi,et al.  3D shape retrieval based on best view selection , 2010, 3DOR '10.

[35]  Ming-Hsuan Yang,et al.  Sketch Retrieval via Dense Stroke Features , 2013, BMVC.

[36]  Jerome A. Feldman,et al.  The Stanford Hand-Eye Project , 1969, IJCAI.