A Data‐Driven Approach for Sketch‐Based 3D Shape Retrieval via Similar Drawing‐Style Recommendation

Sketching is a simple and natural way of expression and communication for humans. For this reason, it gains increasing popularity in human computer interaction, with the emergence of multitouch tablets and styluses. In recent years, sketch‐based interactive methods are widely used in many retrieval systems. In particular, a variety of sketch‐based 3D model retrieval works have been presented. However, almost all of these works focus on directly matching sketches with the projection views of 3D models, and they suffer from the large differences between the sketch drawing and the views of 3D models, leading to unsatisfying retrieval results. Therefore, in this paper, during the matching procedure in the retrieval, we propose to match the sketch with each 3D model from historical users instead of projection views. Yet since the sketches between the current user and the historical users can have big difference, we also aim to handle users' personalized deviations and differences. To this end, we leverage recommendation algorithms to estimate the drawing style characteristic similarity between the current user and historical users. Experimental results on the Large Scale Sketch Track Benchmark(SHREC14LSSTB) demonstrate that our method outperforms several state‐of‐the‐art methods.

[1]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[2]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[3]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, ACM Trans. Graph..

[4]  Hans-Peter Seidel,et al.  An efficient construction of reduced deformable objects , 2013, ACM Trans. Graph..

[5]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[6]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[7]  Fang Wang,et al.  Sketch-based 3D shape retrieval using Convolutional Neural Networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[9]  Huseyin Polat,et al.  A comparison of clustering-based privacy-preserving collaborative filtering schemes , 2013, Appl. Soft Comput..

[10]  Zibin Zheng,et al.  QoS-Aware Web Service Recommendation by Collaborative Filtering , 2011, IEEE Transactions on Services Computing.

[11]  Ralph R. Martin,et al.  Skeleton-based canonical forms for non-rigid 3D shape retrieval , 2016, Computational Visual Media.

[12]  Liqing Zhang,et al.  Guess what you draw: interactive contour-based image retrieval on a million-scale database , 2012, ACM Multimedia.

[13]  Daniel G. Aliaga,et al.  Fast high-resolution appearance editing using superimposed projections , 2012, TOGS.

[14]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[15]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[16]  Shi-Min Hu,et al.  Sketch2Scene: sketch-based co-retrieval and co-placement of 3D models , 2013, ACM Trans. Graph..

[17]  John Riedl,et al.  Introduction to special issue on recommender systems , 2011, ACM Trans. Web.

[18]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[19]  Lanfen Lin,et al.  A new sketch-based 3D model retrieval approach by using global and local features , 2014, Graph. Model..

[20]  Charu C. Aggarwal,et al.  Kernelized Matrix Factorization for Collaborative Filtering , 2016, SDM.

[21]  Kun Zhou,et al.  Discriminative Sketch‐based 3D Model Retrieval via Robust Shape Matching , 2011, Comput. Graph. Forum.

[22]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[23]  Ajay Joneja,et al.  User-Adaptive Sketch-Based 3-D CAD Model Retrieval , 2013, IEEE Transactions on Automation Science and Engineering.

[24]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[26]  Daniel Lemire,et al.  Slope One Predictors for Online Rating-Based Collaborative Filtering , 2007, SDM.

[27]  Bo Li,et al.  A comparison of methods for sketch-based 3D shape retrieval , 2014, Comput. Vis. Image Underst..

[28]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[29]  Diego Fernández,et al.  Comparison of collaborative filtering algorithms , 2011, ACM Trans. Web.

[30]  Gediminas Adomavicius,et al.  Personalization technologies , 2005, Commun. ACM.

[31]  Kpalma Kidiyo,et al.  A Survey of Shape Feature Extraction Techniques , 2008 .

[32]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[33]  Ryutarou Ohbuchi,et al.  Ranking on Cross-Domain Manifold for Sketch-Based 3D Model Retrieval , 2013, 2013 International Conference on Cyberworlds.

[34]  Nancy Argüelles,et al.  Author ' s , 2008 .