Data-driven approach for automatic orientation of 3D shapes

Visualization and visual browsing of 3D model collections require rendering the 3D models from viewpoints that allow the viewer to distinguish between them. In this paper, we introduce a new framework for the automatic selection of the best views of 3D models. We build on the assumption that models belonging to the same class of shapes share the same salient features that discriminate them from the models of other classes. This allows us to formulate the best-view selection problem as a feature selection and classification task. First a 3D model is described with a set of view-based descriptors characterizing the appearance of the model when it is seen from different viewpoints. In a second step we train a classifier that learns for each shape class the set of 2D views that maximize the intra-class similarity and the inter-class dissimilarities. Finally, we post-process the selected 2D views to estimate their upright orientation. We exploit the fact that most of natural and man-made shapes are symmetric and their upright orientation is aligned with their major axis of symmetry. Experiments on the best-view selection benchmark demonstrate that the estimated best views with our data-driven approach are robust to intra-class variations and are consistent within the models of the same class of shapes. This makes the approach suitable for online visual browsing of large 3D data collections.

[1]  Masayuki Nakajima,et al.  Supervised Learning of Salient 2D Views of 3D Models , 2008 .

[2]  Liwei Wang,et al.  Theory and Algorithm for Learning with Dissimilarity Functions , 2009, Neural Computation.

[3]  Sven J. Dickinson,et al.  Selecting canonical views for view-based 3-D object recognition , 2004, ICPR 2004.

[4]  Mongi A. Abidi,et al.  Shape analysis algorithm based on information theory , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[6]  Mateu Sbert,et al.  Viewpoint Selection using Viewpoint Entropy , 2001, VMV.

[7]  C. Gotsman,et al.  What ’ s in an Image ? Towards the Computation of the “ Best ” View of an Object , 2005 .

[8]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[9]  Anne Verroust-Blondet,et al.  Alignment of 3D models , 2009, Graph. Model..

[10]  Thomas A. Funkhouser,et al.  Selecting Distinctive 3D Shape Descriptors for Similarity Retrieval , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[11]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[12]  Hans-Peter Seidel,et al.  Towards Stable and Salient Multi-View Representation of 3D Shapes , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[13]  Michela Spagnuolo,et al.  Semantics-driven best view of 3D shapes , 2009, Comput. Graph..

[14]  Thomas A. Funkhouser,et al.  Distinctive regions of 3D surfaces , 2007, TOGS.

[15]  Afzal Godil,et al.  A benchmark for best view selection of 3D objects , 2010, 3DOR '10.

[16]  Sadegh Abbasi,et al.  Automatic Selection of Optimal Views in Multi-view Object Recognition , 2000, BMVC.

[17]  T. Nishita,et al.  Locating Optimal Viewpoints for Volume Visualization , 2005 .

[18]  D. Cohen-Or,et al.  Upright orientation of man-made objects , 2008, SIGGRAPH 2008.

[19]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[20]  Hamid Laga Semantics-Driven Approach for Automatic Selection of Best Views of 3D Shapes , 2010, 3DOR@Eurographics.

[21]  Mateu Sbert,et al.  Automatic View Selection Using Viewpoint Entropy and its Application to Image‐Based Modelling , 2003, Comput. Graph. Forum.

[22]  Silvia Biasotti,et al.  What’s in an image? , 2005, The Visual Computer.