A framework for 3D CAD models retrieval from 2D images

The management of big databases of three-dimensional models (used inCad applications, visualisation, games, etc.) is a very important domain. The ability to characterise and easily retrieve models is a key issue for the designers and the final users. In this frame, two main approaches exist: search by example of a three-dimensional model, and search by a 2D view or photos. In this paper, we present a novel framework for the characterisation of a 3D model by a set of views (called characteristic views), and an indexing process of these models with a Bayesian probabilistic approach using the characteristic views. The framework is independent from the descriptor used for the indexing. We illustrate our results using different descriptors on a collection of three-dimensional models supplied by the car manufacturer Renault. We also present our results on retrieval of 3D models from a single photo.RésuméLa gestion de grandes bases de données de modèles tridimensionnels (utilisés dans des applications deCao, de visualisation, des jeux, etc.) est un domaine très important. La capacité de caractériser et rechercher facilement des modèles est une question clé pour les concepteurs et les utilisateurs finaux. Deux approches principales existent : la recherche par l’exemple d’un modèle tridimensionnel, et la recherche par une vue 2D ou des photos. Dans cet article, nous présentons un cadre pour la caractérisation d’un modèle 3D par un ensemble de vues (appelées vues caractéristiques), et un processus d’indexation de ces modèles avec une approche probabiliste bayésienne en utilisant les vues caractéristiques. Le système est indépendant du descripteur utilisé pour l’indexation. Nous illustrons nos résultats en utilisant différents descripteurs sur une collection de modèles tridimensionnels fournis par le constructeur automobile Renault. Nous présentons également nos résultats sur l’indexa-don de modèle 3D à partir de photos.

[1]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  June-Ho Yi,et al.  Model-Based 3D Object Recognition Using Bayesian Indexing , 1998, Comput. Vis. Image Underst..

[3]  Guofu Zhou,et al.  L , 2021, Edinburgh Medical and Surgical Journal.

[4]  D. Eberly Geometric methods for analysis of ridges in n-dimensional images , 1994 .

[5]  Mohamed Daoudi,et al.  A practical approach for 3D model indexing by combining local and global invariants , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[6]  Sadegh Abbasi,et al.  Affine-similar shape retrieval: application to multiview 3-D object recognition , 2001, IEEE Trans. Image Process..

[7]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[8]  Linda G. Shapiro,et al.  3D Object Recognition and Pose with Relational Indexing , 2000, Comput. Vis. Image Underst..

[9]  Ming Ouhyoung,et al.  A 3 D Model Alignment and Retrieval System , 2002 .

[10]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Chahab Nastar The Image Shape Spectrum for Image Retrieval , 1997 .

[12]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[13]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[14]  Jin-Long Chen,et al.  3D Free-Form Object Recognition Using Indexing by Contour Features , 1998, Comput. Vis. Image Underst..

[15]  Mohamed Daoudi,et al.  Visual Image Retrieval by Multiscale Description of User Sketches , 2000, J. Vis. Lang. Comput..

[16]  Francoise Preteux,et al.  Indexation de maillages 3D par descripteurs de forme , 2002 .

[17]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[18]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[19]  Chitra Dorai,et al.  Shape Spectrum Based View Grouping and Matching of 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  K JainAnil,et al.  Shape Spectrum Based View Grouping and Matching of 3D Free-Form Objects , 1997 .