Content-Based Image Retrieval Using Shape and Depth from an Engineering Database

Content based image retrieval (CBIR), a technique which uses visual contents to search images from the large scale image databases, is an active area of research for the past decade. It is increasingly evident that an image retrieval system has to be domain specific. In this paper, we present an algorithm for retrieving images with respect to a database consisting of engineering/computer-aided design (CAD) models. The algorithm uses the shape information in an image along with its 3D information. A linear approximation procedure that can capture the depth information using the idea of shape from shading has been used. Retrieval of objects is then done using a similarity measure that combines shape and the depth information. Plotted precision/recall curves show that this method is very effective for an engineering database.

[1]  Jing Huang,et al.  Spatial Color Indexing and Applications , 2004, International Journal of Computer Vision.

[2]  Barbara Caputo,et al.  How to Combine Color and Shape Information for 3D Object Recognition: Kernels do the Trick , 2002, NIPS.

[3]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[4]  James Ze Wang,et al.  Content-based image retrieval: approaches and trends of the new age , 2005, MIR '05.

[5]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[6]  C.-C. Jay Kuo,et al.  Shape from Shading with a Generalized Reflectance Map Model , 1997, Comput. Vis. Image Underst..

[7]  Ugur Güdükbay,et al.  A Histogram-Based Approach for Object-Based Query-by-Shape-and-Color in Multimedia Databases , 2002 .

[8]  Dengsheng Zhang,et al.  A comparative study on shape retrieval using Fourier descriptiors with different shape signatures , 2001 .

[9]  P. W. Huang,et al.  Using 2D C+-strings as spatial knowledge representation for image database systems , 1994, Pattern Recognit..

[10]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[11]  Ioannis Patras,et al.  Combining color and shape information for illumination-viewpoint invariant object recognition , 2006, IEEE Transactions on Image Processing.

[12]  Guojun Lu,et al.  A Comparison of Shape Retrieval Using Fourier Descriptors and Short-Time Fourier Descriptors , 2001, IEEE Pacific Rim Conference on Multimedia.

[13]  Luis Salgado,et al.  Visual Content Processing and Representation , 2003, Lecture Notes in Computer Science.

[14]  László Czúni,et al.  Depth-Based Indexing and Retrieval of Photographic Images , 2003, VLBV.

[15]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[16]  Xiuqi Li,et al.  Image Retrieval By Color , Texture , And Spatial Information , 2002 .

[17]  Ling Shao,et al.  Invariant salient regions based image retrieval under viewpoint and illumination variations , 2006, J. Vis. Commun. Image Represent..

[18]  Hong Chang,et al.  Kernel-based distance metric learning for content-based image retrieval , 2007, Image Vis. Comput..

[19]  Simone Santini,et al.  Image retrieval by shape and texture , 1999, Pattern Recognit..

[20]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..