Self-adaptive Feature Extraction Scheme for Mobile Image Retrieval of Flowers

This paper proposes a new self-adaptive feature extraction scheme to improve retrieval precision for Content-based Image Retrieval (CBIR) systems on mobile phones such that users can search similar pictures for a query image taken from their mobile phones. The proposed methods employ a newly modified extraction method using the Canny edge-based Edge Histogram Descriptor (CEHD), Color Layout Descriptor (CLD) and the Curvature Scale Space (CSS) shape-based descriptor. To obtain object shapes, salient regions are detected by means of a multi-scale self-developed segmentation model. Experiments were conducted using flower images as image data in order to verify the most pertinent feature extraction methods in designing a domain knowledge-driven self-adaptive feature extraction scheme. Test results prove that the CSS descriptor is useful to determine prominent features of a flower image before employing additional extraction techniques. By that means, the system can enhance retrieval precision and avoid unnecessarily extracting insignificant features.

[1]  Naixue Xiong,et al.  Garment Image Retrieval on the Web with Ubiquitous Camera-Phone , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.

[2]  Andrea Kutics,et al.  Use of Adaptive Still Image Descriptors for Annotation of Video Frames , 2007, ICIAR.

[3]  Wolfgang Müller,et al.  Picadomo: Faceted Image Browsing for Mobile Devices , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Keiichiro Hoashi,et al.  High-Level Feature Extraction Experiments for TRECVID 2007 , 2007, TRECVID.

[6]  Moncef Gabbouj,et al.  Content-based image indexing and retrieval framework on symbian based mobile platform , 2005, 2005 13th European Signal Processing Conference.

[7]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[8]  Moncef Gabbouj,et al.  A generic content-based image retrieval framework for mobile devices , 2010, Multimedia Tools and Applications.

[9]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[10]  De Xu,et al.  Automatic video annotation with adaptive number of key words , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  Josef Kittler,et al.  Curvature scale space image in shape similarity retrieval , 1999, Multimedia Systems.

[12]  Jonathon S. Hare,et al.  Content-based image retrieval using a mobile device as a novel interface , 2005, IS&T/SPIE Electronic Imaging.

[13]  Andrea Kutics,et al.  Naming of Image Regions for User-Friendly Image Retrieval , 2006, ICIAR.

[14]  A. Kutics,et al.  Detecting prominent objects for image retrieval , 2005, IEEE International Conference on Image Processing 2005.

[15]  Xing Xie,et al.  Inquiring of the Sights from the Web via Camera Mobiles , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[16]  Andrea Kutics,et al.  MOSIR: Image and Segment-Based Retrieval for Mobile Phones , 2010, PCM.

[17]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[18]  Noboru Sonehara,et al.  Image-Identification Methods for Camera-Equipped Mobile Phones , 2007, 2007 International Conference on Mobile Data Management.