Content-Dependent Image Search System for Aggregation of Color, Shape and Texture Features

The existing image search system often faces difficulty in finding an appropriate retrieved image corresponding to an image query. The difficulty is commonly caused by the users’ intention for searching image is different with dominant information of the image collected from feature extraction. In this paper, we present a new approach for the content-dependent image search system. The system utilizes information of color distribution inside an image and detects a cloud of clustered colors as something supposed as an object. We apply segmentation of an image as a content-dependent process before feature extraction in order to identify is there any object or not inside an image. The system extracts 3 features, which are color, shape, and texture features and aggregates these features for similarity measurement between an image query and image database. HSV histogram color is used to extract the color feature of the image. While the shape feature extraction used Connected Component Labeling (CCL) which is calculated the area value, equivalent diameter, extent, convex hull, solidity, eccentricity, and perimeter of each object. The texture feature extraction used Leung Malik (LM)’s approach with 15 kernels. For applicability of our proposed system, we applied the system with benchmark 1000 image SIMPLIcity dataset consisting of 10 categories namely Africans, beaches, buildings historians, buses, dinosaurs, elephants, roses, horses, mountains, and food. The experimental results performed 62% accuracy rate to detect objects by color feature, 71% by texture feature, 60% by shape feature, 72% by combined color-texture feature, 67% by combined color-shape feature, 72 % combined texture-shape features and 73% combined all features.

[1]  Bo Wang,et al.  Partial likelihood for estimation of multi-class posterior probabilities , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[2]  Guan Yong,et al.  Image Edge Detection Algorithm Based on Improved Canny Operator , 2012 .

[3]  Ali Ridho Barakbah,et al.  Identifying moving variance to make automatic clustering for normal data set , 2004 .

[4]  Ali Ridho Barakbah,et al.  Image Search System with Automatic Weighting Mechanism for Selecting Features , 2010 .

[5]  A. Kutics,et al.  Detecting prominent objects for image retrieval , 2005, IEEE International Conference on Image Processing 2005.

[6]  Fouad Khelifi,et al.  Efficient content based image retrieval based on Semantic Object Detection , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[7]  Yunhe Pan,et al.  Using Hybrid Knowledge Engineering and Image Processing in Color Virtual Restoration of Ancient Murals , 2003, IEEE Trans. Knowl. Data Eng..

[8]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[9]  Gio Wiederhold,et al.  Semantics-sensitive integrated matching for picture libraries and biomedical image databases , 2000 .

[10]  Darlis Herumurti,et al.  Fractal-based texture and HSV color features for fabric image retrieval , 2015, 2015 IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[11]  Ali Ridho Barakbah,et al.  Determining Constraints of Moving Variance to Find Global Optimum and Make Automatic Clustering , 2004 .

[12]  Toshikazu Kato,et al.  Database architecture for content-based image retrieval , 1992, Electronic Imaging.

[13]  K. Hamamoto,et al.  Content-based image retrieval system based on combined and weighted multi-features , 2013, 2013 13th International Symposium on Communications and Information Technologies (ISCIT).

[14]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[16]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[17]  Ali Ridho Barakbah,et al.  Hierarchical K-means: an algorithm for centroids initialization for K-means , 2007 .

[18]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[19]  Alauddin Bhuiyan,et al.  Automatic Segmentation of Dermoscopy Images Using Histogram Thresholding on Optimal Color Channels , 2011 .

[20]  Jiang Xiuhua,et al.  An Improved Algorithm Based on Color Feature Extraction for Image Retrieval , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[21]  N.K. Narayanan,et al.  Image retrieval using combination of color, texture and shape descriptor , 2016, 2016 International Conference on Next Generation Intelligent Systems (ICNGIS).

[22]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.