Semantic Image Retrieval: An Ontology Based Approach

Images / Videos are major source of content on the internet and the content is increasing rapidly due to the advancement in this area. Image analysis and retrieval is one of the active research field and researchers from the last decade have proposed many efficient approaches for the same. Semantic technologies like ontology offers promising approach to image retrieval as it tries to map the low level image features to high level ontology concepts. In this paper, we have proposed Semantic Image Retrieval: An Ontology based Approach which uses domain specific ontology for image retrieval relevant to the user query. The user can give concept / keyword as text input or can input the image itself. Semantic Image Retrieval is based on hybrid approach and uses shape, color and texture based approaches for classification purpose. Mammals domain is used as a test case and its ontology is developed. The proposed system is trained on Mammals dataset and tested on large number of test cases related to this domain. Experimental results show the efficiency / accuracy of the proposed system and support the implementation of the same.

[1]  B. S. Manjunath,et al.  Cortina: a system for large-scale, content-based web image retrieval , 2004, MULTIMEDIA '04.

[2]  Isabelle Bichindaritz,et al.  Automatic semantic indexing of medical images using a web ontology language for case-based image retrieval , 2009, Eng. Appl. Artif. Intell..

[3]  Naif Alajlan,et al.  Geometry-Based Image Retrieval in Binary Image Databases , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Umar Manzoor,et al.  Simulation Modelling Practice and Theory , 2014 .

[5]  Xiangyang Wang,et al.  Content-based image retrieval using local visual attention feature , 2014, J. Vis. Commun. Image Represent..

[6]  Yacine Rezgui,et al.  Categorization of malicious behaviors using ontology-based cognitive agents , 2013, Data Knowl. Eng..

[7]  Subrahmanyam Murala,et al.  Expert content-based image retrieval system using robust local patterns , 2014, J. Vis. Commun. Image Represent..

[8]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[9]  Jurandy Almeida,et al.  A scalable re-ranking method for content-based image retrieval , 2014, Inf. Sci..

[10]  Shyamala C. Doraisamy,et al.  Texture classification and discrimination for region-based image retrieval , 2015, J. Vis. Commun. Image Represent..

[11]  Xiangyang Wang,et al.  A new SVM-based active feedback scheme for image retrieval , 2015, Eng. Appl. Artif. Intell..

[12]  Peter Veelaert,et al.  Adaptive and optimal difference operators in image processing , 2009, Pattern Recognit..

[13]  Samia Nefti-Meziani,et al.  iDetect: Content Based Monitoring of Complex Networks using Mobile Agents , 2012, Appl. Soft Comput..

[14]  Francesco Rea,et al.  Ontology enhancing process for a situated and curiosity-driven robot , 2014, Robotics Auton. Syst..

[15]  Pao-Chi Chang,et al.  Content-based image retrieval using H.264 intra coding features , 2014, J. Vis. Commun. Image Represent..

[16]  ManzoorUmar,et al.  Categorization of malicious behaviors using ontology-based cognitive agents , 2013 .

[17]  Monique Thonnat,et al.  Ontology based complex object recognition , 2008, Image Vis. Comput..

[18]  Jianzhong Wang,et al.  A novel image retrieval method based on hybrid information descriptors , 2014, J. Vis. Commun. Image Represent..

[19]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[20]  Kamal Jamshidi,et al.  A semantic model for general purpose content-based image retrieval systems , 2014, Comput. Electr. Eng..

[21]  Muhammad Sharif,et al.  Content Based Image Retrieval: Survey , 2012 .

[22]  Y. Rezgui,et al.  BUILDING A BILINGUAL BIO-ONTOLOGY PLATFORM FOR KNOWLEDGE DISCOVERY , 2011 .

[23]  Minglun Gong,et al.  CIDER: Concept-based image diversification, exploration, and retrieval , 2013, Inf. Process. Manag..

[24]  Daniel L. Rubin,et al.  A Comprehensive Descriptor of Shape: Method and Application to Content-Based Retrieval of Similar Appearing Lesions in Medical Images , 2012, Journal of Digital Imaging.

[25]  Umar Manzoor,et al.  Ontology based image retrieval , 2012, 2012 International Conference for Internet Technology and Secured Transactions.

[26]  Daniel L. Rubin,et al.  On combining image-based and ontological semantic dissimilarities for medical image retrieval applications , 2014, Medical Image Anal..

[27]  Andrew Blake,et al.  Contour-based learning for object detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[29]  Orkunt Sabuncu,et al.  An ontology-based retrieval system using semantic indexing , 2010, 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010).

[30]  Dianhui Wang,et al.  Machine learning in intelligent image processing , 2013, Signal Process..

[31]  Ryszard S. Choras.  Content-Based Image Retrieval - A Survey , 2006, Biometrics, Computer Security Systems and Artificial Intelligence Applications.

[32]  Ben Taskar,et al.  Shape-Based Object Detection via Boundary Structure Segmentation , 2012, International Journal of Computer Vision.

[33]  Stefan Poslad,et al.  A Multi-Modal Incompleteness Ontology model (MMIO) to enhance information fusion for image retrieval , 2014, Inf. Fusion.

[34]  Umar Manzoor,et al.  A Tool for Agent Based Modeling - A Land Market Case Study , 2011, WSKS.

[35]  Daniel L. Rubin,et al.  A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations , 2014, J. Biomed. Informatics.

[36]  Yacine Rezgui,et al.  Autonomous Malicious Activity Inspector - AMAI , 2010, NLDB.

[37]  Malay Kumar Kundu,et al.  A graph-based relevance feedback mechanism in content-based image retrieval , 2015, Knowl. Based Syst..

[38]  Escuela Politécnica Superior,et al.  Semantically enhanced Information Retrieval: an ontology-based approach , 2009 .

[39]  Samia Nefti-Meziani,et al.  V-NIP Ceaser: Video Stabilization System , 2010, WSKS.

[40]  Alaa Mohamed Riad,et al.  A Literature Review of Image Retrieval based on Semantic Concept , 2012 .