Combining semantic technologies with a content-based image retrieval system – Preliminary considerations

Nowadays, as a part of systematic growth of volume, and variety, of information that can be found on the Internet, we observe also dramatic increase in sizes of available image collections. There are many ways to help users browsing / selecting images of interest. One of popular approaches are Content-Based Image Retrieval (CBIR) systems, which allow users to search for images that match their interests, expressed in the form of images (query by example). However, we believe that image search and retrieval could take advantage of semantic technologies. We have decided to test this hypothesis. Specifically, on the basis of knowledge captured in the CBIR, we have developed a domain ontology of residential real estate (detached houses, in particular). This allows us to semantically represent each image (and its constitutive architectural elements) represented within the CBIR. The proposed ontology was extended to capture not only the elements resulting from image segmentation, but also “spatial relations” be...

[1]  Tatiana Jaworska Image preprocessing for CBIR system , 2007, ICINCO-SPSMC.

[2]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[4]  Tatiana Jaworska CBIR search engine for user designed query (UDQ) , 2015, 2015 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K).

[5]  Andrei Bursuc,et al.  ARTEMIS @ MediaEval 2013: A Content-Based Image Clustering Method for Public Image Repositories , 2013, MediaEval.

[6]  Maria Ganzha,et al.  From implicit semantics towards ontologies — practical considerations from the INTER-IoT perspective , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[7]  Louis Vuurpijl,et al.  Human-centered content-based image retrieval , 2008, Electronic Imaging.

[8]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[9]  Michael S. Lew,et al.  Principles of Visual Information Retrieval , 2001, Advances in Pattern Recognition.

[10]  Joni-Kristian Kämäräinen,et al.  Unsupervised object discovery via self-organisation , 2012, Pattern Recognit. Lett..

[11]  Tatiana Jaworska,et al.  The Inner Structure of Database for the CBIR System , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.