A Semantic Query Interpreter framework by using knowledge bases for image search and retrieval

Due to the ubiquitous ness of the digital media including broadcast news, documentary videos, meeting, movies, etc. and the progression in the technology and the decreasing outlay of the storage media leads to an increase in the data production. This explosive proliferation of the digital media without appropriate management mimics its exploitation. Presently, the multimedia search and retrieval are an active research dilemma among the academia and the industry. The online data repositories like Google, YouTube, Flicker, etc. provides a gigantic bulk of information but findings and accessing the data of interest becomes difficult. Due to this explosive proliferation, there is a strong urge for the system that can efficiently and effectively interpret the user demand for searching and retrieving the relevant information. In order to cope with these problems, we are proposing a novel technique for automatic query interpretation known as the Semantic Query Interpreter (SQI). SQI interprets the user query both lexically and semantically by using open source knowledge bases i.e. WordNet and ConceptNet. Effectiveness of the proposed method is explored on the open-benchmark image data set the LabelMe. Experimental results manifest that SQI shows substantial rectification over the traditional ones.

[1]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[2]  Henry Lieberman,et al.  Aria: an agent for annotating and retrieving images , 2001, Computer.

[3]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[4]  Ellen M. Voorhees,et al.  Query expansion using lexical-semantic relations , 1994, SIGIR '94.

[5]  Beixing Deng,et al.  Concept Based Query Expansion Using WordNet , 2009, 2009 International e-Conference on Advanced Science and Technology.

[6]  Peter Willett,et al.  The limitations of term co-occurrence data for query expansion in document retrieval systems , 1991, J. Am. Soc. Inf. Sci..

[7]  Vijayan Sugumaran,et al.  Improving web-query processing through semantic knowledge , 2008, Data Knowl. Eng..

[8]  Shyi-Ming Chen,et al.  Query expansion for document retrieval based on fuzzy rules and user relevance feedback techniques , 2006, Expert Syst. Appl..

[9]  Zongli Jiang,et al.  A new technology of query expansion based on new user interest model , 2010, 2010 2nd International Conference on Future Computer and Communication.

[10]  Henry Lieberman,et al.  Beating Common Sense into Interactive Applications , 2004, AI Mag..

[11]  Hsin-Hsi Chen,et al.  Query Expansion with ConceptNet and WordNet: An Intrinsic Comparison , 2006, AIRS.

[12]  Zhiguo Gong,et al.  Log mining to support web query expansions , 2009, 2009 International Conference on Information and Automation.

[13]  Yiyu Yao,et al.  Conceptual Query Expansion , 2005, AWIC.

[14]  Youngjoong Ko,et al.  Pseudo-relevance feedback and statistical query expansion for web snippet generation , 2008, Inf. Process. Lett..

[15]  P. Smith,et al.  A review of ontology based query expansion , 2007, Inf. Process. Manag..

[16]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[17]  Hongfei Lin,et al.  Query expansion based on folksonomy tag co-occurrence analysis , 2009, 2009 IEEE International Conference on Granular Computing.

[18]  Peter Willett,et al.  The Limitations of Term Co-Occurrence Data for Query Expansion in Document Retrieval Systems , 1991 .

[19]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[20]  Jinguang Gu,et al.  Selecting good expansion terms based on Google similarity distance , 2010, 2010 2nd International Conference on Future Computer and Communication.

[21]  Simone Paolo Ponzetto,et al.  Large-Scale Taxonomy Mapping for Restructuring and Integrating Wikipedia , 2009, IJCAI.

[22]  Sivaji Bandyopadhyay,et al.  Word Sense Disambiguation Using Extended WordNet , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[23]  Hsin-Hsi Chen,et al.  Combining WordNet and ConceptNet for Automatic Query Expansion: A Learning Approach , 2008, AIRS.

[24]  Pertti Vakkari,et al.  Lay persons' and professionals' nutrition-related vocabularies and their matching to a general and a specific thesaurus , 2009, J. Inf. Sci..

[25]  Kambiz Badie,et al.  A Framework for Query Expansion Based on Viewpoint-Oriented Manipulation of the Related Concepts , 2010, 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation.

[26]  Payal Gulati,et al.  Ontology driven conjunctive query expansion based on mining user logs , 2009, 2009 Proceeding of International Conference on Methods and Models in Computer Science (ICM2CS).

[27]  Philippe De Wilde,et al.  Internet search: Subdivision-based interactive query expansion and the soft semantic web , 2006, Appl. Soft Comput..