Evaluating search features of Google Knowledge Graph and Bing Satori: Entity types, list searches and query interfaces

Purpose – The purpose of this paper is to better understand three main aspects of semantic web search engines of Google Knowledge Graph and Bing Satori. The authors investigated: coverage of entity types, the extent of their support for list search services and the capabilities of their natural language query interfaces. Design/methodology/approach – The authors manually submitted selected queries to these two semantic web search engines and evaluated the returned results. To test the coverage of entity types, the authors selected the entity types from Freebase database. To test the capabilities of natural language query interfaces, the authors used a manually developed query data set about US geography. Findings – The results indicate that both semantic search engines cover only the very common entity types. In addition, the list search service is provided for a small percentage of entity types. Moreover, both search engines support queries with very limited complexity and with limited set of recognised ...

[1]  Igor Jurisica,et al.  Knowledge Discovery and Data Mining in Biomedical Informatics: State-of-the-Art and Future Challenges , 2014 .

[2]  Esther Kaufmann,et al.  Talking to the semantic web - natural language query interfaces for casual end-users , 2007, Ausgezeichnete Informatikdissertationen.

[3]  Dirk Lewandowski,et al.  The freshness of web search engine databases , 2006, J. Inf. Sci..

[4]  Mike Thelwall,et al.  Search engine coverage bias: evidence and possible causes , 2004, Inf. Process. Manag..

[5]  Djoerd Hiemstra,et al.  Query log analysis in the context of information retrieval for children , 2010, SIGIR '10.

[6]  Nigel Shadbolt,et al.  Ranking methods for entity‐oriented semantic web search , 2014, J. Assoc. Inf. Sci. Technol..

[7]  Frank van Harmelen,et al.  Ontology-Based Information Visualization: Toward Semantic Web Applications , 2006, Visualizing the Semantic Web, 2nd Edition.

[8]  Andreas Holzinger,et al.  Interactive Knowledge Discovery and Data Mining in Biomedical Informatics , 2014, Lecture Notes in Computer Science.

[9]  Ravi Kumar,et al.  A web of concepts , 2009, PODS.

[10]  John Grundy,et al.  Interactive Visualization Tools for Exploring the Semantic Graph of Large Knowledge Spaces , 2009 .

[11]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[12]  C. Lee Giles,et al.  Accessibility of information on the Web , 2000, INTL.

[13]  Harry R. Tennant,et al.  Talk to Your Semantic Web , 2005, IEEE Internet Comput..

[14]  Hamish Cunningham,et al.  Natural Language Interfaces to Ontologies: Combining Syntactic Analysis and Ontology-Based Lookup through the User Interaction , 2010, ESWC.

[15]  Andrei Z. Broder,et al.  A Technique for Measuring the Relative Size and Overlap of Public Web Search Engines , 1998, Comput. Networks.

[16]  Abraham Bernstein,et al.  Evaluating Semantic Search Systems to Identify Future Directions of Research , 2012, ESWC.

[17]  Balachander Krishnamurthy,et al.  Measuring personalization of web search , 2013, WWW.

[18]  Dirk Lewandowski.  Web Search Engine Research , 2012 .

[19]  Mike Thelwall,et al.  Search markets and search results: The case of Bing , 2013 .

[20]  Heidrun Schumann,et al.  CGV - An interactive graph visualization system , 2009, Comput. Graph..

[21]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[22]  Dirk Lewandowski,et al.  What Users See - Structures in Search Engine Results Pages , 2009, Inf. Sci..

[23]  Raymond J. Mooney,et al.  Learning to Parse Database Queries Using Inductive Logic Programming , 1996, AAAI/IAAI, Vol. 2.

[24]  Andreas Holzinger,et al.  Multi-touch Graph-Based Interaction for Knowledge Discovery on Mobile Devices: State-of-the-Art and Future Challenges , 2014, Interactive Knowledge Discovery and Data Mining in Biomedical Informatics.

[25]  Abraham Bernstein,et al.  Evaluating the usability of natural language query languages and interfaces to Semantic Web knowledge bases , 2010, J. Web Semant..

[26]  Luiz André Barroso,et al.  Web Search for a Planet: The Google Cluster Architecture , 2003, IEEE Micro.

[27]  Abraham Bernstein,et al.  Querying the Semantic Web with Ginseng: A Guided Input Natural Language Search Engine , 2009 .

[28]  Abraham Bernstein,et al.  Querix: A Natural Language Interface to Query Ontologies Based on Clarification Dialogs , 2006 .

[29]  Torsten Suel,et al.  Analysis of geographic queries in a search engine log , 2008, LocWeb.

[30]  Ahmet Uyar,et al.  Investigation of the accuracy of search engine hit counts , 2009, J. Inf. Sci..