The OWL Reasoner Evaluation (ORE) 2015 Resources

The OWL Reasoner Evaluation (ORE) Competition is an annual competition (with an associated workshop) which pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we outline the design of the competition and present the infrastructure used for its execution: the corpora of ontologies, the competition framework, and the submitted systems. All resources are publicly available on the Web, allowing users to easily re-run the 2015 competition, or reuse any of the ORE infrastructure for reasoner experiments or ontology analysis.

[1]  Bijan Parsia,et al.  The OWL Full/DL Gap in the Field , 2014, OWLED.

[2]  Ian Horrocks,et al.  FaCT++ Description Logic Reasoner: System Description , 2006, IJCAR.

[3]  Boris Motik,et al.  HermiT: An OWL 2 Reasoner , 2014, Journal of Automated Reasoning.

[4]  Jeff Z. Pan,et al.  TrOWL: Tractable OWL 2 Reasoning Infrastructure , 2010, ESWC.

[5]  Bijan Parsia,et al.  A Survey of Current, Stand-alone OWL Reasoners , 2015, ORE.

[6]  Bijan Parsia,et al.  The OWL Reasoner Evaluation (ORE) 2015 Competition Report , 2017, Journal of Automated Reasoning.

[7]  Boris Motik,et al.  OWL 2 Web Ontology Language: structural specification and functional-style syntax , 2008 .

[8]  Geoff Sutcliffe,et al.  The state of CASC , 2006, AI Commun..

[9]  Jeff Z. Pan,et al.  Soundness Preserving Approximation for TBox Reasoning , 2010, AAAI.

[10]  David Osumi-Sutherland,et al.  The Drosophila phenotype ontology , 2013, J. Biomed. Semant..

[11]  Christopher G. Chute,et al.  BioPortal: ontologies and integrated data resources at the click of a mouse , 2009, Nucleic Acids Res..

[12]  Julian Mendez,et al.  jcel: A Modular Rule-based Reasoner , 2012, ORE.

[13]  Samantha Bail,et al.  A Snapshot of the OWL Web , 2013, International Semantic Web Conference.

[14]  Sean Bechhofer,et al.  The OWL API: A Java API for OWL ontologies , 2011, Semantic Web.

[15]  Yevgeny Kazakov,et al.  From Polynomial Procedures to Efficient Reasoning with EL Ontologies , 2013 .

[16]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[17]  Birte Glimm,et al.  Konclude: System description , 2014, J. Web Semant..

[18]  Geoff Sutcliffe,et al.  The development of CASC , 2002, AI Commun..

[19]  Geoff Sutcliffe.  The TPTP Problem Library and Associated Infrastructure , 2017, Journal of Automated Reasoning.

[20]  Ignazio Palmisano,et al.  Chainsaw: a Metareasoner for Large Ontologies , 2012, ORE.

[21]  Geoff Sutcliffe.  The TPTP Problem Library and Associated Infrastructure , 2009, Journal of Automated Reasoning.

[22]  Bijan Parsia,et al.  The Empirical Robustness of Description Logic Classification , 2013, Description Logics.

[23]  Baris Sertkaya.  The ELepHant Reasoner System Description , 2013, ORE.

[24]  Volker Haarslev,et al.  The RacerPro knowledge representation and reasoning system , 2012, Semantic Web.

[25]  Yavor Nenov,et al.  Pay-As-You-Go OWL Query Answering Using a Triple Store , 2014, AAAI.

[26]  Ian Horrocks,et al.  MORe: Modular Combination of OWL Reasoners for Ontology Classification , 2012, SEMWEB.

[27]  Bijan Parsia,et al.  ORE 2015 Reasoner Competition Dataset , 2015 .

[28]  Michel Dumontier,et al.  Ontology-Based Querying with Bio2RDF’s Linked Open Data , 2013, Journal of Biomedical Semantics.

[29]  Markus Krötzsch,et al.  The Incredible ELK , 2013, Journal of Automated Reasoning.