Predicting OWL Reasoners: Locally or Globally?

We propose a novel approach for performance prediction of OWL reasoners. It selects suitable, small ontology subsets, and then extrapolates reasoner’s performance on them to the whole ontology. We investigate intercorrelation of ontology features using PCA. Finally, we discuss various error measures for performance prediction and compare our approach against an existing one using these measures.

[1]  Kevin Leyton-Brown,et al.  Algorithm runtime prediction: Methods & evaluation , 2012, Artif. Intell..

[2]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[3]  Ian Horrocks,et al.  FaCT++ Description Logic Reasoner: System Description , 2006, IJCAR.

[4]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[5]  Ian Horrocks,et al.  Handbook of Knowledge Representation Edited Description Logics 3.1 Introduction , 2022 .

[6]  Bijan Parsia,et al.  Performance Heterogeneity and Approximate Reasoning in Description Logic Ontologies , 2012, International Semantic Web Conference.

[7]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[8]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[9]  Shonali Krishnaswamy,et al.  Predicting Reasoning Performance Using Ontology Metrics , 2012, SEMWEB.

[10]  Chiara Del Vescovo,et al.  The Modular Structure of an Ontology: Atomic Decomposition , 2011, IJCAI.

[11]  Viachaslau Sazonau.  PERFORMANCE PREDICTION OF OWL REASONERS , 2013 .

[12]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[13]  Eugene Tuv,et al.  Best Subset Feature Selection for Massive Mixed-Type Problems , 2006, IDEAL.

[14]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[15]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[16]  Boris Motik,et al.  A Hypertableau Calculus for SHIQ , 2007, Description Logics.

[17]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[18]  Franz Baader.  Description Logics , 2009, Reasoning Web.

[19]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[20]  Samantha Bail,et al.  A Corpus of OWL DL Ontologies , 2013, Description Logics.