An Analysis of Applicability using Quality Metrics for Ontologies on Ontology Design Patterns

Ontology design patterns ODPs provide best-practice solutions for common or recurring ontology design problems. This work focuses on content ODPs, which form small ontologies themselves and thus can be subject to ontology quality metrics in general. We investigate the use of such metrics for content ODP evaluation in terms of metrics applicability and validity. The quality metrics used for this investigation are taken from existing work in the area of ontology quality evaluation. We discuss the general applicability to content ODP of each metric considering its definition, ODP characteristics, and the defined goals of ODPs. The research process presented in this paper has two phases. In the first phase, we conducted a literature research in the area of metrics for assessing ontology quality. The second phase consisted of a two-step evaluation of the ontology metrics identified in the literature analysis. During the first step, we investigated whether the metrics are appropriate to differentiate between content ODPs of different quality. Metrics that proved to be applicable were calculated for a random set of 14 content ODPs. In the second step, a controlled experiment, the quality indicated by the metric value was contrasted with the perception of ontology engineers; that is, do 'measured quality' and 'perceived quality' match?. Copyright © 2015 John Wiley & Sons, Ltd.