A comprehensive framework for the evaluation of ontology modularization

Highlights? We propose a new evaluation framework for ontology modularization tools. ? Three aspects of tool evaluation: tool performance, data performance, and usability. ? Implicit comparison and empirical analysis are performed. ? We perform an empirical analysis using analytic hierarchy process. The Semantic Web and ontologies have received increased attention in recent years. The delivery of well-designed ontologies enhances the effect of Semantic Web services, but building ontologies from scratch requires considerable time and effort. Modularizing ontologies and integrating ontology modules to a given context help users effectively develop ontologies and revitalize ontology dissemination. Therefore, various tools for modularizing ontologies have been developed. However, selecting an appropriate tool to fit a given context is difficult because the assumptions for the approaches greatly vary. Therefore, a suitable framework is required to compare and help screen the most suitable modularization tool.In this research, we propose a new evaluation framework for selecting an appropriate ontology modularization tool. We present three aspects of tool evaluation as the main dimensions for the assessment of modularization tools: tool performance, data performance, and usability.This study provides an implicit evaluation and an empirical analysis of three modularization tools. It also provides an evaluation method for ontology modularization, enabling ontology engineers to compare different modularization tools and easily choose an appropriate one for the production of qualifying ontology modules.The experimental results indicate that the proposed evaluation criteria for ontology modularization tools are valid and effective. This research provides a useful method for assessing and selecting ontology modularization tools. Modularization performance, data performance, and usability are the three modularization aspects designed and applied to the context of ontology. We provide a new focus on the comprehensive framework to evaluate the performance and usability of ontology modularization tools. The proposed framework should be of value to both ontology engineers, who are interested in ontology modularization, and to practitioners, who need information on how to evaluate and select a specific type of ontology tool in accordance with the requirements of the individual environment.