Towards Quality Measures for Evaluating Thesauri

Thesaurus evaluation has often focused on the task of retrieval or analyzed the information environment including factors such as the user, the user interface. Rarely ever has the quality of a thesaurus as an artefact itself been focus of attention. In particular, there are no measures, which provide a holistic description of its intrinsic characteristics as an artefact. This paper suggests a range of abstract measurement constructs based on quality notions in thesaurus literature and inference from other related literature. The suggested measurement constructs allow representing a thesaurus in evaluation approaches, which thereby becomes empirically testable.

[1]  Gail Hodge,et al.  Systems of Knowledge Organization for Digital Libraries: Beyond Traditional Authority Files , 2000 .

[2]  Douglas Tudhope,et al.  A reference model for user-system interaction in thesaurus-based searching , 2006, J. Assoc. Inf. Sci. Technol..

[3]  Vera Lúcia Strube de Lima,et al.  Evaluation of a Thesaurus-Based Query Expansion Technique , 2003, PROPOR.

[4]  Letha H. Etzkorn,et al.  Cohesion Metrics for Ontology Design and Application , 2005 .

[5]  William E. Moen,et al.  The Role of Content Analysis in Evaluating Metadata for the U.S. Government Information Locator Service (GILS): Results from an Exploratory Study , 1997 .

[6]  Emily Gallup Fayen,et al.  Guidelines for the construction, format, and management of monolingual controlled vocabularies : A revision of ANSI/NISO Z39.19 for the 21st century , 2007 .

[7]  Ronald L. Woodfin.  Definitions, Symbols and Abbreviations , 2006 .

[8]  Ling Liu,et al.  Encyclopedia of Database Systems , 2009, Encyclopedia of Database Systems.

[9]  Diane I. Hillmann,et al.  Metadata in Practice , 2004 .

[10]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[11]  Dagobert Soergel.  Indexing and retrieval performance: the logical evidence , 1994 .

[12]  Linda C. Smith,et al.  A framework for information quality assessment , 2007 .

[13]  Daniel Cunliffe,et al.  Qualitative Evaluation of Thesaurus-Based Retrieval , 2002, ECDL.

[14]  Ali Shiri,et al.  Query expansion behavior within a thesaurus-enhanced search environment: A user-centered evaluation , 2006, J. Assoc. Inf. Sci. Technol..

[15]  Jung-ran Park.  Metadata Quality in Digital Repositories: A Survey of the Current State of the Art , 2009 .

[16]  Fausto Giunchiglia,et al.  Lightweight Ontologies , 2009, Encyclopedia of Database Systems.

[17]  Stephen P. Luby,et al.  Appendix Table 2 , 2007 .

[18]  Birger Hjørland,et al.  Knowledge Organization , 2005 .

[19]  David Bawden,et al.  Thesaurus Construction and Use: A Practical Manual , 2000 .

[20]  Diane I. Hillmann,et al.  The Continuum of Metadata Quality: Defining, Expressing, Exploiting , 2004 .

[21]  Aldo Gangemi,et al.  Modelling Ontology Evaluation and Validation , 2006, ESWC.

[22]  Marianne Lykke,et al.  A framework for work task based thesaurus design , 2001, J. Documentation.