A Method for Comparing Large Scale Inter-indexer Consistency Using IR Modeling

The authors present a method for comparing indexing consistency between groups of indexers based on the vector space IR model. Terms assigned by indexers are treated as vectors whose distances from a central vector may be compared. The method is outlined and demonstrated with an example. Les auteurs presentent un modele pour comparer la coherence interindexeurs entre des groupes d’indexeurs base sur le modele de RI d’espace vectoriel. Les termes attribues par les indexeurs sont traites comme des vecteurs avec lesquels il est possible de comparer la distance par rapport a un vecteur central. La methode est expliquee et illustree avec un exemple.

[1]  Claire K. Schultz,et al.  Comparative indexing: Terms supplied by biomedical authors and by document titles , 1965 .

[2]  Gerard Salton,et al.  A theory of indexing , 1975, Regional conference series in applied mathematics.

[3]  Loll N. Rolling.  Indexing consistency, quality and efficiency , 1981, Inf. Process. Manag..

[4]  Jarmo Saarti,et al.  Consistency of subject indexing of novels by public library professionals and patrons , 2002, J. Documentation.

[5]  Arlene G. Taylor,et al.  Indexing Overlap and Consistency between the "Avery Index to Architectural Periodicals" and the "Architectural Periodicals Index.". , 1993 .

[6]  M. E. Maron,et al.  On indexing, retrieval and the meaning of about , 1977, J. Am. Soc. Inf. Sci..

[7]  Yaşar Tonta.  A study of indexing consistency between library of congress and british library catalogers , 1991 .

[8]  P. Zunde,et al.  Indexing Consistency and Quality. , 1969 .

[9]  Jin Zhang,et al.  An investigation of the influence of indexing exhaustivity and term distributions on a document space , 2002, J. Assoc. Inf. Sci. Technol..

[10]  Lois Mai Chan,et al.  Inter-Indexer Consistency in Subject Cataloging. , 1989 .

[11]  Dietmar Wolfram,et al.  The impact of term-indexing characteristics on a document space , 2001 .

[12]  Hope A. Olson,et al.  Syntagmatic relationships and indexing consistency on a larger scale , 2008, J. Documentation.

[13]  Margaret E. I. Kipp,et al.  Patterns and Inconsistencies in Collaborative Tagging Systems: An Examination of Tagging Practices , 2007, ASIST.

[14]  Erik J. Biever,et al.  Indexing Consistency: The Input/Output Function of Thesauri , 1991 .

[15]  Kurt Leininger,et al.  Interindexer consistency in PsycINFO , 2000, J. Libr. Inf. Sci..

[16]  Bernardo A. Huberman,et al.  Usage patterns of collaborative tagging systems , 2006, J. Inf. Sci..

[17]  Ian H. Witten,et al.  Measuring inter-indexer consistency using a thesaurus , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[18]  K. Markey.  Interindexer consistency tests: a literature review and report of a test of consistency in indexing visual materials , 1984 .

[19]  MaryEllen C. Sievert,et al.  Indexing consistency in Information Science Abstracts , 1991, J. Am. Soc. Inf. Sci..

[20]  Claire David,et al.  Inedxing as Problem Solving: A Cognitive Approach to Consistency , 2013 .