Developing a Measure of Search Expertise

While search expertise has long been considered an important variable in the study of online information search, the creation of a robust measure to characterize it has eluded researchers. Instead, those wishing to measure search expertise often include a single item that asks people to indicate how often they search or for how long they have been searching. In this paper, we report initial results of a four-phase study aimed at developing a measure of search expertise. Interviews and focus groups were conducted with nine professional searchers and an inventory of items related to online search expertise was created. While participants identified a number of usual items for determining search expertise, such as prior search experience, domain knowledge and resource knowledge, they also identified a large number of items related to personality characteristics such as persistence, flexibility, curiosity, adaptability and humility. These results suggest that measuring personality characteristics in addition to experience and knowledge might help determine who will be a more successful searcher. In today's search environments, where many people describe themselves as experts, representing these types of characteristics in a measure of search expertise might allow researchers and practitioners to observe more variation in populations of interest, design more effective instruction and make better predictions about search outcomes.

[1]  Philipp Koehn,et al.  Cognitive Psychology , 1992, Ageing and Society.

[2]  Ingrid Hsieh-Yee.  Research on Web Search Behavior. , 2001 .

[3]  Catherine L. Smith,et al.  Domain‐independent search expertise: A description of procedural knowledge gained during guided instruction , 2015, J. Assoc. Inf. Sci. Technol..

[4]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[5]  Christine L. Borgman,et al.  All users of information retrieval systems are not created equal: An exploration into individual differences , 1989, Inf. Process. Manag..

[6]  Karen Markey,et al.  Twenty-five years of end-user searching, Part 1: Research findings , 2007, J. Assoc. Inf. Sci. Technol..

[7]  K. Warner Schaie,et al.  Cognitive Functioning and Social Structure over the Life Course , 1987 .

[8]  Robert Glaser,et al.  Thoughts on Expertise , 1985 .

[9]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[10]  Klaus Nordhausen,et al.  Modeling successful performance in Web searching , 2006, J. Assoc. Inf. Sci. Technol..

[11]  Christoph Hölscher,et al.  Web search behavior of Internet experts and newbies , 2000, Comput. Networks.

[12]  Chaomei Chen.  Individual differences in a spatial-semantic virtual environment , 2000, J. Am. Soc. Inf. Sci..

[13]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .

[14]  Trudi Bellardo.  An investigation of online searcher traits and their relationship to search outcome , 1985, J. Am. Soc. Inf. Sci..

[15]  M. Chi.  Two Approaches to the Study of Experts' Characteristics , 2006 .