Assessment of the effects of user characteristics on mental models of information retrieval systems

This article reports the results of a study that investigated effects of four user characteristics on users' mental models of information retrieval systems: educational and professional status, first language, academic background, and computer experience. The repertory grid technique was used in the study. Using this method, important components of information retrieval systems were represented by nine concepts, based on four IR experts' judgments. Users' mental models were represented by factor scores that were derived from users' matrices of concept ratings on different attributes of the concepts. The study found that educational and professional status, academic background, and computer experience had significant effects in differentiating users on their factor scores. First language had a borderline effect, but the effect was not significant enough at α = 0.05 level. Specific different views regarding IR systems among different groups of users are described and discussed. Implications of the study for information science and IR system designs are suggested.

[1]  Amanda Spink,et al.  Interaction in information retrieval: selection and effectiveness of search terms , 1997 .

[2]  Brian R. Gaines,et al.  BASING KNOWLEDGE ACQUISITION TOOLS IN PERSONAL CONSTRUCT PSYCHOLOGY , 1991 .

[3]  Keith Swigger,et al.  Validation of the repertory grid for use in modeling knowledge , 1992 .

[4]  Nipon Charoenkitkarn.  The effect of markup-querying on search pattern and performance in large-scale text retrieval , 1996 .

[5]  Alexandra Dimitroff,et al.  Mental Models Theory and Search Outcome in a Bibliographic Retrieval System. , 1992 .

[6]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[7]  David Robins,et al.  Interactive Information Retrieval: Context and Basic Notions , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[8]  Trudi Bellardo.  An investigation of online searcher traits and their relationship to search outcome , 1985, J. Am. Soc. Inf. Sci..

[9]  Donald H. Kraft,et al.  Measurement in Information Science , 1994 .

[10]  Christine L. Borgman,et al.  The user's mental model of an information retrieval system , 1999, SIGIR '85.

[11]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[12]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[13]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[14]  D. Bannister,et al.  The evaluation of personal constructs , 1968 .

[15]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[16]  T. N. Kamala.  Individual differences in the use of CD ROM databases , 1992 .

[17]  Christine Faulkner,et al.  The Essence of Human-Computer Interaction , 1997 .

[18]  Bryce Allen.  Individual differences and the conundrums of user-centered design: two experiments , 2000 .

[19]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[20]  Ingrid Hsieh-Yee,et al.  Effects of Search Experience and Subject Knowledge on the Search Tactics of Novice and Experienced Searchers. , 1993 .

[21]  R. N. Woolley.  On Becoming a Personal Scientis , 1982 .

[22]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[23]  Christine L. Borgman,et al.  All users of information retrieval systems are not created equal: An exploration into individual differences , 1989, Inf. Process. Manag..

[24]  Thomas P. Moran,et al.  Mental models and problem solving in using a calculator , 1983, CHI '83.

[25]  Carol H. Fenichel,et al.  Online searching: Measures that discriminate among users with different types of experiences , 1981, J. Am. Soc. Inf. Sci..

[26]  Tefko Saracevic,et al.  The Stratified Model of Information Retrieval Interaction: Extension and Applications , 1997 .

[27]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[28]  Gary Marchionini.  Information Seeking in Full-Text End-User-Oriented Search Systems: The Roles of Domain and Search Expertise , 1993 .

[29]  Peter Ingwersen,et al.  Information Retrieval Interaction , 1992 .

[30]  Liwen Qiu,et al.  Markov Models of Search State Patterns in a Hypertext Information Retrieval System , 1993, J. Am. Soc. Inf. Sci..

[31]  Bryce Allen,et al.  Information Tasks: Toward a User-Centered Approach to Information Systems , 1996 .

[32]  David E. Kieras,et al.  An Approach to the Formal Analysis of User Complexity , 1999, Int. J. Man Mach. Stud..

[33]  Nicholas J. Belkin,et al.  Interaction in Information Retrieval: Trends Over Time , 1999, J. Am. Soc. Inf. Sci..

[34]  John M. Carroll,et al.  Mental Models in Human-Computer Interaction , 1988 .

[35]  Dennis E. Egan,et al.  Individual Differences In Human-Computer Interaction , 1988 .

[36]  Stephen T. Kerr.  Wayfinding in an electronic database: The relative importance of navigational cues vs. mental models , 1990, Inf. Process. Manag..