Assessment of the effects of user characteristics on mental models of information retrieval systems

This article reports the results of a study that investigated effects of four user characteristics on users’ mental models of information retrieval systems: educational and professional status, first language, academic background, and computer experience. The repertory grid technique was used in the study. Using this method, important components of information retrieval systems were represented by nine concepts, based on four IR experts’ judgments. Users’ mental models were represented by factor scores that were derived from users’ matrices of concept ratings on different attributes of the concepts. The study found that educational and professional status, academic background, and computer experience had significant effects in differentiating users on their factor scores. First language had a borderline effect, but the effect was not significant enough at a 5 0.05 level. Specific different views regarding IR systems among different groups of users are described and discussed. Implications of the study for information science and IR system designs are suggested.

[1]  Tefko Saracevic,et al.  The Stratified Model of Information Retrieval Interaction: Extension and Applications , 1997 .

[2]  Marc M. Sebrechts,et al.  Integrative modeling: changes in mental models during learning , 1990 .

[3]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[4]  Stephen T. Kerr.  Wayfinding in an electronic database: The relative importance of navigational cues vs. mental models , 1990, Inf. Process. Manag..

[5]  Carol H. Fenichel,et al.  Online searching: Measures that discriminate among users with different types of experiences , 1981, J. Am. Soc. Inf. Sci..

[6]  David E. Kieras,et al.  An Approach to the Formal Analysis of User Complexity , 1999, Int. J. Man Mach. Stud..

[7]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[8]  Nipon Charoenkitkarn.  The effect of markup-querying on search pattern and performance in large-scale text retrieval , 1996 .

[9]  Ronald M. Baecker,et al.  Readings in human-computer interaction : a multidisciplinary approach , 1988 .

[10]  D. Bannister,et al.  The evaluation of personal constructs , 1968 .

[11]  Ingrid Hsieh-Yee,et al.  Effects of Search Experience and Subject Knowledge on the Search Tactics of Novice and Experienced Searchers , 1993, J. Am. Soc. Inf. Sci..

[12]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[13]  Peter Ingwersen,et al.  Information Retrieval Interaction , 1992 .

[14]  David Robins,et al.  Interactive Information Retrieval: Context and Basic Notions , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[15]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[16]  Bryce Allen,et al.  Information Tasks: Toward a User-Centered Approach to Information Systems , 1996 .

[17]  T. N. Kamala.  Individual differences in the use of CD ROM databases , 1992 .

[18]  William Sugar.  User-Centered Perspective of Information Retrieval Research and Analysis Methods. , 1995 .

[19]  Keith Swigger,et al.  Validation of the Repertory Grid for Use in Modeling Knowledge , 1992, J. Am. Soc. Inf. Sci..

[20]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[21]  David Dubin.  Measurement in information science , 1997 .

[22]  Brian R. Gaines,et al.  BASING KNOWLEDGE ACQUISITION TOOLS IN PERSONAL CONSTRUCT PSYCHOLOGY , 1991 .

[23]  Amanda Spink,et al.  Interaction in Information Retrieval: Selection and Effectiveness of Search Terms , 1997, J. Am. Soc. Inf. Sci..

[24]  Alexandra Dimitroff,et al.  Mental Models Theory and Search Outcome in a Bibliographic Retrieval System. , 1992 .

[25]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[26]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[27]  C. Borgman.  Psychological research in human-computer interaction. , 1984 .

[28]  E Collyer,et al.  On becoming a personal scientist , 1982 .

[29]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[30]  Pamela Briggs,et al.  Usability assessment for the office: methodological choices and their implications , 1988 .

[31]  Liwen Qiu.  Markov Models of Search State Patterns in a Hypertext Information Retrieval System , 1993, J. Am. Soc. Inf. Sci..

[32]  Gary Marchionini.  Information Seeking in Full-Text End-User-Oriented Search Systems: The Roles of Domain and Search Expertise , 1993 .

[33]  Stephen J. Westerman,et al.  Individual differences in human-computer interaction , 1993 .

[34]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[35]  Bryce Allen.  Individual differences and the conundrums of user-centered design: Two experiments , 2000, J. Am. Soc. Inf. Sci..

[36]  D. M. Hutton,et al.  The Essence of Human Computer Interaction , 2000 .

[37]  Nancy Newman Woelfl.  Individual differences in online search behavior : the effect of learning styles and cognitive abilities on process and outcome , 1984 .

[38]  Trudi Bellardo.  An investigation of online searcher traits and their relationship to search outcome , 1985, J. Am. Soc. Inf. Sci..

[39]  Christine L. Borgman,et al.  The user's mental model of an information retrieval system , 1999, SIGIR '85.

[40]  Nicholas J. Belkin,et al.  Interaction in Information Retrieval: Trends Over Time , 1999, J. Am. Soc. Inf. Sci..

[41]  Christine L. Borgman,et al.  All users of information retrieval systems are not created equal: An exploration into individual differences , 1989, Inf. Process. Manag..

[42]  Thomas P. Moran,et al.  Mental models and problem solving in using a calculator , 1983, CHI '83.