The validity of rational criteria for the interpretation of user-hypertext interaction

Abstract This study is about how to interpret users interactions with multimedia systems, in particular their interaction with hypertext. It is generally admitted that our knowledge of how to interpret users search paths in information systems is very limited. Further, there are also controversies about the validity of the import of rational criteria, such as recall, precision and economy, from the domain of information retrieval to the interpretation of users behaviour. The purpose of the present study was to examine the relevance of these criteria to human behaviour. The results of two experiments show the rational criteria such as precision and economy seem to be irrelevant criteria for the interpretation of users search paths in terms of recall, except when the user’s task is simple to achieve and constrained (i.e. a task where subjects have to find precisely a small number of relevant information units in a simple system). In the latter case precision and economy are positiviely correlated with recall. For less simple and unconstrained tasks, the performance of subjects seems to be much more influenced by strategic considerations. Further, it was shown that task constraints lead to more precise performance. Apparently subjects spend more effort under these circumstances to search precisely than in conditions without pressure.

[1]  John A. Swets,et al.  Effectiveness of information retrieval methods , 1969 .

[2]  Louise T. Su The Relevance of Recall and Precision in User Evaluation , 1994, J. Am. Soc. Inf. Sci..

[3]  Carolyn L. Foss Effective Browsing in Hypertext Systems , 1988, RIAO.

[4]  Jocelyne Nanard,et al.  Hypertext design environments and the hypertext design process , 1995, CACM.

[5]  Raya Fidel,et al.  Online searching styles: A case-study-based model of searching behavior , 1984, J. Am. Soc. Inf. Sci..

[6]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[7]  Lynda Hardman,et al.  'Lost in Hyperspace': Cognitive Mapping and Navigation in a Hypertext Environment , 1999, UK Hypertext.

[8]  Norbert A. Streitz,et al.  Hypertext: concepts, systems and applications , 1992 .

[9]  Gary Marchionini,et al.  Evaluating hypermedia and learning: methods and results from the Perseus Project , 1994, TOIS.

[10]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[11]  Mark H. Chignell,et al.  A Model for Information Exploration , 1991, Hypermedia.

[12]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[13]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[14]  Paul B. Kantor,et al.  A study of information seeking and retrieving. II. Users, questions, and effectiveness , 1988, J. Am. Soc. Inf. Sci..

[15]  Jean-François Rouet Interactive Text Processing by Inexperienced (Hyper-) Readers , 1990, ECHT.

[16]  David Levine,et al.  Contours of constructive hypertexts , 1992, ECHT '92.

[17]  Paul B. Kantor,et al.  A study of information seeking and retrieving. III. Searchers, searches, and overlap , 1988, J. Am. Soc. Inf. Sci..

[18]  Michael E. Lesk,et al.  Enhancing the usability of text through computer delivery and formative evaluation: the superbook pr , 1993 .

[19]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[20]  Mark Bernstein,et al.  Enactment in information farming , 1993, Hypertext.

[21]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[22]  Patricia Wright,et al.  Menus and memory load: navigation strategies in interactive search tasks , 1994, Int. J. Hum. Comput. Stud..