Questioning the Effectiveness of Contextual Online Help: Some Alternative Propositions

Most online help systems on the market prove unsuited to the actual needs of novice users. Although recent research has focused on the design and implementation of contextual, adaptable or adaptive help systems, the actual effectiveness and usability of such systems has not yet been assessed extensively. We present an experimental ergonomic evaluation of a contextual help system implementing human expert strategies. 18 potential users interacted with a standard text processor, using two help systems, a contextual one versus a non contextual one. Each system was simulated using the Wizard of Oz paradigm. The contextual help strategies were defined from the analysis of novice-expert dialogues. Contextual help proved more effective than non contextual help as regards successful task execution, this result being statistically significant. Concerning the influence of individual cognitive characteristics on the subjects' performances, analyses based on psychological tests suggest that contextual help facilitates message understanding, whereas it is less effective than non contextual help for subjects with low exploratory capabilities. || La plupart de systemes d'aide en ligne s'averent inadaptes aux besoins effectifs des novices. Bien que l'aide en ligne contextuelle et les systemes d'aide adaptables ou adaptatifs aient fait l'objet de nombreuses recherches recemment, l'efficacite effecti

[1]  Susan Palmiter,et al.  An evaluation of animated demonstrations of learning computer-based tasks , 1991, CHI.

[2]  Nathaniel Solomon Borenstein.  The design and evaluation of online help systems , 1985 .

[3]  A. W. Roesler,et al.  What help do users need?: taxonomies for on-line information needs & access methods , 1995, CHI '95.

[4]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[5]  J. Alty,et al.  Face-to-face guidance of university computer users—I. A study of advisory services , 1980 .

[6]  Robert C. Williges,et al.  Retrieval of HELP Information for Novice Users of Interactive Computer Systems , 1985 .

[7]  C. Spearman.  The Abilities of Man their Nature and Measurement , 2020, Nature.

[8]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[9]  RACHEL M. PILKINGTON,et al.  Question-Answering for Intelligent On-Line Help: The Process of Intelligent Responding , 1992, Cogn. Sci..

[10]  Brad Mehlenbacher,et al.  The evaluation of online help systems: a conceptual model , 1989 .

[11]  D. Goodenough,et al.  The role of individual differences in field dependence as a factor in learning and memory. , 1975, Psychological bulletin.

[12]  Claus Hoffmann,et al.  MASTERING THE COMPLEXITY OF DIALOGUE SYSTEMS BY THE AID OF WORK CONTEXTS , 1987 .

[13]  Noëlle Carbonell,et al.  Contextual On-line Help: A Contribution to the Implementation of Universal Access , 2002 .

[14]  James L. Alty,et al.  Face-to-face guidance of university computer users—II. Characterizing advisory interactions , 1980 .

[15]  A. Macrae.  Book Review: International Journal of Man-Machine Studies , 1970 .

[16]  Klaus-Jürgen Quast.  Plan recognition for context sensitive help , 1993, IUI '93.

[17]  Lynda Hardman,et al.  'Lost in Hyperspace': Cognitive Mapping and Navigation in a Hypertext Environment , 1999, UK Hypertext.

[18]  Graham I. Johnson,et al.  Spoken help for a car stereo: An exploratory study , 1997, Behav. Inf. Technol..

[19]  Bonnie E. John.  Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information , 1990, CHI '90.

[20]  Robert Wilensky.  Talking to UNIX in English: An Overview of an On-Line UNIX Consultant , 1984, AI Mag..

[21]  Johanna D. Moore,et al.  Generating explanations in context , 1993, IUI '93.

[22]  Noëlle Carbonell,et al.  Contextual online help: elicitation of human experts' strategies , 2001, HCI International 2001.

[23]  Jens Rasmussen,et al.  Ecological Information Systems and Support of Learning: Coupling Work Domain Information to User Characteristics , 1997 .