Formative design evaluation of superbook

SuperBook is a hypertext browsing system designed to improve the usability of conventional documents. Successive versions of SuperBook were evaluated in a series of behavioral studies. Students searched for information in a statistics text. presented either in conventional printed form or in SuperBook form. The best version of SuperBook enabled students to answer search questions more quickly and accurately than they could with the conventional text. Students wrote higher quality “open-book” essays using SuperBook than they did with the conventional text, and their subjective ratings of the documentation strongly favored SuperBook. This work is a case study of formative design-evaluation. Behavioral evaluation of the first version of SuperBook showed how design factors and user strategies affected search and established baseline performance measures with printed text. The second version of SuperBook was implemented with the goal of improving search accuracy and speed. User strategies that had proved effective in the first study were made very easy and attractive to use. System response time for common operations was greatly improved. Behavioral evaluation of the new SuperBook demonstrated its superiority to printed text and suggested additional improvements that were incorporated into “MiteyBook,” a SuperBook implementation for PC-size screens. Search with MiteyBook proved to be approximately 25 percent faster and 25 percent more accurate than that obtained with a conventional printed book.

[1]  Louis M. Gomez,et al.  SuperBook: an automatic tool for information exploration—hypertext? , 1987, Hypertext.

[2]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[3]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[4]  Dennis R. Wixon,et al.  Building a user-derived interface , 1984, CACM.

[5]  Gary Marchionini,et al.  Finding facts vs. browsing knowledge in hypertext systems , 1988, Computer.

[6]  Dennis R. Allison.  Guest Editor's Introduction: Electronic Publishing Technologies , 1988, Computer.

[7]  Andries van Dam,et al.  Hypertext '87: keynote address , 1988, CACM.

[8]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[9]  Robert M. Akscyn,et al.  Experience with the ZOG Human-Computer Interface System , 1984, Int. J. Man Mach. Stud..

[10]  Douglas C. Engelbart,et al.  A research center for augmenting human intellect , 1968, AFIPS Fall Joint Computing Conference.

[11]  Stephen A. Weyer,et al.  The design of a dynamic book for information search , 1982 .

[12]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[13]  John D. Gould,et al.  How to design usable systems , 1995 .

[14]  Wilfred J. Hansen,et al.  Reading and writing with computers: a framework for explaining differences in performance , 1988, CACM.

[15]  Kenneth F. Sierzega,et al.  Documentation Management for large Systems of Equipment , 1988, RIAO.

[16]  Louis M. Gomez,et al.  All the right words: Finding what you want as a function of richness of indexing vocabulary , 1990, J. Am. Soc. Inf. Sci..

[17]  Stephen Alexander Weyer,et al.  Searching for information in a dynamic book , 1982 .

[18]  Susan T. Dumais,et al.  Textual Information Retrieval , 1988 .

[19]  James H. Watt.  Level of abstraction structured text , 1988, IEEE Trans. Syst. Man Cybern..

[20]  Jeff Conklin,et al.  Hypertext: An Introduction and Survey , 1987, Computer.

[21]  Susan T. Dumais,et al.  Statistical semantics: analysis of the potential performance of keyword information systems , 1984 .

[22]  Peter J. Bickel,et al.  S: An Interactive Environment for Data Analysis and Graphics , 1984 .

[23]  R C Williges,et al.  Information Retrieval Strategies File-Search Environment , 1984, Human factors.

[24]  George W. Furnas,et al.  Experience with an adaptive indexing scheme , 1985, CHI '85.

[25]  Sallie E. Gordon,et al.  The Effects of Hypertext on Reader Knowledge Representation , 1988 .

[26]  Louis M. Gomez,et al.  Acquiring information in books and superbooks , 1991 .

[27]  Louis M. Gomez,et al.  All the Right Words: Finding What You Want as a Function of Richness of Indexing Vocabulary. , 1990 .

[28]  S. T. Dumais,et al.  Human factors and behavioral science: Statistical semantics: Analysis of the potential performance of key-word information systems , 1983, The Bell System Technical Journal.

[29]  Janet H. Walker,et al.  Document Examiner: delivery interface for hypertext documents , 1987, Hypertext.

[30]  John D. Gould,et al.  Why reading was slower from CRT displays than from paper , 1986, CHI '87.

[31]  Cyril Cleverdon,et al.  Optimizing convenient online access to bibliographic databases , 1984 .

[32]  S. T. Dumais,et al.  Using latent semantic analysis to improve access to textual information , 1988, CHI '88.