Systematic evaluation of design choices for software development tools

Most design and evaluation of software tools is based on the intuition and experience of the designers. Software tool designers consider themselves typical users of the tools that they build and tend to subjectively evaluate their products rather than objectively evaluate them using established usability methods. This subjective approach is inadequate if the quality of software tools is to improve and the use of more systematic methods is advocated. This paper summarises a sequence of studies that show how user interface design choices for software development tools can be evaluated using established usability engineering techniques. The techniques used included guideline review, predictive modelling and experimental studies with users.

[1]  Jim Welsh,et al.  Retrospective application of user interface guidelines: a case study of a language-based editor , 1991 .

[2]  Ian Sommerville,et al.  Software engineering (5th ed.) , 1995 .

[3]  Mark B. Ratcliffe,et al.  Trends in Structure-Oriented Environments , 1994, Int. J. Softw. Eng. Knowl. Eng..

[4]  Jim Welsh,et al.  A design rationale for a language‐based editor , 1991, Softw. Pract. Exp..

[5]  Brad A. Myers,et al.  Challenges of HCI design and implementation , 1994, INTR.

[6]  Ray E. Eberts.  User interface design , 1994, Prentice Hall international series in industrial and systems engineering.

[7]  Jim Welsh,et al.  An empirical investigation of menu design in language-based editors , 1992, SDE 5.

[8]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[9]  Richard N. Taylor,et al.  Workshop on software engineering and computer-human interaction: joint research issues , 1994, Proceedings of 16th International Conference on Software Engineering.

[10]  David J. Gilmore,et al.  User-Centred Requirements for Software Engineering Environments , 1994, NATO ASI Series.

[11]  Jim Welsh,et al.  An evaluation of editing paradigms , 1994 .

[12]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[13]  Gary M. Olson,et al.  The growth of cognitive modeling in human-computer interaction since GOMS , 1990 .

[14]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[15]  T. R. G. Green.  Why Software Engineers Don’t Listen to What Psychologists Don’t Tell Them Anyway , 1994 .

[16]  Jim Welsh,et al.  An empirical investigation of language-based editing paradigms , 1995 .

[17]  Jim Welsh,et al.  Can Design Choices for Language-Based Editors be Analysed with Keystroke-Level Models? , 1996, BCS HCI.

[18]  Jim Welsh,et al.  An Adaptive Program Editor , 1986, Aust. Comput. J..

[19]  Klaus Gröning.  "Combined actions to reduce LR-parsertables": (experimental results) , 1984, SIGP.

[20]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[21]  Jim Welsh,et al.  Software Documents: Concepts and Tools , 1994, Softw. Concepts Tools.

[22]  Elliot Soloway.  A cognitively-based methodology for designing languages/environments/methodologies , 1984 .

[23]  Sidney L. Smith,et al.  Guidelines for Designing User Interface Software , 1986 .

[24]  David W. Embley,et al.  Behavioral Aspects of Text Editors , 1981, CSUR.

[25]  Gerd Szwillus,et al.  Report on the CHI'90 workshop on structure editors , 1990, SGCH.

[26]  Marvin V. Zelkowitz,et al.  Experiences building a syntax-directed editor , 1989, Softw. Eng. J..

[27]  Bonnie E. John,et al.  Browser-Soar: a computational model of a highly interactive task , 1992, CHI.

[28]  Jonas Löwgren,et al.  Supporting the Use of Guidelines and Style Guides in Professional User Interface Design , 1993, Interact. Comput..

[29]  Harold W. Thimbleby,et al.  Failure in the technical user-interface design process , 1985, Comput. Graph..

[30]  Jakob Nielsen,et al.  The usability engineering life cycle , 1992, Computer.

[31]  Jim Welsh,et al.  An empirical investigation of menu design in language-based editors , 1992 .

[32]  Chris R. Jesshope,et al.  An intelligent pascal editor for a graphical oriented workstation , 1985, Softw. Pract. Exp..

[33]  Thomas W. Reps,et al.  The synthesizer generator , 1984, SDE 1.

[34]  Sidney L. Smith,et al.  DESIGN GUIDELINES FOR USER-SYSTEM INTERFACE SOFTWARE , 1984 .

[35]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[36]  Sidney L. Smith,et al.  The user interface to computer-based information systems: a survey of current software design practice , 1984 .

[37]  Joseph E. Urban,et al.  Syntax-directed editing environments: issues and features , 1993, SAC '93.