Methoden und Modelle im Software-Entwicklungsprozess

Evaluation in software ergonomie: Methods and models in the software development cycle Abstract. Ergonomic evaluation of software has gained growing importance in software design. This paper presents methods of software ergonomic evaluation based on a new classification scheme which distinguishes descriptive, predictive and other methods; role and value of evaluation models are discussed as well. Evaluation models integrate one or more methods into the software design process, and organise their effective application. The paper discusses method based, criteria based, and process based evaluation models, and it is shown that, for most models, explicit advice is still lacking how the models fit into the software development life cycle. The final part of the paper deals with the connection between evaluation models and models of software development. Since such connections are presently - at best - only loose, it is a challenging task to integrate these areas.

[1]  Gwen Bell.  Bridges between worlds , 1993 .

[2]  Günther Gediga,et al.  Heuristische Evaluation und IsoMetrics: Ein Vergleich , 1997, Software-Ergonomie.

[3]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[4]  Robin Jeffries,et al.  Usability testing vs. heuristic evaluation: was there a contest? , 1992, SGCH.

[5]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[6]  Jochen Prümper,et al.  Die Evaluation von Software auf Grundlage des Entwurfs zur internationalen Ergonomie-Norm ISO 9241 Teil 10 als Beitrag zur partizipativen Systemgestaltung - ein Fallbeispiel , 1993, Software-Ergonomie.

[7]  John D. Gould,et al.  The 1984 Olympic Message System: a test of behavioral principles of system design , 1987, CACM.

[8]  Chauncey E. Wilson,et al.  The Usability Engineering Framework for Product Design and Evaluation , 1997 .

[9]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[10]  Günther Gediga,et al.  A critique and empirical investigation of the “One-Best-Way-Models” in human-computer interaction , 1988 .

[11]  Harald Reiterer,et al.  User interface evaluation and design : research results of the projects evaluation of dialogue systems (EVADIS) and user interface design assistance (IDA) , 1994 .

[12]  Kim J. Vicente,et al.  Book Review of Handbook of Human-Computer Interaction, Second Edition, Edited by Martin G. Helander, T. K. Landauer, and P. V. Prabhu , 2000 .

[13]  Tom Carey,et al.  Human-computer interaction , 1994 .

[14]  Thomas K. Landauer,et al.  Trouble with Computers: Usefulness, Usability, and Productivity , 1996 .

[15]  Peter Johnson,et al.  Human computer interaction: Psychology, task analysis, and software engineering , 1992 .

[16]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[17]  Kenneth D. Eason,et al.  Ergonomic perspectives on advances in human-computer interaction , 1991 .

[18]  Victoria A. Bowers.  Concurrent versus Retrospective Verbal Protocol for Comparing Window Usability , 1990 .

[19]  Marilyn Tremaine,et al.  Cost/benefit analysis for incorporating human factors in the software lifecycle , 1988, CACM.

[20]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[21]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[22]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[23]  Andreas Beu,et al.  Engineering Joy , 2001, IEEE Softw..

[24]  John Dowell,et al.  A framework for human factors evaluation , 1991 .

[25]  Jakob Nielsen,et al.  Usability engineering at a discount , 1989 .

[26]  Marc Hassenzahl,et al.  Capturing Design Space From a User Perspective: The Repertory Grid Technique Revisited , 2000, Int. J. Hum. Comput. Interact..

[27]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1999, CHI Extended Abstracts.

[28]  Clayton Lewis,et al.  Making usable, useful, productivity-enhancing computer applications , 1991, CACM.

[29]  Brian Shackel,et al.  Human Factors and Usability - Whence and Whither , 1985, Software-Ergonomie.

[30]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[31]  John L. Bennett,et al.  Usability Engineering: Our Experience and Evolution , 1988 .

[32]  M. Scriven.  The methodology of evaluation , 1966 .

[33]  Nancy J. Cooke,et al.  Varieties of knowledge elicitation techniques , 1994, Int. J. Hum. Comput. Stud..

[34]  Ann Lantz,et al.  User centered design—problems and possibilities: a summary of the 1998 PDC & CSCW workshop , 1999, SGCH.

[35]  Morten Kyng,et al.  Design at Work , 1992 .

[36]  R. Bias,et al.  Interface-Walkthroughs: efficient collaborative testing , 1991, IEEE Software.

[37]  Alan E. Benson,et al.  Are We Overlooking Some Usability Testing Methods? A Comparison of Lab, Beta, and Forum Tests , 1993, Behav. Inf. Technol..

[38]  Anker Helms Jørgensen,et al.  Using the thinking-aloud method in system development , 1989 .

[39]  Deborah Hix,et al.  Developing user interfaces , 1993 .

[40]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[41]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[42]  Thomas K. Landauer,et al.  The trouble with computers , 1995 .

[43]  Mary Corbett,et al.  Effective Methodology for the Study of HCI , 1990 .

[44]  John Karat,et al.  User-Centered Software Evaluation Methodologies , 1997 .

[45]  Clare-Marie Karat,et al.  Cost-Justifying Usability Engineering in the Software Life Cycle , 1997 .

[46]  Günther Gediga,et al.  Softwareevaluation in Gruppen oder Einzelevaluation: Sehen zwei Augen mehr als vier? , 1999, Software-Ergonomie.

[47]  Leslie Beth Herbert,et al.  A Comparison of Three Usability Evaluation Methods: Heuristic, Think-Aloud, and Performance Testing , 1993 .

[48]  Jurek Kirakowski,et al.  The Software Usability Measurement Inventory: Background and Usage , 1996 .

[49]  Clare-Marie Karat,et al.  A comparison of user interface evaluation methods , 1994 .

[50]  Stephen J. Payne,et al.  COMPLEX PROBLEM SPACES: MODELLING THE KNOWLEDGE NEEDED TO USE INTERACTIVE DEVICES , 1987 .

[51]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[52]  John M. Carroll.  Human-computer interaction: psychology as a science of design. , 1997 .

[53]  Michael E. Atwood,et al.  What is gained and lost when using evaluation methods other than empirical testing , 1993 .

[54]  Tom Dayton,et al.  Participatory Practices in the Software Lifecycle , 1997 .

[55]  John M. Carroll,et al.  Learning to use a word processor: by doing, by thinking, and by knowing , 1984 .

[56]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[57]  J. Nielsen,et al.  Integrated software usage in the professional work environment: evidence from questionnaires and interviews , 1986, CHI '86.

[58]  Howard Hull.  Using Your Head. , 1999 .

[59]  J. Bortz,et al.  Forschungsmethoden und Evaluation , 1995 .

[60]  Deborah Hix,et al.  Human-computer interface development: concepts and systems for its management , 1989, CSUR.

[61]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[62]  Ron Henderson,et al.  A comparison of the four prominent user-based methods for evaluating the usability of computer software , 1995 .

[63]  Robert A. Virzi.  Usability Inspection Methods , 1997 .

[64]  Wayne D. Gray,et al.  Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods , 1998, Hum. Comput. Interact..

[65]  Heather Desurvire,et al.  EMPIRICISM VERSUS JUDGEMENT: COMPARING USER INTERFACE EVALUATION METHODS ON A NEW TELEPHONE-BASED INTERFACE , 1991, SGCH.

[66]  H. Friedrich,et al.  Lottmann, Alfred; Tergan, Sigmar-Olaf; Schenkel, Peter (Hg.): Qualitätsbeurteilung multimedialer Lern- und Informationssysteme. Evaluationsmethoden auf dem Prüfstand. 2000. Rezension , 2000 .

[67]  Beverly L. Harrison,et al.  Video Annotation and Multimedia Interfaces: From Theory to Practice , 1991 .

[68]  Geoff Walsham,et al.  Interpreting Information Systems in Organizations , 1993 .

[69]  Laura Slaughter,et al.  Assessing the Equivalence of the Paper and On-line Formats of the QUIS 5.5 , 1998 .

[70]  Raymond S. Nickerson,et al.  Human-Computer Interaction: Background and Issues , 1997 .

[71]  D. A. Tyldesley,et al.  Employing Usability Engineering in the Development of Office Products , 1988, Comput. J..

[72]  Siegried Greif.  Organisational issues and task analysis , 1991 .

[73]  Anthony J. Hornof,et al.  Cognitive modeling demonstrates how people use anticipated location knowledge of menu items , 1999, CHI '99.

[74]  John D. Gould,et al.  How to design usable systems , 1995 .

[75]  Chris Baber,et al.  Repertory Grid Theory and its Application to Product Evaluation , 1996 .

[76]  Harald Reiterer,et al.  Evaluation of user interfaces: EVADIS II - a comprehensive evaluation approach , 1993, Behav. Inf. Technol..

[77]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[78]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[79]  W. DZIDA,et al.  User-Perceived Quality of Interactive Systems , 1978, IEEE Transactions on Software Engineering.

[80]  P. Jordan.  Human factors for pleasure in product use. , 1998, Applied ergonomics.

[81]  Thomas P. Moran,et al.  The evaluation of text editors: methodology and empirical results. , 1983, CACM.

[82]  John Karat,et al.  Evolving the scope of user-centered design , 1997, CACM.