Formal Interactive Systems Analysis and Usability Inspection Methods: Two Incompatible Worlds?

We present our view on how a formal technique for the analysis of interactive systems can be used to support 'discount' usability inspection methods. As a demonstration, we present a snapshot of our work on supporting heuristic evaluation and on the analysis of selected usability properties. Our method focuses on the exhaustive analysis of functional properties. We claim that the benefits gained by a formal approach like the one presented here justify its extra costs. Moreover, we believe these costs can be kept comparably low by making the analysis technique flexible enough to support a number of other (informal) analysis techniques throughout the different stages of the design process.

[1]  Chuck Hansen,et al.  Eurographics '97 , 1998, COMG.

[2]  Donald A. Norman,et al.  Design principles for human-computer interfaces , 1983, CHI '83.

[3]  Edmund M. Clarke,et al.  Formal Methods: State of the Art and Future Directions Working Group Members , 1996 .

[4]  Bruno d'Ausbourg.  Using Model Checking for the Automatic Validation of User Interface Systems , 1998, DSV-IS.

[5]  Michael D. Harrison,et al.  Abstract Interaction Objects , 1993, Comput. Graph. Forum.

[6]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[7]  Barry Kirwan,et al.  A Guide to Practical Human Reliability Assessment , 1994 .

[8]  R.W. Butler,et al.  A formal methods approach to the analysis of mode confusion , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[9]  Michael von der Beeck,et al.  A Comparison of Statecharts Variants , 1994, FTRTFT.

[10]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[11]  Everett Palmer.  Murphi busts an altitude: a Murphi analysis of an automation surprise , 1999, Gateway to the New Millennium. 18th Digital Avionics Systems Conference. Proceedings (Cat. No.99CH37033).

[12]  John Rushby,et al.  Using model checking to help discover mode confusions and other automation surprises , 2002, Reliab. Eng. Syst. Saf..

[13]  Victor Carreño,et al.  Analyzing Mode Confusion via Model Checking , 1999, SPIN.

[14]  George S. Avrunin,et al.  Property specification patterns for finite-state verification , 1998, FMSP '98.

[15]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[16]  Amnon Naamad,et al.  Statemate: a working environment for the development of complex reactive systems , 1988, ICSE '88.

[17]  Michael D. Harrison,et al.  The Role of Verification in Interactive Systems Design , 1998, DSV-IS.

[18]  Panos Markopoulos,et al.  Design, Specification and Verification of Interactive Systems ’98 , 1998, Eurographics.

[19]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[20]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[21]  Stefano Levialdi,et al.  The cube – extending systems for undo , 2001 .

[22]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[23]  Amnon Naamad,et al.  The STATEMATE semantics of statecharts , 1996, TSEM.

[24]  Fabio Paternò,et al.  An Approach to the Formal Specification of the Components of an Interaction , 1990, Eurographics.

[25]  Gregory D. Abowd,et al.  Human-computer interaction (2nd ed.) , 1998 .

[26]  Ann Blandford,et al.  The Role of Formal Proof in Modelling Interactive Behaviour , 1998, DSV-IS.

[27]  Jim Armstrong,et al.  Industrial integration of graphical and formal specifications , 1998, J. Syst. Softw..

[28]  Kenneth L. McMillan,et al.  Symbolic model checking , 1992 .

[29]  Gregory D. Abowd,et al.  A formal technique for automated dialogue development , 1995, Symposium on Designing Interactive Systems.