Supporting interactive system testing with interaction sequences

In software engineering testing is an important part of the development process. In interactive systems human input introduces the possibility of human error, which increases the testing requirements. In safety-critical systems user or system error can result in injury or death to a user. We propose using interaction sequences as a way of supporting interactive system testing to help address these issues.

[1]  Paolo Masci.  A preliminary hazard analysis for the GIP number entry software , 2014 .

[2]  Pejman Salehi,et al.  A Model Based Approach to Web Application Design for Older Adults Using MVC Design Pattern , 2016, HCI.

[3]  Jonathan Jacky,et al.  The Way of Z: Practical Programming with Formal Methods , 1996 .

[4]  Fevzi Belli,et al.  Minimal Spanning Set for Coverage Testing of Interactive Systems , 2004, ICTAC.

[5]  Daniel Vanderpooten,et al.  A multi-objective interactive system for adaptive traffic control , 2015, Eur. J. Oper. Res..

[6]  Insup Lee,et al.  Verification of interactive software for medical devices: PCA infusion pumps and FDA regulation as an example , 2013, EICS '13.

[7]  Yi Zhang,et al.  A Generic User Interface Architecture for Analyzing Use Hazards in Infusion Pump Software , 2014, MCPS.

[8]  Harold W. Thimbleby,et al.  Using PVSio-web to Demonstrate Software Issues in Medical User Interfaces , 2014, FHIES/SEHC.

[9]  Brian P. Bailey,et al.  Adapting paper prototyping for designing user interfaces for multiple display environments , 2008, Personal and Ubiquitous Computing.

[10]  Harold W. Thimbleby,et al.  A Performance Review of Number Entry Interfaces , 2013, INTERACT.

[11]  Michael D. Harrison,et al.  Model Checking Interactor Specifications , 2001, Automated Software Engineering.

[12]  Harold W. Thimbleby,et al.  User interface design with matrix algebra , 2004, TCHI.

[13]  Gianni Fenu,et al.  IceTT: a responsive visualization for task models , 2014, EICS.

[14]  Lee Copeland,et al.  A Practitioner's Guide to Software Test Design , 2003 .

[15]  David L. Dill,et al.  Better verification through symmetry , 1996, Formal Methods Syst. Des..

[16]  Harold W. Thimbleby,et al.  Heedless programming: ignoring detectable error is a widespread hazard , 2012, Softw. Pract. Exp..

[17]  Harold W. Thimbleby,et al.  Buffer automata: a UI architecture prioritising HCI concerns for interactive devices , 2011, EICS '11.

[18]  Ann Blandford,et al.  You Can't Touch This: Potential Perils of Patient Interaction with Clinical Medical Devices , 2013, INTERACT.

[19]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[20]  Chin-Yu Huang,et al.  Design and analysis of GUI test-case prioritization using weight-based methods , 2010, J. Syst. Softw..

[21]  Harold W. Thimbleby.  Safer User Interfaces: A Case Study in Improving Number Entry , 2015, IEEE Transactions on Software Engineering.

[22]  Harold Thimbleby,et al.  Analysis of infusion pump error logs and their significance for health care. , 2012, British journal of nursing.

[23]  Christophe Kolski,et al.  Towards an Automatic Analysis of Interaction Data for HCI Evaluation Application to a Transport Network Supervision System , 2011, HCI.

[24]  Margaret M. Burnett,et al.  Finding Gender-Inclusiveness Software Issues with GenderMag: A Field Investigation , 2016, CHI.

[25]  Harold W. Thimbleby,et al.  Action graphs and user performance analysis , 2013, Int. J. Hum. Comput. Stud..

[26]  Lee J. White,et al.  User-based testing of GUI sequences and their interactions , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.

[27]  Matthew B. Dwyer,et al.  Analyzing interaction orderings with model checking , 2004, Proceedings. 19th International Conference on Automated Software Engineering, 2004..

[28]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[29]  Zahir Tari,et al.  Verification of Communication Protocols in Web Services: Model-Checking Service Compositions , 2013 .

[30]  Cui Tao,et al.  Model Checking for Verification of Interactive Health IT Systems , 2015, AMIA.

[31]  João Saraiva,et al.  GUIsurfer: A Reverse Engineering Framework for User Interface Software , 2012 .

[32]  Mark Harman,et al.  The Oracle Problem in Software Testing: A Survey , 2015, IEEE Transactions on Software Engineering.

[33]  Michael E. Lesk,et al.  Safety Risks--Human Error or Mechanical Failure?: Lessons from Railways , 2015, IEEE Security & Privacy.

[34]  Helmut Veith,et al.  25 Years of Model Checking - History, Achievements, Perspectives , 2008, 25 Years of Model Checking.

[35]  Wolfgang Reisig,et al.  The concepts of Petri nets , 2015, Software & Systems Modeling.

[36]  Camille Fayollas.  Addressing dependability for interactive systems: application to interactive cockpits , 2013, EICS '13.

[37]  Fevzi Belli,et al.  A Holistic View for Finite-State Modeling and Testing of User Interactions , 2003 .

[38]  Harold W. Thimbleby,et al.  Contributing to safety and due diligence in safety-critical interactive systems development by generating and analyzing finite state models , 2009, EICS '09.

[39]  Judy Bowen,et al.  Simulating Interaction Sequences , 2018, EICS.

[40]  Ana C. R. Paiva,et al.  Reverse Engineered Formal Models for GUI Testing , 2007, FMICS.

[41]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[42]  J. Samet,et al.  From the Food and Drug Administration. , 2002, JAMA.

[43]  Judy Bowen,et al.  UI-design driven model-based testing , 2013, Innovations in Systems and Software Engineering.

[44]  Michael D. Harrison,et al.  Reusing models and properties in the analysis of similar interactive devices , 2013, Innovations in Systems and Software Engineering.

[45]  Tanja E. J. Vos,et al.  GUITest: a Java library for fully automated GUI robustness testing , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[46]  Neil Walkinshaw,et al.  The Java system dependence graph , 2003, Proceedings Third IEEE International Workshop on Source Code Analysis and Manipulation.

[47]  Andreas Hoffmann,et al.  Model-Based Testing , 2012, IEEE Software.

[48]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[49]  Fabio Paternò,et al.  Applying information visualization techniques to visual representations of task models , 2004, TAMODIA '04.

[50]  Philippe A. Palanque,et al.  A More Intelligent Test Case Generation Approach through Task Models Manipulation , 2017, PACMHCI.

[51]  Marco Winckler,et al.  Beyond modelling: an integrated environment supporting co-execution of tasks and systems models , 2010, EICS '10.

[52]  DillDepartment,et al.  Veri cation of Symmetric Concurrent Systems , 1993 .

[53]  Marco Winckler,et al.  Structuring and Composition Mechanisms to Address Scalability Issues in Task Models , 2011, INTERACT.

[54]  Clemens Holzmann,et al.  Mobile interaction analysis: towards a novel concept for interaction sequence mining , 2014, MobileHCI '14.

[55]  Atif M. Memon,et al.  GUITAR: an innovative tool for automated testing of GUI-driven software , 2014, Automated Software Engineering.

[56]  Feifei Lin.  Analysing Reverse Engineering Techniques for Interactive Systems , 2012 .

[57]  Judy Bowen,et al.  Modelling safety properties of interactive medical systems , 2013, EICS '13.

[58]  Michael Shafto,et al.  Information Organization in the Airline Cockpit , 2013 .

[59]  E KrasnerGlenn,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[60]  Jean-Marie Burkhardt,et al.  Task Descriptions Using Academic Oriented Modelling Languages: A Survey of Actual Practices across the SIGCHI Community , 2011, INTERACT.

[61]  Harold W. Thimbleby,et al.  Reasons to question seven segment displays , 2013, CHI.

[62]  Lee J. White,et al.  Generating test cases for GUI responsibilities using complete interaction sequences , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[63]  Fabio Paternò,et al.  Improving Support for Visual Task Modelling , 2012, HCSE.