Automatically Testing of Multimodal Interactive Applications

Testing interactive multimodal applications is particularly important and requires a lot of effort. Automating this activity can result to significant development cost reduction and quality improvement. In this paper, we propose an approach for automating the test generation of such multimodal applications. This approach is based on the definition of a test modeling language, TTT. The objective of the TTT language is to provide a means for expressing abstract test scenarios for interactive multimodal applications, including non-deterministic choices and action occurrence probabilities that can be used to automate the test generation. Then, we built the TTTEST tool that supports to generate tests for multimodal events and to check the validity of CARE properties of this kind of applications. The approach is illustrated on a case study.

[1]  Sid-Ahmed Selouani,et al.  A formal model to handle the adaptability of multimodal user interfaces , 2008, Ambi-Sys '08.

[2]  Marco Winckler,et al.  Resilience of Interaction Techniques to Interrupts: A Formal Model-Based Approach , 2009, INTERACT.

[3]  Daniel P. Siewiorek,et al.  A method to automate user interface testing using variable finite state machines , 1997, Proceedings of IEEE 27th International Symposium on Fault Tolerant Computing.

[4]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[5]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[6]  Ioannis Parissis,et al.  Automatically testing interactive applications using extended task trees , 2009, J. Log. Algebraic Methods Program..

[7]  Yamine Aït Ameur,et al.  A formal model for output multimodal HCI , 2015, Computing.

[8]  Nguyen Thanh Binh,et al.  A new test modeling language for interactive applications based on task trees , 2013, SoICT '13.

[9]  Philippe A. Palanque,et al.  Verification of an interactive software by analysis of its formal specification , 1995, INTERACT.

[10]  Michael D. Harrison,et al.  Abstract Interaction Objects , 1993, Comput. Graph. Forum.

[11]  Ioannis Parissis,et al.  Automatically testing interactive multimodal systems using task trees and fusion models , 2011, AST '11.

[12]  Laurence Nigay,et al.  Synchronous testing of multimodal systems: an operational profile-based approach , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[13]  Marco Winckler,et al.  A formal approach supporting the comparative predictive assessment of the interruption-tolerance of interactive systems , 2009, EICS '09.

[14]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[15]  Fabio Paternò,et al.  On the use of LOTOS to describe graphical interaction , 1993 .

[16]  Yamine Aït Ameur,et al.  A generic formal specification of fusion of modalities in a multimodal HCI , 2004, IFIP Congress Topical Sessions.