Formal Testing of Multimodal Interactive Systems

This paper presents a method for automatically testing interactive multimodal systems. The method is based on the Lutess testing environment, originally dedicated to synchronous software specified using the Lustre language. The behaviour of synchronous systems, consisting of cycles starting by reading an external input and ending by issuing an output, is to a certain extent similar to the one of interactive systems. Under this hypothesis, the paper presents our method for automatically testing interactive multimodal systems using the Lutess environment. In particular, we show that automatic test data generation based on different strategies can be carried out. Furthermore, we show how multimodality-related properties can be specified in Lustre and integrated in test oracles.

[1]  Laurence Nigay,et al.  A Framework for the Combination and Characterization of Output Modalities , 2000, DSV-IS.

[2]  Fabio Paternò,et al.  On the use of LOTOS to describe graphical interaction , 1993 .

[3]  Benoît Caillaud,et al.  From Synchrony to Asynchrony , 1999, CONCUR.

[4]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[5]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[6]  C. A. Petri,et al.  Concurrency Theory , 1986, Advances in Petri Nets.

[7]  Philippe A. Palanque,et al.  Verification of an interactive software by analysis of its formal specification , 1995, INTERACT.

[8]  Thierry Ganille,et al.  ICARE software components for rapidly developing multimodal interfaces , 2004, ICMI '04.

[9]  Bruno d'Ausbourg.  Using Model Checking for the Automatic Validation of User Interface Systems , 1998, DSV-IS.

[10]  Ioannis Parissis,et al.  Constructing operational profiles for synchronous critical software , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[11]  Philip J. Barnard,et al.  Computers, Communication, and Usability: Design Issues, Research and Methods for Integrated Services , 1993 .

[12]  Edwin D. Reilly,et al.  Interactive system , 2003 .

[13]  Michael D. Harrison,et al.  Abstract Interaction Objects , 1993, Comput. Graph. Forum.

[14]  N. Halbwachs,et al.  Synchronous programming of reactive systems: A tutorial and commented bibliography , 1998, CAV 1998.

[15]  Joëlle Coutaz,et al.  A generic platform for addressing the multimodal challenge , 1995, CHI '95.

[16]  Sophie Dupuy-Chessa,et al.  Test of the ICARE Platform Fusion Mechanism , 2005, DSV-IS.

[17]  Ioannis Parissis,et al.  Specification-based testing of synchronous software , 1996, SIGSOFT '96.

[18]  Laurence Nigay,et al.  ICARE: a component-based approach for the design and development of multimodal interfaces , 2004, CHI EA '04.

[19]  Jørgen Staunstrup.  Design Specification and Verification , 1997 .

[20]  Lydie du Bousquet,et al.  Lutess: a specification-driven testing environment for synchronous software , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[21]  BillinghurstMark.  Put that where? voice and gesture at the graphics interface , 1998 .

[22]  Laurence Nigay,et al.  Synchronous testing of multimodal systems: an operational profile-based approach , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[23]  Fabio Paternò,et al.  CTTE: Support for Developing and Analyzing Task Models for Interactive System Design , 2002, IEEE Trans. Software Eng..

[24]  Harold Thimbleby,et al.  Usability analysis with Markov models , 2001, TCHI.

[25]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[26]  Nicolas Halbwachs,et al.  Synchronous Programming of Reactive Systems , 1992, CAV.

[27]  Laurence Nigay,et al.  Testing the CARE Properties of Multimodal Applications by Means of a Synchronous Approach , 2005, IASTED Conf. on Software Engineering.