A multi-modal interface for an interactive simulated vascular reconstruction system

This paper is devoted to multi-modal interface design and implementation of a simulated vascular reconstruction system. It provides multi-modal interaction methods such as speech recognition, hand gestures, direct manipulation of virtual 3D objects and measurement tools. The main challenge is that no general interface scenario in existence today can satisfy all the users of the system (radiologists, vascular surgeons, medical students, etc.). The potential users of the system can vary by their skills, expertise level, habits and psycho-motional characteristics. To make a multimodal interface user-friendly is a crucial issue. In this paper we introduce an approach to develop such an efficient, user-friendly multi-modal interaction system. We focus on adaptive interaction as a possible solution to address the variety of end-users. Based on a user model, the adaptive user interface identifies each individual by means of a set of criteria and generates a customized exploration environment.

[1]  Peter M. A. Sloot,et al.  Lattice-Boltzmann hydrodynamics on parallel systems , 1998 .

[2]  Theo Mandel,et al.  The Elements of User Interface Design , 1997 .

[3]  Peter M. A. Sloot,et al.  The Design of Dynamic Exploration Environments for Computational Steering Simulations , 2000 .

[4]  T.L.J. Ferris,et al.  User-Centered Design: An Integrated Approach , 2004, IEEE Transactions on Professional Communication.

[5]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[6]  Elena V. Zudilova-Seinstra.  Simulation-Visualization Complexes as Generic Exploration Environment , 2001, International Conference on Computational Science.

[7]  Jon Trinder,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2002, Interact. Learn. Environ..

[8]  Scott Isensee,et al.  User-Centered Design: An Integrated Approach with Cdrom , 2001 .

[9]  Aline Berthome-Montoy.  Generating Self-Adaptive Human-Computer Interfaces , 1993, EWHCI.

[10]  Peter M. A. Sloot,et al.  Scenario Switches and State Updates in an Agent-based Solution to Constructing Interactive Simulation Systems , 2002 .

[11]  Larry F. Hodges,et al.  User Interface Constraints for Immersive Virtual Environment Applications , 1995 .

[12]  Chris Baber,et al.  Designing habitable dialogues for speech-based interaction with computers , 2001, Int. J. Hum. Comput. Stud..

[13]  Peter M. A. Sloot,et al.  AG-IVE: An Agent Based Solution to Constructing Interactive Simulation Systems , 2002, International Conference on Computational Science.

[14]  Karan Harbison,et al.  User-Centered Requirements: The Scenario-Based Engineering Process , 1997 .

[15]  Peter M. A. Sloot,et al.  Simulated vascular reconstruction in a virtual operating theatre , 2001, CARS.

[16]  Don Hannema,et al.  Interaction in Virtual Reality , 2001 .

[17]  Peter M. A. Sloot,et al.  A first step to a user centered approach to a development of adaptive simulation-visualization complexes , 2002 .

[18]  Shamus P. Smith,et al.  Editorial : User Centered Design and Implementation of Virtual Environments , 2022 .

[19]  Daniel M. Brown,et al.  Review of The humane interface , 2002 .