Experiences in using immersive virtual characters to educate medical communication skills

This paper presents a system which allows medical students to experience the interaction between a patient and a medical doctor using natural methods of interaction with a high level of immersion. We also present our experiences with a pilot group of medical and physician assistant students at various levels of training. They interacted with projector-based life-sized virtual characters using gestures and speech. We believe that natural interaction and a high level of immersion facilitates the education of communication skills. We present the system details as well as the participants' performance and opinions. The study confirmed that the level of immersion contributed significantly to the experience, and participants reported that the system is a powerful tool for teaching and training. Applying the system to formal communication skills evaluation and further scenario development will be the focus of future research and refinement.

[1]  Christine L. Lisetti.  Personality, Affect and Emotion Taxonomy for Socially Intelligent Agents , 2002, FLAIRS Conference.

[2]  Julian A. Smith.  Sabiston. Textbook of Surgery: The Biological Basis of Modern Surgical Practice , 2002 .

[3]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[4]  Hironori Hirata,et al.  Method of crowd simulation by using multiagent on cellular automata , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[5]  Ronald F. Martin,et al.  THE ACUTE ABDOMEN: An Overview and Algorithms , 1997 .

[6]  Norman I. Badler,et al.  Virtual humans for validating maintenance procedures , 2002, CACM.

[7]  Mel Slater,et al.  Collaboration in Tele-Immersive Environments , 2002, EGVE.

[8]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jake K. Aggarwal,et al.  Human motion analysis: a review , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[10]  Sheila B. Banks,et al.  An Architecture to Address Uncertain Requirements and Composability for Intelligent Agents in Distributed Simulations , 2003, HIS.

[11]  Sabarish V. Babu,et al.  Effects of travel technique on cognition in virtual environments , 2004, IEEE Virtual Reality 2004.

[12]  Kyle Johnsen,et al.  Evaluating a Script -Based Approach for Simulating Patient -Doctor Interaction , 2005 .

[13]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[14]  Damian A. Isla,et al.  Creature Smarts: The Art and Architecture of a Virtual Brain , 2001 .

[15]  Arno M M Muijtjens,et al.  Assessing simulated patients in an educational setting: the MaSP (Maastricht Assessment of Simulated Patients) , 2004, Medical education.

[16]  Samsun Lampotang,et al.  Functional Anatomy of Full-Scale Patient Simulators , 2004, Journal of Clinical Monitoring.

[17]  Randall W. Hill,et al.  Virtual Humans in the Mission Rehearsal Exercise System , 2003, Künstliche Intell..

[18]  Mary C. Whitton,et al.  Effects of Handling Real Objects and Self-Avatar Fidelity on Cognitive Task Performance and Sense of Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[19]  Kristinn R. Thórisson.  Gandalf: an embodied humanoid capable of real-time multimodal dialogue with people , 1997, AGENTS '97.

[20]  Marc Erich Latoschik,et al.  Resolving object references in multimodal dialogues for immersive virtual environments , 2004, IEEE Virtual Reality 2004.

[21]  Delia S Anderson,et al.  Communication assessment using the common ground instrument: psychometric properties. , 2004, Family medicine.

[22]  Dimitris N. Metaxas,et al.  A framework for motion recognition with applications to American sign language and gait recognition , 2000, Proceedings Workshop on Human Motion.

[23]  Samia Nefti,et al.  Education for health care professionals through the medium of the Internet , 2000, Proceedings International Workshop on Advanced Learning Technologies. IWALT 2000. Advanced Learning Technology: Design and Development Issues.

[24]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[25]  Jonathan E. Rhoads.  Textbook of Surgery, 15th Edition: The Biological Basis of Modern Surgical Practice , 1997 .

[26]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[27]  P N Kizakevich,et al.  The virtual standardized patient. Simulated patient-practitioner dialog for patient interview training. , 2000, Studies in health technology and informatics.

[28]  A. R. Dillon,et al.  The acute abdomen. , 1983, The Veterinary clinics of North America. Small animal practice.

[29]  Ramesh Raskar,et al.  Immersive planar display using roughly aligned projectors , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[30]  Randy F. Pausch,et al.  Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments , 2002, CHI.

[31]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[32]  M. Bearman.  Is Virtual the Same as Real? Medical Students' Experiences of a Virtual Patient , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[33]  George Papagiannakis,et al.  Interactive Scenario Immersion: Health Emergency Decision Training in JUST Project , 2002 .

[34]  Mel Slater,et al.  The impact of eye gaze on communication using humanoid avatars , 2001, CHI.

[35]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..