Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability

This paper presents mixed reality humans (MRHs), a new type of embodied agent enabling touch-driven communication. Affording touch between human and agent allows MRHs to simulate interpersonal scenarios in which touch is crucial. Two studies provide initial evaluation of user behavior with a MRH patient and the usability and acceptability of a MRH patient for practice and evaluation of medical students' clinical skills. In Study I (n = 8) it was observed that students treated MRHs as social actors more than students in prior interactions with virtual human patients (n = 27), and used interpersonal touch to comfort and reassure the MRH patient similarly to prior interactions with human patients (n = 76). In the within-subjects Study II (n = 11), medical students performed a clinical breast exam on each of a MRH and human patient. Participants performed equivalent exams with the MRH and human patients, demonstrating the usability of MRHs to evaluate students' exam skills. The acceptability of the MRH patient for practicing exam skills was high as students rated the experience as believable and educationally beneficial. Acceptability was improved from Study I to Study II due to an increase in the MRH's visual realism, demonstrating that visual realism is critical for simulation of specific interpersonal scenarios.

[1]  R. Heslin,et al.  Hands touching hands: affective and evaluative effects of an interpersonal touch. , 1976, Sociometry.

[2]  J. Bruhn,et al.  The Doctor's Touch: Tactile Communication in the Doctor-Patient Relationship , 1978, Southern medical journal.

[3]  Howard S. Friedman,et al.  Some Effects of Gaze on Subjects Motivated to Seek or to Avoid Social Comparison. , 1978 .

[4]  C. K. Adams,et al.  Improved detection of human breast lesions following experimental training , 1980, Cancer.

[5]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[6]  Melanie Booth-Butterfield,et al.  Reach out and Touch Someone: Analysis of Nonverbal Comforting Responses. , 1993 .

[7]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[8]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[9]  Jeremy N. Bailenson,et al.  Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments , 2001, Presence: Teleoperators & Virtual Environments.

[10]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[11]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[12]  Jane Kidd,et al.  An innovative model for teaching and learning clinical procedures , 2002, Medical education.

[13]  Randall W. Hill,et al.  Virtual Humans in the Mission Rehearsal Exercise System , 2003, Künstliche Intell..

[14]  Nicole A. Lazar,et al.  Testing Statistical Hypotheses of Equivalence , 2003, Technometrics.

[15]  Michael J. Singer,et al.  Virtual environment cultural training for operational readiness (VECTOR) , 2004, Virtual Reality.

[16]  Delia S Anderson,et al.  Communication assessment using the common ground instrument: psychometric properties. , 2004, Family medicine.

[17]  Daniel Kopans,et al.  Clinical Breast Examination: Practical Recommendations for Optimizing Performance and Reporting , 2004, CA: a cancer journal for clinicians.

[18]  Arno M M Muijtjens,et al.  Assessing simulated patients in an educational setting: the MaSP (Maastricht Assessment of Simulated Patients) , 2004, Medical education.

[19]  Larry F. Hodges,et al.  Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness , 2006, CHI.

[20]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[21]  Kyle Johnsen,et al.  Evolving an Immersive Medical Communication Skills Trainer , 2006, Presence: Teleoperators & Virtual Environments.

[22]  Jeremy N. Bailenson,et al.  Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments , 2008, Multimedia Tools and Applications.

[23]  Kyle Johnsen,et al.  The validity of a virtual human experience for interpersonal skills education , 2007, CHI.

[24]  Kyle Johnsen,et al.  Comparing Interpersonal Interactions with a Virtual Human to Those with a Real Human , 2007, IEEE Transactions on Visualization and Computer Graphics.

[25]  Sabarish V. Babu,et al.  Can Immersive Virtual Humans Teach Social Conversational Protocols? , 2007, 2007 IEEE Virtual Reality Conference.

[26]  Benjamin Lok,et al.  Virtual Human + Tangible Interface = Mixed Reality Human An Initial Exploration with a Virtual Breast Exam Patient , 2008, 2008 IEEE Virtual Reality Conference.