Autonomous Virtual Human Agents for Healthcare Information Support and Clinical Interviewing

This chapter discusses virtual human (VH) conversational agents to support client interaction within a healthcare context. After a brief discussion of the history of VHs in the Clinical Virtual Reality domain, applications where a VH can provide private online healthcare information and support (i.e., SimCoach) and where a VH can serve the role as a clinical interviewer (i.e., SimSensei) are presented.

[1]  Stacy Marsella,et al.  How virtual reality training can win friends and influence people , 2013 .

[2]  Todd Bowerly,et al.  A Virtual Reality Scenario for All Seasons: The Virtual Classroom , 2009, CNS Spectrums.

[3]  Albert A. Rizzo,et al.  Sorting Out the Virtual Patient: How to Exploit Artificial Intelligence, Game Technology and Sound Educational Practices to Create Engaging Role-Playing Simulations , 2012, Int. J. Gaming Comput. Mediat. Simulations.

[4]  Jonathan Gratch,et al.  Socially Anxious People Reveal More Personal Information with Virtual Counselors That Talk about Themselves using Intimate Human Back Stories , 2012, Annual Review of Cybertherapy and Telemedicine.

[5]  Rena A. Menke.  Examining nonverbal shame markers among post-pregnancy women with maltreatment histories , 2011 .

[6]  Javier R. Movellan,et al.  Generalized adaptive view-based appearance model: Integrated framework for monocular head pose estimation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[7]  J. Pennebaker,et al.  Language use of depressed and depression-vulnerable college students , 2004 .

[8]  Christine Eibner,et al.  Invisible Wounds of War. Summary and Recommendations for Addressing Psychological and Cognitive Injuries , 2008 .

[9]  Suzanne P. Weisband,et al.  Self disclosure on computer forms: meta-analysis and implications , 1996, CHI.

[10]  Gwen Littlewort,et al.  Toward Practical Smile Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Sabarish V. Babu,et al.  "What Would You Like to Talk About?" An Evaluation of Social Conversations with a Virtual Receptionist , 2006, IVA.

[12]  P. Waxer.  Nonverbal cues for depression. , 1974, Journal of abnormal psychology.

[13]  J. Schelde.  Major depression: behavioral markers of depression and recovery. , 1998, The Journal of nervous and mental disease.

[14]  J. Galen Buckwalter,et al.  A Controlled Clinical Comparison of Attention Performance in Children with ADHD in a Virtual Reality Classroom Compared to Standard Neuropsychological Methods , 2007, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[15]  J. Cassell,et al.  Social Dialongue with Embodied Conversational Agents , 2005 .

[16]  Lee McCauley,et al.  MIKI: A Speech Enabled Intelligent Kiosk , 2006, IVA.

[17]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[18]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1956 .

[19]  Lauren M. Bylsma,et al.  A meta-analysis of emotional reactivity in major depressive disorder. , 2008, Clinical psychology review.

[20]  S. Brunnhuber,et al.  Facial Expression and Experience of Emotions in Psychodynamic Interviews with Patients with PTSD in Comparison to Healthy Subjects , 2007, Psychopathology.

[21]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[22]  Fernando De la Torre,et al.  Detecting depression from facial actions and vocal prosody , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[23]  Stacy Marsella,et al.  SmartBody: behavior realization for embodied conversational agents , 2008, AAMAS.

[24]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Judith A. Hall,et al.  Nonverbal behavior in clinician—patient interaction , 1995 .

[26]  Randall W. Hill,et al.  Steve Goes to Bosnia: Towards a New Generation of Virtual Humans for Interactive Experiences , 2001 .

[27]  D. Lazer,et al.  Using reality mining to improve public health and medicine. , 2009, Studies in health technology and informatics.

[28]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[29]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[30]  Amy C. Traylor,et al.  A Feasibility Study of Virtual Reality-Based Coping Skills Training for Nicotine Dependence , 2012, Research on social work practice.

[31]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[32]  John E. Perez,et al.  Nonverbal Social Skills and Psychopathology , 2003 .

[33]  H. Chad Lane,et al.  Virtual Humans for Learning , 2013, AI Mag..

[34]  Albert A. Rizzo,et al.  User-State Sensing for Virtual Health Agents and TeleHealth Applications , 2013, MMVR.

[35]  J. Schelde.  Major depression: behavioral parameters of depression and recovery. , 1998, The Journal of nervous and mental disease.

[36]  Jonathan Gratch,et al.  A Virtual Human Agent for Training Novice Therapist Clinical Interviewing Skills , 2007 .

[37]  Louis-Philippe Morency,et al.  Modeling Human Communication Dynamics [Social Sciences] , 2010, IEEE Signal Processing Magazine.

[38]  Patrick Kenny,et al.  SimCoach: an intelligent virtual human system for providing healthcare information and support , 2011 .

[39]  Albert A. Rizzo,et al.  Automatic audiovisual behavior descriptors for psychological disorder analysis , 2014, Image Vis. Comput..

[40]  Steven Kerr,et al.  The AS interactive project: single-user and collaborative virtual environments for people with high-functioning autistic spectrum disorders , 2003, Comput. Animat. Virtual Worlds.

[41]  Benjamin Kuipers,et al.  Computer power and human reason , 1976, SGAR.

[42]  Steve R. Howell.  Computers in Psychotherapy: A New Prescription , 2000 .

[43]  J. Blascovich,et al.  Proxemic behaviors as predictors of aggression towards Black (but not White) males in an immersive virtual environment , 2009 .

[44]  J. Talbott.  Importance of Anonymity to Encourage Honest Reporting in Mental Health Screening After Combat Deployment , 2013 .

[45]  Louis-Philippe Morency,et al.  It's only a computer: Virtual humans increase willingness to disclose , 2014, Comput. Hum. Behav..

[46]  C. Coles,et al.  Case study: using a virtual reality computer game to teach fire safety skills to children diagnosed with fetal alcohol syndrome. , 2006, Journal of pediatric psychology.

[47]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[48]  J. Cassell,et al.  SOCIAL DIALOGUE WITH EMBODIED CONVERSATIONAL AGENTS , 2005 .

[49]  C. Hoge,et al.  Combat duty in Iraq and Afghanistan, mental health problems and barriers to care. , 2004, U.S. Army Medical Department journal.

[50]  Barbara O Rothbaum,et al.  Cognitive behavioral therapy for public‐speaking anxiety using virtual reality for exposure , 2005, Depression and anxiety.

[51]  David R. Traum,et al.  Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents , 2008, IVA.

[52]  James A. Russell,et al.  The psychology of facial expression: What does a facial expression mean? , 1997 .

[53]  Louis-Philippe Morency,et al.  Modeling Human Communication Dynamics , 2010 .

[54]  J. Bailenson,et al.  Transformed Social Interaction: Exploring the Digital Plasticity of Avatars , 2006 .

[55]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[56]  Albert A. Rizzo,et al.  Immersiveness and Physiological Arousal within Panoramic Video-Based Virtual Reality , 2007, Cyberpsychology Behav. Soc. Netw..

[57]  David DeVault,et al.  Detection and Computational Analysis of Psychological Signals Using a Virtual Human Interviewing Agent , 2014 .

[58]  M T McGuire,et al.  Nonverbal interaction of patients and therapists during psychiatric interviews. , 1982, Journal of abnormal psychology.

[59]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..