Communication Apprehension and Eye Contact Anxiety in Video Conferences Involving Teleoperated Robot Avatars: A Subjective Evaluation Study

Communication apprehension (CA), defined as anxiety in oral communication, and anxiety in eye contact (AEC), defined as the discomfort felt in communication while being stared at by others, limit communication effectiveness. In this study, we examined whether using a teleoperated robot avatar in a video teleconference provides communication support to people with CA and AEC. We propose a robotic telecommunication system in which a user has two options to produce utterance for own responses in online interaction with interviewer i.e., either by a robot avatar that faces the interviewer, or by self. Two imagination-based experiments were conducted, in which a total of 400 participants were asked to watch videos for interview scenes with or without the proposed system; 200 participants for each experiment. The participants then evaluated their impressions by imagining that they were the interviewee. In the first experiment, a video conference with the proposed system was compared with an ordinary video conference, where the interviewer and interviewee faced each other. In the second experiment, it was compared with an ordinary video conference where the interviewer’s attentional focus was directed away from the interviewee. A significant decrease in the expected CA and AEC of participants with the proposed system was observed in both experiments, whereas a significant increase in the expected sense of being attended (SoBA) was observed in the second experiment. This study contributes to the literature in terms of examining the expected impact of using a teleoperated robot avatar for better video conferences, especially for supporting individuals with CA and AEC.

[1]  Filippo Lanubile,et al.  Communication Media Selection for Remote Interaction of Ad Hoc Groups , 2010, Adv. Comput..

[2]  Justin W. Weeks,et al.  Relations among Social Anxiety, Eye Contact Avoidance, State Anxiety, and Perception of Interaction Performance during a Live Conversation , 2016, Cognitive behaviour therapy.

[3]  Sonya S. Kwak,et al.  Who is this?: Identity and presence in robot-mediated communication , 2017, Cognitive Systems Research.

[4]  The video cover letter: embedded assessment of oral communication skills , 2018, Quality Assurance in Education.

[5]  Gwyneth Doherty-Sneddon,et al.  Comparison of Face-to-Face and Video-Mediated Interaction , 1996, Interact. Comput..

[6]  Mark Keil,et al.  Feedback Channels: Using Social Presence Theory to Compare Voice Mail to E-Mail , 2002, J. Inf. Syst. Educ..

[7]  C. Erik Timmerman,et al.  Relating Computer, Communication, and Computer-Mediated Communication Apprehensions to New Communication Technology Use in the Workplace , 2005, Commun. Res..

[8]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[9]  G. Alpers,et al.  Is eye to eye contact really threatening and avoided in social anxiety?--An eye-tracking and psychophysiology study. , 2009, Journal of anxiety disorders.

[10]  J. Lobmaier,et al.  Gaze perception in social anxiety and social anxiety disorder , 2013, Front. Hum. Neurosci..

[11]  James C. McCroskey,et al.  An Introduction to Rhetorical Communication , 1971 .

[12]  Jeff B. Pelz,et al.  Eye contact and video-mediated communication: A review , 2013, Displays.

[13]  Virginia P. Richmond,et al.  The effects of communication apprehension on the perception of peers , 1976 .

[14]  The Mona Lisa Illusion—Scientists See Her Looking at Them Though She Isn’t , 2019, i-Perception.

[15]  J. Mccroskey.  Oral Communication Apprehension: A Reconceptualization , 1982 .

[16]  John Short,et al.  The social psychology of telecommunications , 1976 .

[17]  Scott E. Caplan,et al.  Social anxiety and computer-mediated communication during initial interactions: Implications for the hyperpersonal perspective , 2009, Comput. Hum. Behav..

[18]  Cynthia Breazeal,et al.  Semi-Autonomous Robot Avatar as a Medium for Family Communication and Education , 2009, Adv. Robotics.

[19]  John C. Tang,et al.  What video can and cannot do for collaboration: A case study , 2005, Multimedia Systems.

[20]  J. Mccroskey.  The effects of communication apprehension on nonverbal behavior , 1976 .

[21]  M. Meadows,et al.  I, Avatar: The Culture and Consequences of Having a Second Life , 2007 .

[22]  T. Rodebaugh,et al.  Social Anxiety and Gaze Avoidance: Averting Gaze but not Anxiety , 2013, Cognitive Therapy and Research.

[23]  Phillip V. Lewis,et al.  Communication Apprehension as a Determinant of Channel Preferences , 1984 .

[24]  Robert M. Fano.  Computer-Mediated Communication , 1985, IEEE Technology and Society Magazine.

[25]  Kin Hong Wong,et al.  Robot Avatar: A Virtual Tourism Robot for People with Disabilities , 2017 .

[26]  Jari K. Hietanen,et al.  Seeing direct and averted gaze activates the approach–avoidance motivational brain systems , 2008, Neuropsychologia.

[27]  Yuichiro Yoshikawa,et al.  Communication Support via a Tele-Operated Robot for Easier Talking: Case/Laboratory Study of Individuals with/Without Autism Spectrum Disorder , 2018, Int. J. Soc. Robotics.

[28]  Zahra Ashktorab,et al.  Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns , 2019, CHI.

[29]  Chayan Chakrabarti,et al.  Artificial conversations for customer service chatter bots: Architecture, algorithms, and evaluation metrics , 2015, Expert Syst. Appl..

[30]  Shirley S. Ho,et al.  Social-Psychological Influences on Opinion Expression in Face-to-Face and Computer-Mediated Communication , 2008, Commun. Res..

[31]  Andrew F. Monk,et al.  Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus , 1998, Int. J. Hum. Comput. Stud..

[32]  Ruth A. Maurer,et al.  Using Digital Video Technology to Reduce Communication Apprehension in Business Education , 2009, INFORMS Trans. Educ..

[33]  Chao-Jung Ko,et al.  The Effect of Task Types on Foreign Language Learners' Social Presence in Synchronous Computer Mediated Communication (SCMC). , 2016 .

[34]  M. Liebowitz,et al.  Fear and avoidance of eye contact in social anxiety disorder. , 2011, Comprehensive psychiatry.

[35]  R. Rice.  Media Appropriateness Using Social Presence Theory to Compare Traditional and New Organizational Media , 1993 .

[36]  V. Freimuth.  The Effects of Communication Apprehension on Communication Effectiveness , 1976 .

[37]  R. Hodge.  Interpersonal classroom communication through eye contract , 1971 .

[38]  Jason S. Wrench,et al.  Analyzing College Students' Social Media Communication Apprehension , 2018, Cyberpsychology Behav. Soc. Netw..

[39]  Tamyra Pierce,et al.  Social anxiety and technology: Face-to-face communication versus technological communication among teens , 2009, Comput. Hum. Behav..

[40]  Yasushi Hirano,et al.  Reciprocal attentive communication in remote meeting with a humanoid robot , 2007, ICMI '07.

[41]  W. G. Tymon,et al.  Communication Apprehension, Interpretive Styles, Preparation, and Performance in Oral Briefing , 1994 .

[42]  Don G. Bouwhuis,et al.  Eye contact as a determinant of social presence in video communication , 2006 .

[43]  R. Soussignan,et al.  Gaze avoidance in social phobia: objective measure and correlates. , 2010, Behaviour research and therapy.

[44]  Kazuaki Tanaka,et al.  Physical Embodiment Can Produce Robot Operator’s Pseudo Presence , 2015, Front. ICT.

[45]  Ben J. A. Kröse,et al.  Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model , 2010, Int. J. Soc. Robotics.

[46]  Edward Castronova.  Theory of the Avatar , 2003, SSRN Electronic Journal.

[47]  Manfred Tscheligi,et al.  Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games , 2018, Entertain. Comput..

[48]  Jered Borup,et al.  Improving online social presence through asynchronous video , 2012, Internet High. Educ..

[49]  Raymond Chiong,et al.  Avatars and Embodied Agents in Experimental Information Systems Research: A Systematic Review and Conceptual Framework , 2019, Australas. J. Inf. Syst..

[50]  Jorun Børsting,et al.  A Robot Avatar: Easier Access to Education and Reduction in Isolation? , 2016 .

[51]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[52]  Justin W. Weeks,et al.  GAZE AVOIDANCE IN SOCIAL ANXIETY DISORDER , 2013, Depression and anxiety.

[53]  Timothy T. Baldwin,et al.  Communication Apprehension: A Barrier to Students' Leadership, Adaptability, and Multicultural Appreciation , 2013 .

[54]  Shuichi Nishio,et al.  Incorporated identity in interaction with a teleoperated android robot: A case study , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[55]  Christine Greenhow,et al.  Hybrid Learning in Higher Education: The Potential of Teaching and Learning With Robot-Mediated Communication , 2017 .