In AI We Trust: Investigating the Relationship between Biosignals, Trust and Cognitive Load in VR

Human trust is a psycho-physiological state that is difficult to measure, yet is becoming increasingly important for the design of human-computer interactions. This paper explores if human trust can be measured using physiological measures when interacting with a computer interface, and how it correlates with cognitive load. In this work, we present a pilot study in Virtual Reality (VR) that uses a multi-sensory approach of Electroencephalography (EEG), galvanic skin response (GSR), and Heart Rate Variability (HRV) to measure trust with a virtual agent and explore the correlation between trust and cognitive load. The goal of this study is twofold; 1) to determine the relationship between biosignals, or physiological signals with trust and cognitive load, and 2) to introduce a pilot study in VR based on cognitive load level to evaluate trust. Even though we could not report any significant main effect or interaction of cognitive load and trust from the physiological signal, we found that in low cognitive load tasks, EEG alpha band power reflects trustworthiness on the agent. Moreover, cognitive load of the user decreases when the agent is accurate regardless of task’s cognitive load. This could be possible because of small sample size, tasks not stressful enough to induce high cognitive load due to lab study and comfortable environment or timestamp synchronisation error due to fusing data from various physiological sensors with different sample rate.

[1]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[2]  Didier Stricker,et al.  Visual Computing as a Key Enabling Technology for Industrie 4.0 and Industrial Internet , 2015, IEEE Computer Graphics and Applications.

[3]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[4]  Mark R. Lehto,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[5]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[6]  Jacek Gwizdka Using stroop task to assess cognitive load , 2010, ECCE.

[7]  Kai Kunze,et al.  Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear , 2017, SEMWEB.

[8]  Mika P. Tarvainen,et al.  Kubios HRV - Heart rate variability analysis software , 2014, Comput. Methods Programs Biomed..

[9]  Neera Jain,et al.  A Classification Model for Sensing Human Trust in Machines Using EEG and GSR , 2018, ACM Trans. Interact. Intell. Syst..

[10]  Sandra G. Hart,et al.  NASA Task Load Index (TLX) , 2013 .

[11]  A. Hamilton,et al.  Testing the relationship between mimicry, trust and rapport in virtual reality conversations , 2016, Scientific Reports.

[12]  Bruce H. Thomas,et al.  Levity: A Virtual Reality System that Responds to Cognitive Load , 2018, CHI Extended Abstracts.

[13]  Daniel McDuff,et al.  COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera , 2016, CHI.

[14]  Yun Suen Pai Physiological Signal-Driven Virtual Reality in Social Spaces , 2016, UIST.

[15]  Nilanjan Sarkar,et al.  Cognitive Load Measurement in a Virtual Reality-Based Driving System for Autism Intervention , 2017, IEEE Transactions on Affective Computing.

[16]  Mohamed Abouelenien,et al.  Detecting Human Thermal Discomfort via Physiological Signals , 2017, PETRA.

[17]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[18]  Martin Breidt,et al.  Face reality: investigating the Uncanny Valley for virtual faces , 2010, SIGGRAPH ASIA.

[19]  Lydia Tapia,et al.  Design and Implementation of a Virtual Reality System and Its Application to Training Medical First Responders , 2000, Presence: Teleoperators & Virtual Environments.

[20]  Neera Jain,et al.  Real-Time Sensing of Trust in Human-Machine Interactions , 2016 .

[21]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[22]  Rajesh Aggarwal,et al.  Recent Advancements in Medical Simulation: Patient-Specific Virtual Reality Simulation , 2012, World Journal of Surgery.

[23]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[24]  Jérémy Frey,et al.  Framework for Electroencephalography-based Evaluation of User Experience , 2016, CHI.

[25]  Fang Chen,et al.  Using Galvanic Skin Response (GSR) to Measure Trust and Cognitive Load in the Text-Chat Environment , 2015, CHI Extended Abstracts.

[26]  Blanca Hernández-Ortega The role of post-use trust in the acceptance of a technology: Drivers and consequences , 2011 .

[27]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[28]  David W. Hughes,et al.  Is anybody out there? , 1998, Nature.

[29]  Katarzyna Samson,et al.  Effects of Cognitive Load on Trusting Behavior – An Experiment Using the Trust Game , 2015, PloS one.

[30]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[31]  Sirkka L. Jarvenpaa,et al.  Is Anybody Out There? Antecedents of Trust in Global Virtual Teams , 1998, J. Manag. Inf. Syst..

[32]  Glyn Lawson,et al.  The Relationship Between Presence and Trust in Virtual Reality , 2016, ECCE.

[33]  Izak Benbasat,et al.  Online Consumer Trust and Live Help Interfaces: The Effects of Text-to-Speech Voice and Three-Dimensional Avatars , 2005, Int. J. Hum. Comput. Interact..

[34]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[35]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[36]  D. H. Mills The Logic and Limits of Trust , 1983 .

[37]  Wioleta Szwoch,et al.  Emotion Recognition Using Physiological Signals , 2015, MIDI '15.

[38]  E. Bedel Relationship between , 2009 .

[39]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[40]  Andreas Dunser,et al.  Combining EEG with Pupillometry to Improve Cognitive Workload Detection , 2015, Computer.

[41]  John D. Murphy,et al.  Avatars, People, and Virtual Worlds: Foundations for Research in Metaverses , 2009, J. Assoc. Inf. Syst..

[42]  Arindam Dey,et al.  Exploration of an EEG-Based Cognitively Adaptive Training System in Virtual Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[43]  Sandra G. Hart,et al.  NASA Task Load Index (TLX). Volume 1.0; Paper and Pencil Package , 1986 .

[44]  Koichi Kise,et al.  Mental State Analysis on Eyewear , 2018, UbiComp/ISWC Adjunct.

[45]  Neera Jain,et al.  Dynamic modeling of trust in human-machine interactions , 2017, 2017 American Control Conference (ACC).

[46]  Soo-Young Lee,et al.  A Preliminary Study on Human Trust Measurements by EEG for Human-Machine Interactions , 2015, HAI.