A Classification Model for Sensing Human Trust in Machines Using EEG and GSR

Today, intelligent machines interact and collaborate with humans in a way that demands a greater level of trust between human and machine. A first step toward building intelligent machines that are capable of building and maintaining trust with humans is the design of a sensor that will enable machines to estimate human trust level in real time. In this article, two approaches for developing classifier-based empirical trust-sensor models are presented that specifically use electroencephalography and galvanic skin response measurements. Human subject data collected from 45 participants is used for feature extraction, feature selection, classifier training, and model validation. The first approach considers a general set of psychophysiological features across all participants as the input variables and trains a classifier-based model for each participant, resulting in a trust-sensor model based on the general feature set (i.e., a “general trust-sensor model”). The second approach considers a customized feature set for each individual and trains a classifier-based model using that feature set, resulting in improved mean accuracy but at the expense of an increase in training time. This work represents the first use of real-time psychophysiological measurements for the development of a human trust sensor. Implications of the work, in the context of trust management algorithm design for intelligent machines, are also discussed.

[1]  Qing-guo Ma,et al.  You Have My Word: Reciprocity Expectation Modulates Feedback-Related Negativity in the Trust Game , 2015, PloS one.

[2]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[3]  Fang Chen,et al.  Using Galvanic Skin Response (GSR) to Measure Trust and Cognitive Load in the Text-Chat Environment , 2015, CHI Extended Abstracts.

[4]  Antonio Franchi,et al.  Human-Collaborative Schemes in the Motion Control of Single and Multiple Mobile Robots Mobile robot , 2017 .

[5]  W J Levy,et al.  Effect of Epoch Length on Power Spectrum Analysis of the EEG , 1987, Anesthesiology.

[6]  Luciano Mecacci,et al.  Anxiety, cognitive self-evaluation and performance: ERP correlates. , 2009, Journal of anxiety disorders.

[7]  Rana Fayyaz Ahmad,et al.  Feature extraction and classification for EEG signals using wavelet transform and machine learning techniques , 2015, Australasian Physical & Engineering Sciences in Medicine.

[8]  R. Nikula Psychological correlates of nonspecific skin conductance responses. , 1991, Psychophysiology.

[9]  Marko Robnik-Sikonja,et al.  Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF , 2004, Applied Intelligence.

[10]  Stephen J. Morrissey,et al.  Reviews of Human Factors and Ergonomics , 2008 .

[11]  M J Stokes,et al.  EEG-based communication: a pattern recognition approach. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  P. Stone,et al.  Use of skin conductance changes during mental stress testing as an index of autonomic arousal in cardiovascular research. , 1994, American heart journal.

[13]  Shouhuai Xu,et al.  Spatiotemporal Patterns and Predictability of Cyberattacks , 2015, PloS one.

[14]  Xiaolin Zhou,et al.  To believe or not to believe: trust choice modulates brain responses in outcome evaluation , 2012, Neuroscience.

[15]  Neera Jain,et al.  Real-Time Sensing of Trust in Human-Machine Interactions , 2016 .

[16]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[17]  H.K. Kim Filtering in the time and frequency domains , 1978, Proceedings of the IEEE.

[18]  Yue Wang,et al.  Human-Collaborative Schemes in the Motion Control of Single and Multiple Mobile Robots Mobile robot , 2017 .

[19]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[20]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[21]  Neera Jain,et al.  Dynamic modeling of trust in human-machine interactions , 2017, 2017 American Control Conference (ACC).

[22]  René Riedl,et al.  Are There Neural Gender Differences in Online Trust? An fMRI Study on the Perceived Trustworthiness of eBay Offers , 2010, MIS Q..

[23]  N. Jausovec,et al.  EEG activity during the performance of complex mental problems. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[25]  R. Riedl,et al.  The Biology of Trust: Integrating Evidence From Genetics, Endocrinology, and Functional Brain Imaging , 2012 .

[26]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[27]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[28]  C. Guézennec,et al.  EEG and ECG changes during simulator operation reflect mental workload and vigilance. , 2005, Aviation, space, and environmental medicine.

[29]  Nicholas R. Jennings,et al.  Human-agent collectives , 2014, CACM.

[30]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[31]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[32]  Yang Wang,et al.  Measurable Decision Making with GSR and Pupillary Analysis for Intelligent User Interface , 2015, ACM Trans. Comput. Hum. Interact..

[33]  Raja Parasuraman,et al.  Human-Automation Interaction , 2005 .

[34]  D Lehmann,et al.  Source localization of EEG activity during hypnotically induced anxiety and relaxation. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[36]  D. Sundararajan,et al.  Discretewavelet Transform: A Signal Processing Approach , 2015 .

[37]  Daniel Tranel,et al.  Right ventromedial prefrontal cortex: a neuroanatomical correlate of impulse control in boys. , 2009, Social cognitive and affective neuroscience.

[38]  Lilly Irani,et al.  Amazon Mechanical Turk , 2018, Advances in Intelligent Systems and Computing.

[39]  Paul C. Schutte,et al.  Human automation interaction , 2018 .

[40]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[41]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[42]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[43]  Catholijn M. Jonker,et al.  Formal Analysis of Models for the Dynamics of Trust Based on Experiences , 1999, MAAMAW.

[44]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[45]  Todd C. Handy,et al.  Event-related potentials : a methods handbook , 2005 .

[46]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[47]  Yang Wang,et al.  Multimodal behavior and interaction as indicators of cognitive load , 2012, TIIS.

[48]  Seana Coulson,et al.  Knowing When to Trust Others: An ERP Study of Decision Making After Receiving Information from Unknown People , 2009, Social cognitive and affective neuroscience.

[49]  K.-R. Muller,et al.  BCI meeting 2005-workshop on BCI signal processing: feature extraction and translation , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.