Adaptive Probabilistic Classification of Dynamic Processes: A Case Study on Human Trust in Automation

Classification algorithms have traditionally been developed based on the assumption of independent data samples characterized by a stationary distribution. However, some data types, including human-subject data, typically do not satisfy the aforementioned assumptions. This is relevant given the growing need for models of human behavior (as they relate to research in human-machine interaction). In this paper, we propose an adaptive probabilistic classification algorithm using a generative model. We model the prior probabilities using a Markov decision process to incorporate temporal dynamics. The conditional probabilities use an adaptive Bayes quadratic discriminant analysis classifier. We implement and validate the proposed algorithm for prediction of human trust in automation using electroencephalography (EEG) and behavioral response data. An improved accuracy is obtained for the proposed classifier as compared to an adaptive classifier that does not consider the temporal dynamics of the process being considered. The proposed algorithm can be used for classification of other human behaviors measured using psychophysiological data and behavioral responses, as well as other dynamic processes characterized by data with non-stationary distributions.

[1]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[2]  G. Pfurtscheller,et al.  Information transfer rate in a five-classes brain-computer interface , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Neera Jain,et al.  Dynamic modeling of trust in human-machine interactions , 2017, 2017 American Control Conference (ACC).

[4]  Desney S. Tan,et al.  Brain-Computer Interfaces and Human-Computer Interaction , 2010, Brain-Computer Interfaces.

[5]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[6]  Neera Jain,et al.  A Classification Model for Sensing Human Trust in Machines Using EEG and GSR , 2018, ACM Trans. Interact. Intell. Syst..

[7]  Christoforos Anagnostopoulos,et al.  Online linear and quadratic discriminant analysis with adaptive forgetting for streaming classification , 2012, Stat. Anal. Data Min..

[8]  F. Cincotti,et al.  Comparison of different feature classifiers for brain computer interfaces , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[9]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[10]  Lilly Irani,et al.  Amazon Mechanical Turk , 2018, Advances in Intelligent Systems and Computing.

[11]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[12]  Catholijn M. Jonker,et al.  Formal Analysis of Models for the Dynamics of Trust Based on Experiences , 1999, MAAMAW.

[13]  Neera Jain,et al.  Real-Time Sensing of Trust in Human-Machine Interactions , 2016 .

[14]  Mark Hoogendoorn,et al.  Modeling and Validation of Biased Human Trust , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[15]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.