Cognitive workload and affective state: A computational study using Bayesian networks

This paper uses Bayesian networks to investigate the impact of three different kind of inputs, namely, physiological, cognitive and affect features, on workload estimation, from a computational point of view. The ability of the proposed models to infer the workload variation of subjects involved in successive tasks demanding different levels of cognitive resources is discussed, in term of two criteria to be jointly optimized: the diversity, i.e. the ability of the model to perform on different subjects, and the accuracy, i.e., how close from the (subjectively estimated) workload level the model prediction is.

[1]  M. Dawson,et al.  The electrodermal system , 2007 .

[2]  B. Cain A Review of the Mental Workload Literature , 2007 .

[3]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[4]  Patrick Gaudreau,et al.  Positive and negative affective states in a performance-related setting: Testing the factorial structure of the panas across two samples of french-canadian participants. , 2006 .

[5]  Jing Zhang,et al.  Learning-Based Driver Workload Estimation , 2008, Computational Intelligence in Automotive Applications.

[6]  Rouja Nikolova,et al.  Functional Determination of the Operator State in the Interaction of Humans with Automated Systems , 2003 .

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Tanja Schultz,et al.  Multimodal Recognition of Cognitive Workload for Multitasking in the Car , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  Michela Terenzi,et al.  Using the Distribution of Eye Fixations to Assess Pilots' Mental Workload , 2006 .

[10]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[11]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[12]  Marco Botta,et al.  Evaluation of Distraction in a Driver-Vehicle-Environment Framework: An Application of Different Data-Mining Techniques , 2009, ICDM.

[13]  Changchun Liu,et al.  An empirical study of machine learning techniques for affect recognition in human–robot interaction , 2006, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[15]  Pavlo A. Krokhmal,et al.  An algorithm for online detection of temporal changes in operator cognitive state using real-time psychophysiological data , 2010, Biomed. Signal Process. Control..

[16]  T. Dalgleish Basic Emotions , 2004 .

[17]  B. Wallin,et al.  The sympathetic nervous system in man — aspects derived from microelectrode recordings , 1986, Trends in Neurosciences.

[18]  Anthony F. Norcio,et al.  Adaptive human-computer interfaces: a literature survey and perspective , 1989, IEEE Trans. Syst. Man Cybern..

[19]  Sandra G. Hart,et al.  NASA Task Load Index (TLX) , 2013 .

[20]  Jean-Philippe Thiran,et al.  Extraction of Audio Features Specific to Speech Production for Multimodal Speaker Detection , 2008, IEEE Transactions on Multimedia.

[21]  A. Sanders Towards a model of stress and human performance. , 1983, Acta psychologica.

[22]  A. Isen,et al.  An Influence of Positive Affect on Decision Making in Complex Situations: Theoretical Issues With Practical Implications , 2001 .

[23]  Peter A. Hancock,et al.  Human factors and safety in the design of intelligent vehicle-highway systems (IVHS) , 1992 .

[24]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[25]  Zhiwei Zhu,et al.  Toward a decision-theoretic framework for affect recognition and user assistance , 2006, Int. J. Hum. Comput. Stud..

[26]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .