Formal Detection of Attentional Tunneling in Human Operator–Automation Interactions

The allocation of visual attention is a key factor for the humans when operating complex systems under time pressure with multiple information sources. In some situations, attentional tunneling is likely to appear and leads to excessive focus and poor decision making. In this study, we propose a formal approach to detect the occurrence of such an attentional impairment that is based on machine learning techniques. An experiment was conducted to provoke attentional tunneling during which psycho-physiological and oculomotor data from 23 participants were collected. Data from 18 participants were used to train an adaptive neuro-fuzzy inference system (ANFIS). From a machine learning point of view, the classification performance of the trained ANFIS proved the validity of this approach. Furthermore, the resulting classification rules were consistent with the attentional tunneling literature. Finally, the classifier was robust to detect attentional tunneling when performing over test data from four participants.

[1]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[2]  H P BAHRICK,et al.  Effect of incentives upon reactions to peripheral stimuli. , 1952, Journal of experimental psychology.

[3]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[5]  Christopher D. Wickens,et al.  ATTENTIONAL TUNNELING AND TASK MANAGEMENT , 2005 .

[6]  Mickaël Causse,et al.  The effects of emotion on pilot decision-making: a neuroergonomic approach to aviation safety , 2013 .

[7]  Frédéric Dehais,et al.  GHOST: experimenting conflicts countermeasures in the pilot's activity , 2003, IJCAI 2003.

[8]  Raja Parasuraman,et al.  Neuroergonomics: The Brain at Work , 2006 .

[9]  Rebecca M. Warner,et al.  Cardiovascular reactivity and positive/negative affect during conversations , 1995, Journal of Behavioral Medicine.

[10]  Stéphane Mercier,et al.  Conflicts in Human Operator - Unmanned Vehicles Interactions , 2009, HCI.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  L J Williams,et al.  Tunnel Vision Induced by a Foveal Load Manipulation , 1985, Human factors.

[13]  Frédéric Dehais,et al.  The Perseveration Syndrome in the Pilot's Activity: Guidelines and Cognitive Countermeasures , 2009, HESSD.

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  I Rock,et al.  Inattentional Blindness as a Function of Proximity to the Focus of Attention , 1998, Perception.

[16]  Mark Claypool,et al.  The effects of loss and latency on user performance in unreal tournament 2003® , 2004, NetGames '04.

[17]  M. Bradley,et al.  Affective reactions to briefly presented pictures. , 2001, Psychophysiology.

[18]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[19]  S. W. Brown,et al.  Time perception and attention: The effects of prospective versus retrospective paradigms and task demands on perceived duration , 1985, Perception & psychophysics.

[20]  Frédéric Dehais,et al.  Towards human operator "state" assessment , 2011, ATACCS.

[21]  Mickaël Causse,et al.  Improving situation awareness of a single human operator interacting with multiple unmanned vehicles: first results , 2010 .

[22]  Andri Riid,et al.  Transparent Fuzzy Systems and Modelling with Transparency Protection , 2000 .

[23]  G. Underwood,et al.  Driving Experience and the Functional Field of View , 1999, Perception.

[24]  D. Adam,et al.  Assessment of autonomic function in humans by heart rate spectral analysis. , 1985, The American journal of physiology.

[25]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[26]  Christopher D. Wickens,et al.  Eye-tracking and Individual Differences in off-Normal Event Detection when Flying with a Synthetic Vision System Display , 2004 .

[27]  E. Cox,et al.  Fuzzy fundamentals , 1992, IEEE Spectrum.

[28]  T. Jung,et al.  Task performance and eye activity: predicting behavior relating to cognitive workload. , 2007, Aviation, space, and environmental medicine.

[29]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Neural Networks with Combined Physiological and Performance Features , 1999 .

[30]  G. Parati,et al.  Spectral analysis of blood pressure and heart rate variability in evaluating cardiovascular regulation. A critical appraisal. , 1995, Hypertension.

[31]  Mickaël Causse,et al.  Mitigation of Conflicts with Automation , 2011, Hum. Factors.

[32]  S. Folkman [Personal control and stress and coping processes: a theoretical analysis]. , 1988, Kango kenkyu. The Japanese journal of nursing research.

[33]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[34]  S Plainis,et al.  Raised Visual Detection Thresholds Depend on the Level of Complexity of Cognitive Foveal Loading , 2001, Perception.

[35]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[36]  Glenn F. Wilson,et al.  Heart Rate Measures of Flight Test and Evaluation , 2002 .

[37]  Mickaël Causse,et al.  Reward and Uncertainty Favor Risky Decision-Making in Pilots: Evidence from Cardiovascular and Oculometric Measurements , 2011, Applied psychophysiology and biofeedback.

[38]  Linden J. Ball,et al.  An Eye Movement Analysis of Web Page Usability , 2002 .

[39]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[40]  Rachid Alami,et al.  Physiological and subjective evaluation of a human-robot object hand-over task. , 2011, Applied ergonomics.

[41]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[42]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[43]  Pandelis Perakakis,et al.  Cardiac defense: from attention to action. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  Mickaël Causse,et al.  Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task , 2010, Applied psychophysiology and biofeedback.

[45]  David A. Kobus,et al.  Overview of the DARPA Augmented Cognition Technical Integration Experiment , 2004, Int. J. Hum. Comput. Interact..

[46]  L. J. Williams Visual field tunneling in aviators induced by memory demands. , 1995, The Journal of general psychology.

[47]  A. Minassian,et al.  Pupillary dilation to simple vs. complex tasks and its relationship to thought disturbance in schizophrenia patients. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[48]  Steve Easterbrook,et al.  Handling conflict between domain descriptions with computer-supported negotiation , 1991 .

[49]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[50]  Andri Riid,et al.  TRANSPARENCY ANALYSIS OF FIRST-ORDER TAKAGI-SUGENO SYSTEMS , 2001 .