Adaptive Task Support Based on Dynamic Human State Estimation

Adaptive systems that provide task support to the human operator when needed can be a solution to the problems of traditional automation in complex dynamic systems. One way of initiating support is automatically: let the technical system assess operator functional state based on continuous monitored physiological, performance, and environmental factors and let it decide whether support is needed. For this concept to work in practice several human-related problems need to be solved. This is the focus of the REFLECT project which aims at developing adaptive systems that really support the human operator. Some of the accumulated knowledge gained in this and preceding projects are addressed in this paper. In addition, a design cycle for adaptive systems is presented that provides a functional overview of the design issues to be solved.

[1]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[2]  G. R. J. Hockey.  Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[3]  Christian D. Schunn,et al.  Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction , 2002, Proc. IEEE.

[4]  L. Mulder,et al.  Introducing a baroreflex model for studying cardiovascular effects of mental workload. , 2004, Psychophysiology.

[5]  A. Kramer,et al.  Theoretical and methodological issues in psychophysiological research , 1998 .

[6]  D de Waard,et al.  Cardiovascular state changes during performance of a simulated ambulance dispatchers' task: potential use for adaptive support. , 2009, Applied ergonomics.

[7]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[8]  Marika Hoedemaeker,et al.  Behavioural adaptation to driving with an adaptive cruise control (ACC) , 1998 .

[9]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[10]  Frank Flemisch,et al.  Automation spectrum, inner / outer compatibility and other potentially useful human factors concepts for assistance and automation , 2008 .

[11]  B. Rouse William,et al.  Adaptive Aiding for Human/Computer Control , 1988 .

[12]  Mark W. Scerbo,et al.  Adaptive Automation , 2006, Neuroergonomics.

[13]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[14]  B. Cain.  A Review of the Mental Workload Literature , 2007 .

[15]  Samantha L Comte.  New systems: new behaviour? , 2000 .

[16]  Lawrence J. Prinzel,et al.  Research on Hazardous States of Awareness and Physiological Factors in Aerospace Operations , 2002 .

[17]  Dick de Waard,et al.  Adaptive driving support: Information about the vehicle’s lateral position , 2010 .

[18]  Jennifer A. Healey,et al.  Affect detection in the real world: Recording and processing physiological signals , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[19]  John E. Deaton,et al.  Theory and Design of Adaptive Automation in Aviation Systems , 1992 .

[20]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[21]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[22]  L. Mulder.  Measurement and analysis methods of heart rate and respiration for use in applied environments , 1992, Biological Psychology.

[23]  Renwick E. Curry,et al.  Flight-deck automation: promises and problems , 1980 .

[24]  Karel Brookhuis,et al.  Behavioural adaptation in response to ADAS , 2004 .

[25]  Earl L. Wiener,et al.  Human factors of advanced technology (glass cockpit) transport aircraft , 1989 .

[26]  Marika Hoedemaeker,et al.  Driver behavior in an emergency situation in the Automated Highway System , 1999 .

[27]  P. J. Hoogeboom,et al.  Physiological indices for the estimation of momentary changes in cognitive workload and mental state , 2004 .

[28]  A.W.K. Gaillard,et al.  Operator Functional State: The Assessment and Prediction of Human Performance Degradation in Complex Tasks , 2003 .

[29]  Senior Member,et al.  Knowing when to assist : developmental issues in lifelong assistive robotics , 2022 .

[30]  D. de Waard,et al.  Assessment of drivers' workload: performance, subjective and physiological indices , 2001 .

[31]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .