Neuroadaptive technologies: Applying neuroergonomics to the design of advanced interfaces

This article describes an emerging approach to the design of human-machine systems referred to as 'neuroadaptive interface technology'. A neuroadaptive interface is an ensemble of computer-based displays and controls whose functional characteristics change in response to meaningful variations in the user's cognitive and/or emotional states. Variations in these states are indexed by corresponding central nervous system activity, which control functionally adaptive modifications to the interface. The purpose of these modifications is to promote safer and more effective human-machine system performance. While fully functional adaptive interfaces of this type do not currently exist, there are promising steps being taken toward their development, and great potential value in doing so--value that corresponds directly to and benefits from a neuroergonomic approach to systems development. Specifically, it is argued that the development of these systems will greatly enhance overall human-machine system performance by providing more symmetrical communications between users and computer-based systems than currently exist. Furthermore, their development will promote a greater understanding of the relationship between nervous system activity and human behaviour (specifically work-related behaviour), and as such may serve as an exemplary paradigm for neuroergonomics. A number of current research and development areas related to neuroadaptive interface design are discussed, and challenges associated with the development of this technology are described.

[1]  E. Tenner.  Why things bite back : technology and the revenge of unintended consequences , 1996 .

[2]  S. Bressler.  Understanding Cognition Through Large-Scale Cortical Networks , 2002 .

[3]  Joseph E LeDoux,et al.  Information cascade from primary auditory cortex to the amygdala: corticocortical and corticoamygdaloid projections of temporal cortex in the rat. , 1993, Cerebral cortex.

[4]  Raja Parasuraman,et al.  Neuroergonomics: Research and practice , 2003 .

[5]  John M. Flach,et al.  Cognitive Engineering: Designing for Situation Awareness , 2000 .

[6]  R. B. Knapp,et al.  Controlling computers with neural signals. , 1996, Scientific American.

[7]  Rosalind W. Picard.  Toward computers that recognize and respond to user emotion , 2000, IBM Syst. J..

[8]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  Rosalind W. Picard.  Affective Computing , 1997 .

[10]  John M Hoffman,et al.  Ecstasy and Agony: Activation of the Human Amygdala in Positive and Negative Emotion , 2002, Psychological science.

[11]  Kevin B. Bennett,et al.  A Theoretical Analysis and Preliminary Investigation of Dynamically Adaptive Interfaces , 2001 .

[12]  G Pfurtscheller,et al.  Timing of EEG-based cursor control. , 1997, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[13]  F. Freeman,et al.  Evaluation of a Psychophysiologically Controlled Adaptive Automation System, Using Performance on a Tracking Task , 2000, Applied psychophysiology and biofeedback.

[14]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  R. Adolphs,et al.  The human amygdala in social judgement , 2000 .

[16]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[17]  S P Levine,et al.  A direct brain interface based on event-related potentials. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Mark W. Scerbo,et al.  A brain-based system for adaptive automation , 2003 .

[19]  Michael W. Haas,et al.  Current Research in Adaptive Interfaces , 2001 .

[20]  T. Åkerstedt,et al.  Extreme sleepiness: quantification of EOG and spectral EEG parameters. , 1988, The International journal of neuroscience.

[21]  Marshall B. Jones,et al.  Isoperformance Curves in Applied Psychology , 1996, Hum. Factors.

[22]  F. Freeman,et al.  A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation , 2000, The International journal of aviation psychology.

[23]  R. Adolphs,et al.  The human amygdala in social judgment , 1998, Nature.

[24]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[25]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[26]  R W Backs,et al.  Psychophysiological Measures of Workload during Continuous Manual Performance , 1994, Human factors.

[27]  Greg L. Zacharias,et al.  Adaptive Pilot–Vehicle Interfaces for the Tactical Air Environment , 2003 .

[28]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[29]  A. Ohman,et al.  Automaticity and the Amygdala: Nonconscious Responses to Emotional Faces , 2002 .

[30]  Lawrence J. Prinzel,et al.  A Bio-Cybernetic System for Adaptive Automation , 1995 .

[31]  J. M. Peter,et al.  The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology , 2001 .

[32]  F. Freeman,et al.  Evaluation of an adaptive automation system using three EEG indices with a visual tracking task , 1999, Biological Psychology.

[33]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.