Towards measurement of brain function in operational environments

In operational environments that demand sustained vigilance or that involve multiple tasks competing for limited attentional resources, continuous monitoring of the mental state of the operator could decrease the potential for serious errors and provide valuable information concerning the ergonomics of the tasks being performed. There is widespread discussion and appreciation of the basic feasibility of utilizing neurophysiological measurements to derive accurate, reliable, rapid and unobtrusive assessments of mental state. However, progress in transitioning this idea into practical applications has been impeded by the fact that at present no convenient, inexpensive and effective means exists to derive a meaningful index of brain activity outside of laboratory settings. In this paper, we review some recent advances in recording technology and signal processing methods that will help overcome this limitation. For example, rapid progress is being made in the engineering of recording systems that are small, rugged, portable and easy-to-use, and thus suitable for deployment in operational environments. Progress is also being made in the development of signal processing algorithms for detecting and correcting recording artifacts and for increasing the amount of useful information that can be derived from brain signals. Finally, results from basic research studies suggest that accurate and reliable inferences about the mental load and alertness of an individual can be derived from neurophysiological measures in a practical fashion. These research and engineering successes suggest that it is reasonable to expect that in the near term a basic enabling technology will be deployed that will permit routine measurement of brain function in operational environments.

[1]  A. Gevins,et al.  Spatiotemporal dynamics of component processes in human working memory. , 1993, Electroencephalography and clinical neurophysiology.

[2]  E Callaway,et al.  Coupling between Cortical Potentials from Different Areas , 1974, Science.

[3]  H Petsche,et al.  Thinking with images or thinking with language: a pilot EEG probability mapping study. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  A Gevins,et al.  Subdural grid recordings of distributed neocortical networks involved with somatosensory discrimination. , 1994, Electroencephalography and clinical neurophysiology.

[5]  A Gevins,et al.  High resolution EEG: 124-channel recording, spatial deblurring and MRI integration methods. , 1994, Electroencephalography and clinical neurophysiology.

[6]  T. Bullock,et al.  Lateral coherence of the electrocorticogram: a new measure of brain synchrony. , 1989, Electroencephalography and clinical neurophysiology.

[7]  M. N. Livanov.  Spatial organization of cerebral processes , 1977 .

[8]  R M White,et al.  Event-related covariances of a bimanual visuomotor task. , 1987, Electroencephalography and clinical neurophysiology. Supplement.

[9]  A. Kramer,et al.  Toward a Psychophysiological Assessment of Dynamic Changes in Mental Workload , 1994, Human factors.

[10]  E. Michael Kahn,et al.  Topographic maps of brain electrical activity-pitfalls and precautions , 1988, Biological Psychiatry.

[11]  H Pratt,et al.  Brain potentials in a memory-scanning task. I. Modality and task effects on potentials to the probes. , 1989, Electroencephalography and clinical neurophysiology.

[12]  B. V. Veen,et al.  Localization of intra-cerebral sources of electrical activity via linearly constrained minimum variance spatial filtering , 1992, [1992] IEEE Sixth SP Workshop on Statistical Signal and Array Processing.

[13]  W. R. Adey,et al.  Computer techniques in correlation and spectral analyses of cerebral slow waves during discriminative behavior. , 1961, Experimental neurology.

[14]  M. Matousek,et al.  A method for assessing alertness fluctuations from EEG spectra. , 1983, Electroencephalography and clinical neurophysiology.

[15]  E Donchin,et al.  A metric for thought: a comparison of P300 latency and reaction time. , 1981, Science.

[16]  L. Johnson,et al.  Discrimination among states of consciousness using EEG spectra. , 1969, Psychophysiology.

[17]  J. Le,et al.  Method to reduce blur distortion from EEG's using a realistic head model , 1993, IEEE Transactions on Biomedical Engineering.

[18]  S. Bressler,et al.  Shadows of thought: shifting lateralization of human brain electrical patterns during brief visuomotor task. , 1983, Science.

[19]  D Kleinman,et al.  Neural readout from memory. , 1973, Journal of neurophysiology.

[20]  A S Gevins,et al.  Human neuroelectric patterns predict performance accuracy. , 1987, Science.

[21]  W. R. Adey,et al.  Discriminating among states of consciousness by EEG measurements. A study of four subjects. , 1967, Electroencephalography and clinical neurophysiology.

[22]  S. Sternberg.  High-Speed Scanning in Human Memory , 1966, Science.

[23]  H. L. Andrews,et al.  ELECTRO-ENCEPHALOGRAPHY: III. NORMAL DIFFERENTIATION OF OCCIPITAL AND PRECENTRAL REGIONS IN MAN , 1938 .

[24]  A. D. Fisk,et al.  The effects of practice and task structure on components of the event-related brain potential. , 1986, Psychophysiology.

[25]  W. van Winsum,et al.  Event-related desynchronization and P300. , 1987, Psychophysiology.

[26]  R. Cooper,et al.  Brain slow potential and ERP changes associated with operator load in a visual tracking task. , 1988, Electroencephalography and clinical neurophysiology.

[27]  Glenn F. Wilson,et al.  Fighter Pilot Performance during Airborne and Simulator Missions: Physiological Comparisons, , 1988 .

[28]  J R Smith,et al.  EEG sleep stage scoring by an automatic hybrid system. , 1971, Electroencephalography and clinical neurophysiology.

[29]  A S Gevins,et al.  Electrical potentials in human brain during cognition: new method reveals dynamic patterns of correlation. , 1981, Science.

[30]  A S Gevins,et al.  Computer rejection of EEG artifact. II. Contamination by drowsiness. , 1977, Electroencephalography and clinical neurophysiology.

[31]  M. Scherg.  Fundamentals if dipole source potential analysis , 1990 .

[32]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[33]  G. Pfurtscheller.  Handbook of electroencephalography and clinical neurophysiology , 1978 .

[34]  Raja Parasuraman,et al.  Event-related brain potentials and human factors research. , 1990 .

[35]  W.B. Albery,et al.  Non-invasive sensing systems for acceleration-induced physiologic changes , 1991, IEEE Engineering in Medicine and Biology Magazine.

[36]  Kara D. Federmeier,et al.  Event-related brain potentials. , 1990 .

[37]  A S Gevins,et al.  On-line computer rejection of EEG artifact. , 1977, Electroencephalography and clinical neurophysiology.

[38]  J.P. Cammarota.  Integrated systems for detecting and managing acceleration-induced loss of consciousness , 1991, IEEE Engineering in Medicine and Biology Magazine.

[39]  G F Wilson,et al.  The use of cardiac and eye blink measures to determine flight segment in F4 crews. , 1991, Aviation, space, and environmental medicine.

[40]  J. Nedzelski.  Advances in Audiology , 1985 .

[41]  M Salinsky,et al.  Alertness and Attention: Basic Science and Electrophysiologic Correlates , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[42]  R. Leahy,et al.  Multiple Dipole Modeling and Localization from , 1992 .

[43]  S. Bressler,et al.  Event-related covariances during a bimanual visuomotor task. II. Preparation and feedback. , 1989, Electroencephalography and clinical neurophysiology.

[44]  J. Doyle,et al.  EEG patterns during 'cognitive' tasks. II. Analysis of controlled tasks. , 1979, Electroencephalography and clinical neurophysiology.

[45]  A S Gevins,et al.  Effects of prolonged mental work on functional brain topography. , 1990, Electroencephalography and clinical neurophysiology.

[46]  Shunsuke Ohtahara,et al.  Topographic mapping of brain electrical activity, FH Duffy (Ed.). Butterworths, Boston · London · Durban · Singapore · Sydney · Toronto · Wellington (1986), 428 pp , 1987 .

[47]  Nelson Morgan,et al.  Applications of neural-network (NN) signal processing in brain research , 1988, IEEE Trans. Acoust. Speech Signal Process..

[48]  Ross Pigeau,et al.  The Effect of Endogenous Alpha on Hemispheric Asymmetries and the Relationship of Frontal Theta to Sustained Attention , 1988 .

[49]  E. Sirevaag,et al.  A Psychophysiological Assessment of Operator Workload During Simulated Flight Missions , 1987, Human factors.

[50]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[51]  B. Hjorth.  An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[52]  V. Menon,et al.  Local estimate of surface Laplacian derivation on a realistically shaped scalp surface and its performance on noisy data. , 1994, Electroencephalography and clinical neurophysiology.

[53]  M. Manosevitz,et al.  High-Speed Scanning in Human Memory , 2022 .

[54]  S. Bressler,et al.  Event-related covariances during a bimanual visuomotor task. I. Methods and analysis of stimulus- and response-locked data. , 1989, Electroencephalography and clinical neurophysiology.

[55]  Thomas M. Longridge,et al.  Physiological Assessment of Aircraft Pilot Workload in Simulated Landing and Simulated Hostile Threat Environments , 1984 .

[56]  A S Gevins,et al.  EEG patterns during 'cognitive' tasks. I. Methodology and analysis of complex behaviors. , 1979, Electroencephalography and clinical neurophysiology.

[57]  G F Wilson,et al.  Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. , 1994, Aviation, space, and environmental medicine.

[58]  J. C. Smith,et al.  Electroencephalographic Correlates of Pilot Performance: Simulation and In-Flight Studies , 1988 .

[59]  A. Belyavin,et al.  Changes in electrical activity of the brain with vigilance. , 1987, Electroencephalography and clinical neurophysiology.

[60]  C D Wickens,et al.  The Event-Related Brain Potential as an Index of Display-Monitoring Workload , 1980, Human factors.

[61]  J. Webster.  Encyclopedia of Medical Devices and Instrumentation , 1988 .