Cardiac Measures of Cognitive Workload: A Meta-Analysis

Objective: We aimed to provide an assessment of the impact of workload manipulations on various cardiac measurements. We further sought to determine the most effective measurement approaches of cognitive workload as well as quantify the conditions under which these measures are most effective for interpretation. Background: Cognitive workload affects human performance, particularly when load is relatively high (overload) or low (underload). Despite ongoing interest in assessing cognitive workload through cardiac measures, it is currently unclear which cardiac-based assessments best indicate cognitive workload. Although several quantitative studies and qualitative reviews have sought to provide guidance, no meta-analytic integration of cardiac assessment(s) of cognitive workload exists to date. Method: We used Morris and DeShon’s meta-analytic procedures to quantify the changes in cardiac measures due to task load conditions. Results: Sample-weighted Cohen’s d values suggest that several metrics of cardiac activity demonstrate sensitivity in response to cognitive workload manipulations. Heart rate variability measures show sensitivity to task load, conditions of event rate, and task duration. Authors of future work should seek to quantify the utility of leveraging multiple metrics to understand workload. Conclusion: Results suggest that assessment of cognitive workload can be done using various cardiac activity indicators. Further, given the number of valid and reliable measures available, researchers and practitioners should base their selection of a psychophysiological measure on the experimental and practical concerns inherent to their task/protocol. Applications: Findings bear implications for future assessment of cognitive workload within basic and applied settings. Future research should seek to validate conditions under which measurements are best interpreted, including but not limited to individual differences.

[1]  M. N. Levy.  Brief Reviews: Sympathetic-Parasympathetic Interactions in the Heart , 1971, Circulation research.

[2]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[3]  Daniel J. Barber,et al.  Augmenting Robot Behaviors Using Physiological Measures of Workload State , 2016, HCI.

[4]  Ronald S. Landis,et al.  Successfully Combining Meta-analysis and Structural Equation Modeling: Recommendations and Strategies , 2013 .

[5]  Winston Bennett,et al.  Conducting Meta-Analysis Using SAS , 2001 .

[6]  N A Stanton,et al.  What's skill got to do with it? Vehicle automation and driver mental workload , 2007, Ergonomics.

[7]  Tyler H. Shaw,et al.  Effects of sensory modality on cerebral blood flow velocity during vigilance , 2009, Neuroscience Letters.

[8]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[9]  Joachim Vogt,et al.  The Impact of Workload on Heart Rate and Blood Pressure in En-Route and Tower Air Traffic Control , 2006 .

[10]  Karel Brookhuis,et al.  Adaptation Longitudinal Driving Behavior, Mental Workload, and Psycho-Spacing Models in Fog , 2011 .

[11]  James L. Szalma,et al.  The future of neuroergonomics , 2003 .

[12]  J. Veltman,et al.  Indices of mental workload in a complex task environment. , 1993, Neuropsychobiology.

[13]  Judi E. See,et al.  Meta-analysis of the sensitivity decrement in vigilance. , 1995 .

[14]  D. J. Mascord,et al.  Behavioral and physiological indices of fatigue in a visual tracking task , 1992 .

[15]  D. Spodick,et al.  Duration of diastole versus cycle length as correlates of left ventricular ejection time. , 1976, British heart journal.

[16]  R. Wright,et al.  Mental fatigue influence on effort-related cardiovascular response: difficulty effects and extension across cognitive performance domains , 2007 .

[17]  Torbjörn Åkerstedt,et al.  The effects of asking for verbal ratings of sleepiness on sleepiness and its masking effects on performance , 2007, Clinical Neurophysiology.

[18]  Jens Steinbrink,et al.  Decoding Vigilance with NIRS , 2014, PloS one.

[19]  B. Abernethy,et al.  Attentional processes in skill learning and expert performance , 2007 .

[20]  Robert D. O'Donnell,et al.  A Conceptual Framework for Development of a Workload Assessment Methodology , 1982 .

[21]  P. Hancock,et al.  Noise effects on human performance: a meta-analytic synthesis. , 2011, Psychological bulletin.

[22]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[23]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[24]  S. Huffel,et al.  Instantaneous changes in heart rate regulation due to mental load in simulated office work , 2011, European Journal of Applied Physiology.

[25]  Glenn F. Wilson,et al.  Psychological and Psychophysiological Models of Pilot Performance for Systems Development and Mission Evaluation , 2002 .

[26]  F. Graham.  Normality of distributions and homogeneity of variance of heart rate and heart period samples. , 1978, Psychophysiology.

[27]  J. Pilcher,et al.  Decreased Cognitive/CNS Function in Young Adults at Risk for Hypertension: Effects of Sleep Deprivation , 2012, International journal of hypertension.

[28]  James J. Lindsay,et al.  Research in the Psychological Laboratory , 1999 .

[29]  K. Strimbu,et al.  What are biomarkers? , 2010, Current opinion in HIV and AIDS.

[30]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.

[31]  N. Anderson,et al.  Patterns of cardiovascular responses to stress as a function of race and parental hypertension in men. , 1989, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[32]  Ranjana K. Mehta,et al.  Neuroergonomics: a review of applications to physical and cognitive work , 2013, Front. Hum. Neurosci..

[33]  Guozhong Zheng,et al.  Experimental study on physiological and psychological effects of heat acclimatization in extreme hot , 2011 .

[34]  A. H. Roscoe,et al.  Heart rate as a psychophysiological measure for in-flight workload assessment. , 1993, Ergonomics.

[35]  A. Sherwood,et al.  Cardiovascular responses to behavioral stressors: laboratory-field generalization and inter-task consistency. , 1990, Journal of psychosomatic research.

[36]  James L. Szalma,et al.  A Meta-Analysis of Performance Response Under Thermal Stressors , 2007, Hum. Factors.

[37]  S. Svebak,et al.  The psychological significance of task-induced tonic changes in somatic and autonomic activity. , 1981, Psychophysiology.

[38]  F. Graham,et al.  Constraints on measuring heart rate and period sequentially through real and cardiac time. , 1978, Psychophysiology.

[39]  H. Lackner,et al.  Effects of Stimuli on Cardiovascular Reactivity Occurring at Regular Intervals During Mental Stress , 2010 .

[40]  R Rosenthal,et al.  Meta‐analysis: a review. , 1991, Psychosomatic medicine.

[41]  David L Neumann,et al.  Effect of varying levels of mental workload on startle eyeblink modulation , 2002, Ergonomics.

[42]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[43]  J. A. Veltman,et al.  A Comparative Study of Psychophysiological Reactions During Simulator and Real Flight , 2002 .

[44]  Staffan Nählinder,et al.  Mental Workload in Aircraft and Simulator During Basic Civil Aviation Training , 2009 .

[45]  Mickaël Causse,et al.  Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task , 2010, Applied psychophysiology and biofeedback.

[46]  J. Saul,et al.  Beat-to-Beat Variations of Heart Rate Reflect Modulation of Cardiac Autonomic Outflow , 1990 .

[47]  G. Wilson.  Applied use of cardiac and respiration measures: Practical considerations and precautions , 1992, Biological Psychology.

[48]  Dick de Waard,et al.  National culture moderates the influence of mental effort on subjective and cardiovascular measures , 2013, Ergonomics.

[49]  P. Hancock,et al.  A Dynamic Model of Stress and Sustained Attention , 1989, Human factors.

[50]  Huan Zhang,et al.  Improving pilot mental workload evaluation with combined measures. , 2014, Bio-medical materials and engineering.

[51]  R G EASON,et al.  Performance and Physiological Indicants of Activation in a Vigilance Situation , 1965, Perceptual and motor skills.

[52]  Kelley S. Parsons,et al.  The abbreviated vigilance task and cerebral hemodynamics , 2007, Journal of clinical and experimental neuropsychology.

[53]  S. Melamed,et al.  Variation in the ambulatory blood pressure response to daily work load--the moderating role of job control. , 1998, Scandinavian journal of work, environment & health.

[54]  Sang D. Choi,et al.  An investigation of myocardial aerobic capacity as a measure of both physical and cognitive workloads , 2005 .

[55]  Jan B. F. van Erp,et al.  Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. , 2014, International Journal of Psychophysiology.

[56]  Bryan Reimer,et al.  The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation , 2011, Ergonomics.

[57]  Michael Richter,et al.  Ego involvement and effort: cardiovascular, electrodermal, and performance effects. , 2005, Psychophysiology.

[58]  D. de Waard,et al.  Short-term cardiovascular responses to changing task demands. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[59]  N. Anderson,et al.  Racial differences in cardiovascular reactivity to mental arithmetic. , 1988, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[60]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[61]  Phillip D Tomporowski,et al.  Mental engagement during cognitive and psychomotor tasks: Effects of task type, processing demands, and practice. , 2016, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[62]  B. Strange,et al.  Alternative neural circuitry that might be impaired in the development of Alzheimer disease , 2015, Front. Neurosci..

[63]  Hongliu Yu,et al.  Influence of computer work under time pressure on cardiac activity , 2015, Comput. Biol. Medicine.

[64]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[65]  P. Hancock,et al.  Cerebral lateralization of vigilance: A function of task difficulty , 2010, Neuropsychologia.

[66]  R W Backs,et al.  Psychophysiological aspects of selective and divided attention during continuous manual tracking. , 1997, Acta psychologica.

[67]  Dick de Waard,et al.  The consequences of an increase in heavy goods vehicles for passenger car drivers' mental workload and behaviour: a simulator study. , 2008, Accident; analysis and prevention.

[68]  Elke Vlemincx,et al.  Individual differences in cardiorespiratory measures of mental workload: An investigation of negative affectivity and cognitive avoidant coping in pilot candidates. , 2017, Applied ergonomics.

[69]  Raja Parasuraman,et al.  Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload , 2005, Hum. Factors.

[70]  James L. Szalma,et al.  Individual differences in performance, workload, and stress in sustained attention: Optimism and pessimism , 2009 .

[71]  Peter Nickel,et al.  Sensitivity and Diagnosticity of the 0.1-Hz Component of Heart Rate Variability as an Indicator of Mental Workload , 2003, Hum. Factors.

[72]  Alan H. Roscoe.  Heart Rate as an In-Flight Measure of Pilot Workload , 1982 .

[73]  Danny D. Mann,et al.  Heart Rate Variability in Response to Task Automation in Agricultural Semi-Autonomous Vehicles , 2014 .

[74]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[75]  R W Backs,et al.  Metabolic and cardiorespiratory measures of mental effort: the effects of level of difficulty in a working memory task. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[76]  Ralph H. Cullen,et al.  Comparing Different Measures of Overall Workload in a Multimodal Postural/Auditory Dual-Task Environment , 2016 .

[77]  Xu Xu,et al.  Analysis on Mental Stress/Workload Using Heart Rate Variability and Galvanic Skin Response during Design Process , 2014 .

[78]  Jarle Eid,et al.  Who benefits from simulator training: Personality and heart rate variability in relation to situation awareness during navigation training , 2012, Comput. Hum. Behav..

[79]  L. Keltikangas-Järvinen,et al.  Vital exhaustion, temperament, and cardiac reactivity in task-induced stress , 2004, Biological Psychology.

[80]  L. Luecken,et al.  Handbook of Physiological Research Methods in Health Psychology , 2007 .

[81]  U. Lundberg,et al.  Blood pressure in healthy men and women under laboratory and naturalistic conditions. , 1990, Journal of psychosomatic research.

[82]  Mao-Jiun J. Wang,et al.  Effective Indices for Monitoring Mental Workload While Performing Multiple Tasks , 2015, Perceptual and motor skills.

[83]  Richard P. DeShon,et al.  Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. , 2002, Psychological methods.

[84]  D. Carroll,et al.  Haemodynamic adjustments to mental stress in normotensives and subjects with mildly elevated blood pressure. , 1991, Psychophysiology.

[85]  Richard W. Backs,et al.  THE USE OF AUTONOMIC COMPONENTS TO IMPROVE CARDIOVASCULAR ASSESSMENT OF MENTAL WORKLOAD IN FLIGHT SIMULATION , 1999 .

[86]  J. Fahrenberg,et al.  Is elevated blood pressure level associated with higher cardiovascular responsiveness in laboratory tasks and with response specificity? , 1995, Psychophysiology.

[87]  N. Anderson,et al.  Parental history of hypertension and cardiovascular responses to behavioral stress in young black women. , 1987, Journal of psychosomatic research.

[88]  P. Hancock,et al.  How cognitive load affects duration judgments: A meta-analytic review. , 2010, Acta psychologica.

[89]  Craig Johnson,et al.  Development of Quantitative Specifications for Simulating the Stress Environment , 1992 .

[90]  P. Obrist,et al.  Cardiac deceleration and reaction time: an evaluation of two hypotheses. , 1970, Psychophysiology.

[91]  S A Metalis.  Heart Period as a Useful Index of Pilot Workload in Commercial Transport Aircraft , 1991 .

[92]  Glenn F. Wilson,et al.  Workload assessment in multi-task environments , 2020 .

[93]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[94]  W. Boucsein,et al.  Standardized task strain and system response times in human-computer interaction. , 1995, Ergonomics.

[95]  Ellen M. Whitener,et al.  Confusion of confidence intervals and credibility intervals in meta-analysis. , 1990 .

[96]  James L. Szalma,et al.  Comparison of Measures Used to Assess the Workload of Monitoring an Unmanned System in a Simulation Mission , 2015 .

[97]  A. Stuiver,et al.  Cardiovascular state changes in simulated work environments , 2014, Front. Neurosci..

[98]  Sarah Sharples,et al.  Physiological Parameter Response to Variation of Mental Workload , 2017, Hum. Factors.

[99]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[100]  M. Wetherell,et al.  The multitasking framework: the effects of increasing workload on acute psychobiological stress reactivity. , 2014, Stress and health : journal of the International Society for the Investigation of Stress.

[101]  Ingmar Ehrenpfordt,et al.  Workload of younger and elderly drivers in different infrastructural situations , 2014 .

[102]  Diane M. Tomasic,et al.  Meta-Analysis: A Comparison of Approaches , 2005 .

[103]  Herman Aguinis,et al.  Best-Practice Recommendations for Defining, Identifying, and Handling Outliers , 2013 .

[104]  P. Ackerman,et al.  Cognitive, perceptual-speed, and psychomotor determinants of individual differences during skill acquisition. , 2000, Journal of experimental psychology. Applied.

[105]  W. Verwey,et al.  Detecting short periods of elevated workload: A comparison of nine workload assessment techniques , 1996 .

[106]  Raja Parasuraman,et al.  EFFECTS OF MANUAL AND AUTOPILOT CONTROL ON MENTAL WORKLOAD AND VIGILANCE DURING SIMULATED GENERAL AVIATION FLIGHT , 1999 .

[107]  D. Bunce,et al.  The moderating influence of physical fitness on age gradients in vigilance and serial choice responding tasks. , 1996, Psychology and aging.