Formalising Human Mental Workload as a Defeasible Computational Concept

Human mental workload has gained importance, in the last few decades, as a fundamental design concept in human-computer interaction. It can be intuitively defined as the amount of mental work necessary for a person to complete a task over a given period of time. For people interacting with interfaces, computers and technological devices in general, the construct plays an important role. At a low level, while processing information, often people feel annoyed and frustrated; at higher level, mental workload is critical and dangerous as it leads to confusion, it decreases the performance of information processing and it increases the chances of errors and mistakes. It is extensively documented that either mental overload or underload negatively affect performance. Hence, designers and practitioners who are ultimately interested in system or human performance need answers about operator workload at all stages of system design and operation. At an early system design phase, designers require some explicit model to predict the mental workload imposed by their technologies on end-users so that alternative system designs can be evaluated. However, human mental workload is a multifaceted and complex construct mainly applied in cognitive sciences. A plethora of ad-hoc definitions can be found in the literature. Generally, it is not an elementary property, rather it emerges from the interaction between the requirements of a task, the circumstances under which it is performed and the skills, behaviours and perceptions of the operator. Although measuring mental workload has advantages in interaction and interface design, its formalisation as an operational and computational construct has not sufficiently been addressed. Many researchers agree that too many ad-hoc models are present in the literature and that they are applied subjectively by mental workload designers thereby limiting their application in different contexts and making comparison across different models difficult. This thesis introduces a novel computational framework for representing and assessing human mental workload based on defeasible reasoning. The starting point is the investigation of the nature of human mental workload that appears to be a defeasible phenomenon. A defeasible concept is a concept built upon a set of arguments that can be defeated by adding additional arguments. The word ‘defeasible’ is inherited from defeasible reasoning, a form of reasoning built upon reasons that can be defeated. It is also known as non-monotonic reasoning because of the technical property (non-monotonicity) of the logical formalisms that are aimed at modelling defeasible reasoning activity. Here, a conclusion or claim, derived from the application of previous knowledge, can be retracted in the light of new evidence. Formally, state-of-the-art defeasible reasoning models are implemented employing argumentation theory, a multi-disciplinary paradigm that incorporates elements of philosophy, psychology and sociology. It systematically studies how arguments can be built, sustained or discarded in a reasoning process, and it investigates the validity of their conclusions.

[1]  Pamela S. Tsang,et al.  Mental Workload and Situation Awareness , 2006 .

[2]  Pietro Baroni,et al.  Semantics of Abstract Argument Systems , 2009, Argumentation in Artificial Intelligence.

[3]  Mark H. Chignell,et al.  Mental workload dynamics in adaptive interface design , 1988, IEEE Trans. Syst. Man Cybern..

[4]  Eric N. Wiebe,et al.  An examination of two mental workload measurement approaches to understanding multimedia learning , 2010, Comput. Hum. Behav..

[5]  R. Goonetilleke,et al.  Simplified subjective workload assessment technique , 2001, Ergonomics.

[6]  Luca Longo,et al.  A Computational Analysis of Cognitive Effort , 2010, ACIIDS.

[7]  Gregg C. Vanderheiden,et al.  Mental workload during brain–computer interface training , 2012, Ergonomics.

[8]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[9]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[10]  Trevor J. M. Bench-Capon Persuasion in Practical Argument Using Value-based Argumentation Frameworks , 2003, J. Log. Comput..

[11]  Henry Prakken,et al.  Logics for Defeasible Argumentation , 2001 .

[12]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[13]  W. Wierwille Important Remaining Issues in Mental Workload Estimation , 1988 .

[14]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[15]  Paul-Amaury Matt,et al.  Combining statistics and arguments to compute trust , 2010, AAMAS.

[16]  Frank Dignum,et al.  Argumentation and Persuasion in the Cognitive Coherence Theory , 2006, COMMA.

[17]  Asit Dey,et al.  Sensitivity and diagnosticity of NASA-TLX and simplified SWAT to assess the mental workload associated with operating an agricultural sprayer , 2010, Ergonomics.

[18]  Diane K Mitchell,et al.  Mental Workload and ARL Workload Modeling Tools. , 2000 .

[19]  Waldemar Karwowski,et al.  Mental Workload Measurement , 2006 .

[20]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[21]  G. Salvendy,et al.  Job enrichment and mental workload in computer-based work: Implications for adaptive job design , 1999 .

[22]  Seung Ki Moon,et al.  Considering Context: The Role of Mental Workload and Operator Control in Users' Perceptions of Usability , 2012, Int. J. Hum. Comput. Interact..

[23]  Sally A. Seven,et al.  Selecting Performance Measures: "Objective" versus "Subjective" Measurement , 1992 .

[24]  C. Hershey,et al.  Measuring Physician Mental Workload: Reliability and Validity Assessment of a Brief Instrument , 1992, Medical care.

[25]  Luca Longo,et al.  Argumentation theory in health care , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[26]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[27]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[28]  Bryan Reimer,et al.  The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation , 2011, Ergonomics.

[29]  Luca Longo,et al.  Cognitive Effort for Multi-agent Systems , 2010, Brain Informatics.

[30]  E. Sirevaag,et al.  A Psychophysiological Assessment of Operator Workload During Simulated Flight Missions , 1987, Human factors.

[31]  Paolo Mancarella,et al.  Computing ideal sceptical argumentation , 2007, Artif. Intell..

[32]  Paul-Amaury Matt,et al.  A Game-Theoretic Measure of Argument Strength for Abstract Argumentation , 2008, JELIA.

[33]  Aidan Byrne,et al.  Measurement of Mental Workload in Clinical Medicine: A Review Study , 2011, Anesthesiology and pain medicine.

[34]  Daniel Baldauf,et al.  Time perception as a workload measure in simulated car driving. , 2009, Applied ergonomics.

[35]  Sheue-Ling Hwang,et al.  Application of queueing theory to quantify information workload in supervisory control systems , 1989 .

[36]  John G. Casali,et al.  A Validated Rating Scale for Global Mental Workload Measurement Applications , 1983 .

[37]  Ari Widyanti,et al.  Cultural influences on the measurement of subjective mental workload , 2011 .

[38]  Daniel Gopher,et al.  Workload: An examination of the concept. , 1986 .

[39]  G. Young,et al.  Assessment of workload using NASA Task Load Index in perianesthesia nursing. , 2008, Journal of perianesthesia nursing : official journal of the American Society of PeriAnesthesia Nurses.

[40]  Sanjay Modgil,et al.  An Abstract Theory of Argumentation That Accommodates Defeasible Reasoning About Preferences , 2007, ECSQARU.

[41]  Henry Prakken,et al.  Argument-Based Extended Logic Programming with Defeasible Priorities , 1997, J. Appl. Non Class. Logics.

[42]  Mikolaj Podlaszewski,et al.  A Labelling-Based Justification Status of Arguments , 2010, NMR 2010.

[43]  Jacek Gwizdka,et al.  Distribution of cognitive load in Web search , 2010, J. Assoc. Inf. Sci. Technol..

[44]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[45]  John Fox,et al.  A LOGIC OF ARGUMENTATION FOR REASONING UNDER UNCERTAINTY , 1995, Comput. Intell..

[46]  F Nachreiner,et al.  Standards for ergonomics principles relating to the design of work systems and to mental workload. , 1995, Applied ergonomics.

[47]  Luca Longo,et al.  A novel methodology for evaluating user interfaces in health care , 2011, 2011 24th International Symposium on Computer-Based Medical Systems (CBMS).

[48]  J. Concato,et al.  A simulation study of the number of events per variable in logistic regression analysis. , 1996, Journal of clinical epidemiology.

[49]  Phan Minh Dung,et al.  An Abstract, Argumentation-Theoretic Approach to Default Reasoning , 1997, Artif. Intell..

[50]  D. Kahneman,et al.  Attention and Effort , 1973 .

[51]  Anthony Jameson,et al.  Assessing Cognitive Load in Adaptive Hypermedia Systems: Physiological and Behavioral Methods , 2004, AH.

[52]  Luca Longo,et al.  Formalising human mental workload as non-monotonic concept for adaptive and personalised web-design , 2012, UMAP.

[53]  Francesca Toni,et al.  Argumentative agents , 2010, Proceedings of the International Multiconference on Computer Science and Information Technology.

[54]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[55]  Daiana Martins Vitório,et al.  Analysis of mental workload of electrical power plant operators of control and operation centers. , 2012, Work.

[56]  G. Salvendy,et al.  Review and reappraisal of modelling and predicting mental workload in single- and multi-task environments , 2000 .

[57]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[58]  Christophe Labreuche,et al.  Argumentation Framework with Fuzzy Preference Relations , 2010, IPMU.

[59]  Paul J. Krause,et al.  Argumentation as a General Framework for Uncertain Reasoning , 1993, UAI.

[60]  John Annett,et al.  Subjective rating scales in ergonomics: a reply , 2002 .

[61]  Yung-Tsan Jou,et al.  Evaluation of mental workload in automation design for a main control room task , 2009, 2009 International Conference on Networking, Sensing and Control.

[62]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[63]  Luca Longo,et al.  Argumentation Theory for Decision Support in Health-Care: A Comparison with Machine Learning , 2013, Brain and Health Informatics.

[64]  Gerhard Tröster,et al.  Monitoring of mental workload levels during an everyday life office-work scenario , 2013, Personal and Ubiquitous Computing.

[65]  J. Farris CONJECTURES AND REFUTATIONS , 1995, Cladistics : the international journal of the Willi Hennig Society.

[66]  O Quirin,et al.  A Measure of Physician Mental Work Load in Internal Medicine Ambulatory Care Clinics , 1990, Medical care.

[67]  Mansour Rahimi,et al.  Evaluation of 16 Measures of Mental Workload using a Simulated Flight Task Emphasizing Mediational Activity , 1985 .

[68]  Chris Reed,et al.  Argumentation Schemes in Argument-as-Process and Argument-as-Product , 2003 .

[69]  P. Tsang,et al.  Diagnosticity and multidimensional subjective workload ratings. , 1996, Ergonomics.

[70]  Silvia Heinz,et al.  Cognitive Load in eCommerce Applications - Measurement and Effects on User Satisfaction , 2009, Adv. Hum. Comput. Interact..

[71]  Daniel P. J. Bruneau,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[72]  Barry H. Kantowitz,et al.  Mental Workload , 2020, Encyclopedia of Behavioral Medicine.

[73]  Martine De Cock,et al.  Fuzzy Argumentation Frameworks , 2008 .

[74]  Gavriel Salvendy,et al.  Prediction of Mental Workload in Single and Multiple Tasks Environments , 2000 .

[75]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[76]  Sheue-Ling Hwang,et al.  A Mental Workload Predicator Model for the Design of Pre Alarm Systems , 2007, HCI.

[77]  Trevor J. M. Bench-Capon,et al.  Argumentation in artificial intelligence , 2007, Artif. Intell..

[78]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[79]  A. Byrne,et al.  A novel method of measuring the mental workload of anaesthetists during simulated practice. , 2009, British journal of anaesthesia.

[80]  Patrice D. Tremoulet,et al.  Workload-Based Assessment of a User Interface Design , 2009, HCI.

[81]  Ameersing Luximon,et al.  Subjective mental workload measures , 2005 .

[82]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[83]  Graham Wilson,et al.  Psychophysiological assessment of workload in multi-task environments , 2020 .

[84]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[85]  Francesca Toni,et al.  Assumption-Based Argumentation for Closed and Consistent Defeasible Reasoning , 2007, JSAI.

[86]  Trevor J. M. Bench-Capon,et al.  Computational Representation of Practical Argument , 2006, Synthese.

[87]  Sanjay Modgil,et al.  Reasoning about preferences in argumentation frameworks , 2009, Artif. Intell..

[88]  Wendy Macdonald Train controller interface design: factors influencing mental workload , 1999 .

[89]  F. Grasso Towards a Framework for Rhetorical Argumentation , 2002 .

[90]  Luca Longo,et al.  Human-Computer Interaction and Human Mental Workload: Assessing Cognitive Engagement in the World Wide Web , 2011, INTERACT.

[91]  Nir Oren,et al.  Probabilistic Argumentation Frameworks , 2011, TAFA.

[92]  W. Verwey,et al.  Detecting short periods of elevated workload: A comparison of nine workload assessment techniques , 1996 .

[93]  N. Meshkati,et al.  The Effects of Individual Differences in Information Processing Behavior on Experiencing Mental Workload and Perceived Task Difficulty: A Preliminary Experimental Investigation , 1988 .

[94]  S. Fairclough,et al.  Psychophysiological measures of workload and stress , 1993 .

[95]  Henry Prakken,et al.  An abstract framework for argumentation with structured arguments , 2010, Argument Comput..

[96]  Diane L. Damos,et al.  Individual Differences in Subjective Estimates of Workload , 1988 .

[97]  Dominik Aronsky,et al.  Emergency physicians' behaviors and workload in the presence of an electronic whiteboard , 2005, Int. J. Medical Informatics.

[98]  Linda R. Elliott,et al.  Managing workload in human-robot interaction: A review of empirical studies , 2010, Comput. Hum. Behav..

[99]  B. Cain A Review of the Mental Workload Literature , 2007 .

[100]  W. B. Seales,et al.  Assessing Mental Workload During Laparoscopic Surgery , 2005, Surgical innovation.

[101]  A. Byrne,et al.  Novel method of measuring the mental workload of anaesthetists during clinical practice. , 2009, British journal of anaesthesia.

[102]  Robert E. Schlegel,et al.  Operator Functional State Assessment , 2004 .

[103]  Neville A Stanton,et al.  It's all relative: defining mental workload in the light of Annett's paper , 2002, Ergonomics.

[104]  Paul E. Dunne,et al.  Semi-stable semantics , 2006, J. Log. Comput..

[105]  D M Gaba,et al.  Measuring the Workload of the Anesthesiologist , 1990, Anesthesia and analgesia.

[106]  Vincent P. Wade,et al.  Personalisation in the wild: providing personalisation across semantic, social and open-web resources , 2011, HT '11.

[107]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[108]  Michael Wooldridge,et al.  Weighted argument systems: Basic definitions, algorithms, and complexity results , 2011, Artif. Intell..

[109]  Souhila Kaci,et al.  An Argumentation Framework for Merging Conflicting Knowledge Bases: The Prioritized Case , 2005, ECSQARU.

[110]  Robert D. O'Donnell,et al.  A Conceptual Framework for Development of a Workload Assessment Methodology , 1982 .

[111]  Fabio Rusconi,et al.  The Importance of Human Mental Workload in Web Design , 2012, WEBIST.

[112]  Pietro Baroni,et al.  An introduction to argumentation semantics , 2011, The Knowledge Engineering Review.

[113]  William B. Rouse,et al.  Modeling the dynamics of mental workload and human performance in complex systems , 1993, IEEE Trans. Syst. Man Cybern..

[114]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[115]  A F Smith,et al.  Methodological approaches to anaesthetists' workload in the operating theatre. , 2005, British journal of anaesthesia.

[116]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[117]  A Pretorius,et al.  Development of a mental workload index: A systems approach , 2007, Ergonomics.

[118]  Mark S. Young,et al.  Attention and automation: New perspectives on mental underload and performance , 2002 .

[119]  C A Shingledecker,et al.  Behavioral and Subjective Workload Metrics for Operational Environments , 1983 .

[120]  Henry Prakken,et al.  AI & Law, Logic and Argument Schemes , 2005 .

[121]  Elizabeth Sklar,et al.  Reasoning about Trust Using Argumentation: A Position Paper , 2010, ArgMAS.

[122]  P. Hancock The Effect of Gender and Time of Day Upon the Subjective Estimate of Mental Workload During the Performance of a Simple Task , 1988 .

[123]  J. Annett Subjective rating scales: science or art? , 2002, Ergonomics.

[124]  Luca Longo,et al.  Defeasible Reasoning and Argument-Based Systems in Medical Fields: An Informal Overview , 2014, 2014 IEEE 27th International Symposium on Computer-Based Medical Systems.

[125]  Michael J. Albers Tapping as a measure of cognitive load and website usability , 2011, SIGDOC '11.

[126]  Victor A. Riley,et al.  W/INDEX: A Predictive Model of Operator Workload , 1989 .

[127]  Jing Zhang,et al.  Driver cognitive workload estimation: a data-driven perspective , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[128]  P A Hancock,et al.  The effect of performance failure and task demand on the perception of mental workload. , 1989, Applied ergonomics.

[129]  Jacek Gwizdka,et al.  Assessing Cognitive Load on Web Search Tasks , 2009, ArXiv.

[130]  A. H. Roscoe,et al.  A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use , 1990 .

[131]  Michael A. Shepherd,et al.  A Goal-based Classification of Web Information Tasks , 2006, ASIST.

[132]  Claude Frasson,et al.  Modeling mental workload using EEG features for intelligent systems , 2011, UMAP'11.

[133]  K. Kanda,et al.  Effects of mental workload on nurses' visual behaviors during infusion pump operation. , 2011, Japan journal of nursing science : JJNS.

[134]  Tjerk de Greef,et al.  Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation , 2009, HCI.

[135]  Pietro Baroni,et al.  FULL NONMONOTONICITY : A NEW PERSPECTIVE IN DEFEASIBLE REASONING , 2005 .

[136]  Explore Configuring,et al.  A Simulation Study to , 2004 .

[137]  Daniel B. Jones,et al.  Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center , 2007, Surgical Endoscopy.

[138]  Guillermo Ricardo Simari,et al.  An Abstract Argumentation Framework with Varied-Strength Attacks , 2008, KR.

[139]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[140]  Claudette Cayrol,et al.  A Reasoning Model Based on the Production of Acceptable Arguments , 2002, Annals of Mathematics and Artificial Intelligence.

[141]  George E. Cooper,et al.  The use of pilot rating in the evaluation of aircraft handling qualities , 1969 .

[142]  A. O. Dick,et al.  Operator Workload: Comprehensive Review and Evaluation of Operator Workload Methodologies , 1989 .

[143]  I. B. Turksen,et al.  Fuzzy Analysis of Skill and Rule-Based Mental Workload , 1988 .

[144]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[145]  P. S. Tsang,et al.  TECHNIQUES OF SUBJECTIVE WORKLOAD ASSESSMENT: A COMPARISON OF SWAT AND THE NASA-BIPOLAR METHODS , 1986 .

[146]  Bernard Moulin,et al.  A taxonomy of argumentation models used for knowledge representation , 2010, Artificial Intelligence Review.

[147]  Henri Prade,et al.  A Qualitative Bipolar Argumentative View of Trust , 2007, SUM.

[148]  Yung-Tsan Jou,et al.  Evaluation of operators’ mental workload of human–system interface automation in the advanced nuclear power plants , 2009 .

[149]  D. Gopher,et al.  On the Psychophysics of Workload: Why Bother with Subjective Measures? , 1984 .

[150]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[151]  James C. Schueren,et al.  Using the Subjective Workload Dominance (SWORD) Technique for Projective Workload Assessment , 1991 .