Cognitive Ergonomic Evaluation Metrics and Methodology for Interactive Information System

In the face of complex information interactive system, it is essential to evaluate products achieve system performance within users cognitive capacity. Most of the research about ergonomic evaluation mainly focus on the macro ergonomic method, which not focus on concrete design problem at the micro level. This paper focuses on how to identify and predict cognitive ergonomic problems based user action and cognitive model and establishes the mapping relationship between cognitive ergonomic problems and real-time continuous measured data in order to let the evaluation results play a direct role in the design. The methodology was applied to evaluate the ergonomic quality of IETM used by astronauts in the space station, which including make flight plans, do experiments, in-orbit maintenance, and so on. A series of standardized evaluation procedures were designed to explore the possibility of remote ergonomic measurement for long-term orbiting operation.

[1]  Jean-Paul Imbert,et al.  Attentional costs and failures in air traffic control notifications , 2014, Ergonomics.

[2]  Christopher D. Wickens,et al.  Mental Workload: Assessment, Prediction and Consequences , 2017, H-WORKLOAD.

[3]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[4]  Brian Shackel,et al.  Usability - Context, framework, definition, design and evaluation , 1991, Interact. Comput..

[5]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[6]  Duygun Erol,et al.  Evaluation of a surgical interface for robotic cryoablation task using an eye-tracking system , 2016, Int. J. Hum. Comput. Stud..

[7]  B. Cain.  A Review of the Mental Workload Literature , 2007 .

[8]  Pauline A. Smith.  Towards a Practical Measure of Hypertext Usability , 1996, Interact. Comput..

[9]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[10]  Jim Nixon,et al.  Measuring mental workload using physiological measures: A systematic review. , 2019, Applied ergonomics.

[11]  Cecilia Berlin,et al.  Production Ergonomics: Designing Work Systems to Support Optimal Human Performance , 2017 .

[12]  S.D.P. Harker,et al.  The development of ISO DIS 9241 Part 2: visual display terminals (VDTs) used for office tasks-ergonomic requirements. 2. Task requirements , 1989 .

[13]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[14]  David B. Boles,et al.  Predicting Dual-Task Performance With the Multiple Resources Questionnaire (MRQ) , 2007, Hum. Factors.

[15]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[16]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[17]  E. Hollnagel.  Cognitive ergonomics: it's all in the mind , 1997 .

[18]  Mark S. Young,et al.  Guide to Methodology in Ergonomics: Designing for Human Use , 1999 .

[19]  Robert D. O'Donnell,et al.  A Conceptual Framework for Development of a Workload Assessment Methodology , 1982 .

[20]  Peter A. Hancock.  Whither Workload? Mapping a Path for Its Future Development , 2017, H-WORKLOAD.

[21]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[22]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[23]  Luca Longo,et al.  Experienced mental workload, perception of usability, their interaction and impact on task performance , 2018, PloS one.

[24]  Jessica Hutchings,et al.  What Is Ergonomics? , 2022, Ergonomics in the Dental Office.

[25]  Elizabeth M. Borycki,et al.  Insights and limits of usability evaluation methods along the health information technology lifecycle , 2015, MIE.

[26]  Dipak Kalra,et al.  How do clinical information systems affect the cognitive demands of general practitioners? Usability study with a focus on cognitive workload , 2015, BMJ Health & Care Informatics.