Applying ergonomics within the multi-modelling paradigm with an example from multiple UAV control

Abstract This article presents a position statement on using ergonomics in conjunction with the multi-modelling paradigm. Multi-modelling is a computational approach to combine models of systems and components for design and simulation of cyber physical systems and systems of systems. Despite potentially significant benefits in terms of more human-centric system modelling, there is limited evidence of the application of ergonomics within multi-modelling. This article presents the case for applying ergonomics within multi-modelling. We open with an introduction to multi-modelling and benefits, applications and gaps for ergonomics in multi-modelling, and of potentially useful models from ergonomics. We then describe a proof-of-concept implementation of ergonomics within a multi-model of UAV control. This demonstrates that as well as user-centred modelling, this approach supports ergonomics in how we can access rich systems models, and the collaborative value of applying ergonomics theory in systems design. Practitioner Summary: Examines multi-modelling, a computational approach for complex modelling, and the contribution of ergonomics. An autonomous UAV test implementation demonstrates the application of ergonomics knowledge for improving design and evaluation processes, and how multi-modelling can give ergonomics access to rich systems models. Abbreviations: ACT-R: adaptive control of thought—rational; API: application programming interface; CFD: computational fluid dynamics; COTS: commerical off the shelf; CPS: cyber-physical system; CT: continuous time; DE: discrete event; DSE: design space exploration; FME: finite element modeling; FMI: functional mock-up interface; FMU: functional mock-up unit; GOMS: goals, operators, methods, selections; HCI: human-computer interaction; IMPRINT: improved performance research integration tool; INTO-CPS: integrated toolchain for cyber-physical system modeling; KLM: keystroke level model; MPC: model-predictive control; SysML: system markup language; SoS: system of system; UAV: unmanned aerial vehicle

[1]  Mary L. Cummings,et al.  Predicting Locomotive Crew Performance in Rail Operations with Human and Automation Assistance , 2019, IEEE Transactions on Human-Machine Systems.

[2]  Frank E. Ritter,et al.  Model-based evaluation of expert cell phone menu interaction , 2007, TCHI.

[3]  Peter Gorm Larsen,et al.  Collaborative Design for Embedded Systems: Co-modelling and Co-simulation , 2014 .

[4]  Janet M. Twomey,et al.  Predicting peak pinch strength: Artificial neural networks vs. regression , 1996 .

[5]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[6]  Bruce P. Hunn,et al.  A Shadow Unmanned Aerial Vehicle (UAV) Improved Performance Research Integration Tool (IMPRINT) Model Supporting Future Combat Systems , 2006 .

[7]  Erik Hollnagel,et al.  Human factors and folk models , 2004, Cognition, Technology & Work.

[8]  Gary E. Burnett,et al.  An extended keystroke level model (KLM) for predicting the visual demand of in-vehicle information systems , 2007, CHI.

[9]  F. E. Ritter,et al.  Learning Curve, The , 2001 .

[10]  Michael Henshaw,et al.  The future of trans-Atlantic collaboration in modelling and simulation of Cyber-Physical Systems - A strategic research agenda for collaboration , 2017 .

[11]  Christoph van Treeck,et al.  Real-Time Assessment of Human Thermal Comfort Using Image Recognition in Conjunction with a Detailed Numerical Human Model , 2017 .

[12]  M. Brian Blake,et al.  Agent-based simulation for UAV swarm mission planning and execution , 2013, SpringSim.

[13]  Alie El-Din Mady,et al.  Collaborative Model‐based Systems Engineering for Cyber‐Physical Systems, with a Building Automation Case Study , 2016 .

[14]  Cinzia Bernardeschi,et al.  A Flexible Framework for FMI-Based Co-Simulation of Human-Centred Cyber-Physical Systems , 2018, STAF Workshops.

[15]  Leo A. M. van Dongen,et al.  Simulating mechanical stress on a micro Unmanned Aerial Vehicle (UAV) body frame for selecting maintenance actions , 2018 .

[16]  Rainer Stark,et al.  Integrating User Experience Validation into a New Engineering Development Process for Advanced Driver Assistance Systems , 2014, AutomotiveUI.

[17]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[18]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[19]  Michael D. Byrne,et al.  A History and Primer of Human Performance Modeling , 2009 .

[20]  Christopher D. Wickens,et al.  Time Sharing Between Robotics and Process Control , 2016, Hum. Factors.

[21]  F.-L. Krause,et al.  Competing in engineering design—The role of Virtual Product Creation , 2010 .

[22]  Zhuang Fengqing,et al.  Patients’ Responsibilities in Medical Ethics , 2016 .

[23]  Stewart Robinson,et al.  Simulation: The Practice of Model Development and Use , 2004 .

[24]  Casper Thule,et al.  Maestro: The INTO-CPS co-simulation framework , 2019, Simul. Model. Pract. Theory.

[25]  Kincho H. Law,et al.  A multi-agent based framework for the simulation of human and social behaviors during emergency evacuations , 2007, AI & SOCIETY.

[26]  James Humann,et al.  Modeling and simulation of multi-UAV, multi-operator surveillance systems , 2018, 2018 Annual IEEE International Systems Conference (SysCon).

[27]  Graham Coates,et al.  Agent-based simulation for large-scale emergency response: A survey of usage and implementation , 2012, CSUR.

[28]  Christian Lebiere,et al.  Modeling Human Performance in Complex Systems , 2012 .

[29]  Massimo Satler,et al.  Towards Smart Farming and Sustainable Agriculture with Drones , 2015, 2015 International Conference on Intelligent Environments.

[30]  Yan Wang,et al.  Conceptual approach for multi-disciplinary cyber physical systems design and engineering , 2014 .

[31]  R. Seibel DISCRIMINATION REACTION TIME FOR 1,023-ALTERNATIVE TASK. , 1963, Journal of experimental psychology.

[32]  Simon Kind,et al.  Hybrid Simulators for Product Service-Systems – Innovation Potential Demonstrated on Urban Bike Mobility☆ , 2015 .

[33]  Travis J. Wiltshire,et al.  Multiscale movement coordination dynamics in collaborative team problem solving. , 2019, Applied ergonomics.

[34]  Guy H. Walker,et al.  State-of-science: situation awareness in individuals, teams and systems , 2017, Ergonomics.

[35]  Jakob Axelsson,et al.  Systems-of-systems for border-crossing innovation in the digitized society - A strategic research and innovation agenda for Sweden , 2015 .

[36]  Jim Woodcock,et al.  Features of Integrated Model-Based Co-modelling and Co-simulation Technology , 2017, SEFM Workshops.

[37]  Peer-Olaf Siebers,et al.  Modelling and simulation of rail passengers to evaluate methods to reduce dwell times , 2015 .

[38]  Waldemar Karwowski,et al.  The complexity of human performance variability on watch standing task. , 2019, Applied ergonomics.

[39]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[40]  Peter Gorm Larsen,et al.  Development of a Driverless Lawn Mower Using Co-simulation , 2017, SEFM Workshops.

[41]  Nuria Pelechano,et al.  Evacuation simulation models: challenges in modeling high rise building evacuation with cellular automata approaches , 2008 .

[42]  Björn Johansson,et al.  DESIGN OF A DISTRIBUTED HUMAN FACTORS LABORATORY FOR FUTURE AIRSYSTEMS , 2018 .

[43]  Keith Case,et al.  ‘Beyond Jack and Jill’: designing for individuals using HADRIAN , 2004 .

[44]  Roberto Palacin,et al.  Exploring Human Behaviour in Cyber-Physical Systems with Multi-modelling and Co-simulation , 2019, FM Workshops.

[45]  David R. Large,et al.  Train-driving simulator studies: Can novice drivers deliver the goods? , 2017 .

[46]  Zi Qian,et al.  Integrated evaluation of air flow and gas dispersion for underground station safety strategies based on subway climatology , 2017 .

[47]  Alexander I. Rudnicky,et al.  A performance model of system delay and user strategy selection , 1992, CHI.

[48]  Frank E. Ritter,et al.  Fitting a Model to Behavior Tells Us What Changes Cognitively when under Stress and with Caffeine , 2009, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[49]  Sue E. Kasea,et al.  Fitting a model to behavior reveals what changes cognitively when under stress and with caffeine , 2017 .

[50]  Steven Rasmussen,et al.  Automated UAV tasks for search and surveillance , 2016, 2016 IEEE Conference on Control Applications (CCA).

[51]  Nazaruddin,et al.  Grip strength prediction for Malaysian industrial workers using artificial neural networks , 2005 .

[52]  Stephan A. Konz,et al.  Engineering Models of the Human Thermoregulatory System-A Review , 1977, IEEE Transactions on Biomedical Engineering.

[53]  Peter Gorm Larsen,et al.  Collaborative Design for Embedded Systems , 2014, Springer Berlin Heidelberg.

[54]  Insup Lee,et al.  Cyber-physical systems: The next computing revolution , 2010, Design Automation Conference.

[55]  Nicolai Pedersen,et al.  Distributed Co-Simulation of Embedded Control Software with Exhaust Gas Recirculation Water Handling System using INTO-CPS , 2017, SIMULTECH.

[56]  Markus Roggenbach,et al.  Towards integrated simulation and formal verification of rail yard designs - an experience report based on the UK East Coast Main Line , 2016, 2016 IEEE International Conference on Intelligent Rail Transportation (ICIRT).

[57]  Mary L. Cummings,et al.  Modeling the Impact of Workload in Network Centric Supervisory Control Settings , 2018, Neurocognitive and Physiological Factors During High-Tempo Operations.

[58]  Roy S. Kalawsky,et al.  A Novel “Resilience Viewpoint” to aid in Engineering Resilience in Systems of Systems (SoS) , 2018, INCOSE International Symposium.

[59]  Constantin-Bala Zamfirescu,et al.  Early-stage analysis of cyber-physical production systems through collaborative modelling , 2019, Software and Systems Modeling.

[60]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[61]  Stefano Filippi,et al.  In-Depth Analysis of Non-deterministic Aspects of Human-Machine Interaction and Update of Dedicated Functional Mock-Ups , 2014, HCI.

[62]  Emine Mine Thompson,et al.  A11 Towards an integrated evaluation of the effects on health from smoke or toxic gas dispersion in the evacuation of subway tunnels , 2015 .

[63]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[64]  Mark D. Dunlop,et al.  Enhancing KLM (keystroke-level model) to fit touch screen mobile devices , 2014, MobileHCI '14.

[65]  Sarah Mortimer,et al.  Road2CPS priorities and recommendations for research and innovation in cyber-physical systems , 2017 .

[66]  Enrico Rukzio,et al.  Presenting a Modular Framework for a Holistic Simulation of Manual Assembly Tasks , 2018 .

[67]  Eugenio Andrés Díaz Merino,et al.  Simulating the influence of physical overload on assembly line performance: A case study in an automotive electrical component plant. , 2019, Applied ergonomics.

[68]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[69]  Francesco Flammini,et al.  Railway infrastructure monitoring by drones , 2016, 2016 International Conference on Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC).

[70]  Gary B. Lamont,et al.  Parallel simulation of UAV swarm scenarios , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[71]  Jan F. Broenink,et al.  A co-modelling method for solving incompatibilities during co-design of mechatronic devices , 2014, Adv. Eng. Informatics.

[72]  Peer-Olaf Siebers,et al.  On the multi-agent stochastic simulation of occupants in buildings , 2018 .

[73]  Peter Gorm Larsen,et al.  A Discrete Event-first Approach to Collaborative Modelling of Cyber-Physical Systems , 2018 .

[74]  Cinzia Bernardeschi,et al.  Co-simulation of Semi-autonomous Systems: The Line Follower Robot Case Study , 2017, SEFM Workshops.

[75]  Olivier Festor,et al.  Multi-modeling and Co-simulation-Based Mobile Ubiquitous Protocols and Services Development and Assessment , 2010, MobiQuitous.

[76]  Ramón Alcarria,et al.  A Methodology for the Design of Application-Specific Cyber-Physical Social Sensing Co-Simulators , 2017, Sensors.

[77]  Jonathan Powell,et al.  A comparison of modelled and real-life driving profiles for the simulation of railway vehicle operation , 2015 .

[78]  Claire Ingram,et al.  Model-based Engineering of Emergence in a Collaborative SoS: Exploiting SysML & Formalism , 2015 .

[79]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[80]  John Fitzgerald,et al.  Engineering Cyber-Physical Swarms with Collaborative Modelling , 2018 .

[81]  Dusan Gleich,et al.  On drone ground penetrating radar for landmine detection , 2017, 2017 First International Conference on Landmine: Detection, Clearance and Legislations (LDCL).

[82]  John M. Flach,et al.  Complexity: learning to muddle through , 2011, Cognition, Technology & Work.

[83]  Mihai NEGHINA,et al.  Multi-Paradigm Discrete-Event Modelling and Co-simulation of Cyber-Physical Systems , 2019 .

[84]  Feng Wei,et al.  Implementing Occupant Behaviour in the Simulation of Building Energy Performance and Energy Flexibility: Development of Co-Simulation Framework and Case Study , 2017, Building Simulation Conference Proceedings.

[85]  Sara Fripp A learning curve. , 2014, Midwives.

[86]  Ivan Grujic,et al.  Model-Based Development and Evaluation of Control for Complex Multi-Domain Systems: Attitude Control for a Quadrotor UAV , 2016 .

[87]  Paul Bratley,et al.  A guide to simulation , 1983 .

[88]  C Niessen,et al.  Modelling cognitive processes of experienced air traffic controllers. , 1999, Ergonomics.