Modelling human cognition of abnormal machine behaviour

Despite the advances in intelligent systems, there is no guarantee that those systems will always behave normally. Machine abnormalities, unusual responses to controls or false alarms, are still common; therefore, a better understanding of how humans learn and respond to abnormal machine behaviour is essential. Human cognition has been researched in many domains. Numerous theories such as utility theory, three-level situation awareness and theory of dual cognition suggest how human cognition behaves. These theories present the varieties of human cognition including deliberate and naturalistic thinking. However, studies have not taken into consideration varieties of human cognition employed when responding to abnormal machine behaviour. This study reviews theories of cognition, along with empirical work on the significance of human cognition, including several case studies. The different propositions of human cognition concerning abnormal machine behaviour are compared to dual cognition theories. Our results show that situation awareness is a suitable framework to model human cognition of abnormal machine behaviour. We also propose a continuum which represents varieties of cognition, lying between explicit and implicit cognition. Finally, we suggest a theoretical approach to learn how the human cognition functions when responding to abnormal machine behaviour during a specific event. In conclusion, we posit that the model has implications for emerging waves of human-intelligent system collaboration.