A methodology for building a data-enclosing tunnel for automated online-feedback in simulator Training

Abstract Extensive research confirms that feedback is the key to an effective training. However, in many domains, human trainers, who can provide feedback to trainees, are considered not only a costly but also a scarce resource. For trainees to be more independent and undergo self-training and unbiased support, effective automated feedback is highly recommended. We resort to elements from the theory of data mining to devise a data-driven automated feedback system. The data-enclosing tunnel is a novel concept that may be used to detect deviations from correct operation paths and be the base for automated feedback. Two case studies demonstrate the viability of this methodology and its usefulness in industrial simulation scenarios. Case study 1 focuses on the increase of oil production, whilst case study 2 focuses on the decrease of gas production. The data-enclosing tunnel is validated and compared with three other assessment methods. These methods are simpler versions of the data-enclosing tunnel method, as they are three variants of a baseline approach Data Enclosing Band (DEB), namely DEB1, DEB2, DEB3. The methods accuracy is determined by calculating how precisely they can classify new data. The data-enclosing tunnel yielded the highest accuracy, 94.3%, compared to 81.4%, 62.9%, and 70% for DEB1, DEB2, DEB3 respectively.

[1]  Steve W. J. Kozlowski,et al.  Current issues and future directions in simulation-based training in North America , 2008 .

[2]  Dan Morris,et al.  Providing metrics and performance feedback in a surgical simulator , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[3]  Yoshiyuki Yamashita,et al.  Supervised learning for the analysis of process operational data , 2000 .

[4]  Donato Malerba,et al.  A Sliding Window Algorithm for Relational Frequent Patterns Mining from Data Streams , 2009, Discovery Science.

[5]  Xue Z. Wang,et al.  Knowledge discovery from process operational data for assessment and monitoring of operator's performance , 2000 .

[6]  Salman Nazir,et al.  Performance Indicators for the Assessment of Industrial Operators , 2012 .

[7]  Sujin Lee,et al.  Development of evaluation algorithms for operator training system , 2000 .

[8]  Laura Marcano,et al.  Implementation of performance indicators for automatic assessment , 2017 .

[9]  Kaushik Ghosh,et al.  Optimal variable selection for effective statistical process monitoring , 2014, Comput. Chem. Eng..

[10]  Annette Kluge,et al.  Procedure for Automated Assessment of Industrial Operators , 2014 .

[11]  Ian Witten,et al.  Data Mining , 2000 .

[12]  Laura Marcano,et al.  Constructive Assessment Method for Simulator Training , 2018 .

[13]  Mona Hafez Mahmoud,et al.  An intelligent tutoring system for teaching the grammar of the Arabic language , 2016 .

[14]  Seunggeun Hyun,et al.  Confidence bands for the difference of two survival functions under the additive risk model , 2011 .

[15]  Laura Marcano,et al.  Using the concept of data enclosing tunnel as an online feedback tool for simulator training , 2018 .

[16]  Mahnane Lamia,et al.  Implementing flipped classroom that used an intelligent tutoring system into learning process , 2018, Comput. Educ..

[17]  Tiina M. Komulainen,et al.  Learning transfer through industrial simulator training: Petroleum industry case , 2018 .

[18]  Valeriy Khabarov,et al.  Creating a Model of an Operator of a Simulator Complex using Commonsense Reasoning , 2017 .

[19]  Tom Kontogiannis,et al.  Refresher Training for Air Traffic Controllers: Is It Adequate to Meet the Challenges of Emergencies and Abnormal Situations? , 2012 .

[20]  Liang Ming,et al.  Abnormal situation management: Challenges and opportunities in the big data era , 2016, Comput. Chem. Eng..

[21]  Tiina M. Komulainen,et al.  LARGE-SCALE TRAINING SIMULATORS FOR INDUSTRY AND ACADEMIA , 2014 .

[22]  A. Skelton,et al.  An algorithm for continuous piecewise linear bounding of discrete time series data , 2014 .

[23]  Davide Manca,et al.  How a plant simulator can improve industrial safety , 2015 .

[24]  Siriwan Suebnukarn,et al.  Intelligent dental training simulator with objective skill assessment and feedback , 2011, Artif. Intell. Medicine.

[25]  Eduardo Salas,et al.  The Science of Training and Development in Organizations , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[26]  Kurt VanLehn,et al.  A System Architecture for Affective Meta Intelligent Tutoring Systems , 2014, Intelligent Tutoring Systems.

[27]  Jürgen Sauer,et al.  Designing training for process control simulators: a review of empirical findings and current practices , 2009 .

[28]  Laura Marcano,et al.  Review of simulator training practices for industrial operators: How can individual simulator training be enabled? , 2019, Safety Science.

[29]  Janis A. Cannon-Bowers,et al.  Feedback source modality effects on training outcomes in a serious game: Pedagogical agents make a difference , 2015, Comput. Hum. Behav..