Categorization Errors for Data Entry in Maintenance Work-Orders

In manufacturing, there is a significant push toward the digitizationof processes and decision making, by increasing thelevel of automation and networking via cyber-physical systems,and machine learning methods that can parse usefulpatterns from these complex architectures. As such, this pushtoward being “smart” is largely driven by the availability ofdata, for analysis, decision guidance, and the training of AI.The maintenance team, however, one of the core subsystemsin any production line, remains a largely human endeavor.Consequently, the historical data needed for research and developmentof AI-assisted maintenance frameworks are oftenfull of misspellings, jargon, and abbreviations. While onemight enforce data-entry into pre-specified functional categories(generally using some form of controlled vocabulary),cognitive models, along with consistent reports from industry,indicate that data entry remains a process fraught with significanterrors, especially when a mismatch occurs between designatedschemas and the technician’s needed semantic flexibility.This paper offers a framework for understanding andaddressing these issues, with a methodological case study inapplying Human Reliability Analysis (HRA) to quantify andunderstand human errors associated with entering maintenancework-order (MWO) data into structured database (DB)schema. We subsequently suggest potential mitigation strategiesfor each to improve the quality of recorded data throughoutthe maintenance-management workflow.

[1]  K. Schemeleva,et al.  HUMAN ERROR PROBABILITIES COMPUTATION FOR MANUFACTURING SYSTEM SIMULATION USING CREAM , 2012 .

[2]  G. McCarthy FRAM: the functional resonance analysis method, modelling complex socio-technical systems , 2013 .

[3]  L. Thurstone A law of comparative judgment. , 1994 .

[4]  Carol J. Williams,et al.  Measuring Associative Strength: Category-Item Associations and Their Activation from Memory , 2000 .

[5]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  R. Luce,et al.  The Choice Axiom after Twenty Years , 1977 .

[7]  Richard L. Kegg,et al.  One-Line Machine and Process Diagnostics , 1984 .

[8]  Monica Chiarini Tremblay,et al.  Identifying fall-related injuries: Text mining the electronic medical record , 2009, Inf. Technol. Manag..

[9]  Birgit Vogel-Heuser,et al.  Making Implicit Knowledge Explicit - Acquisition of Plant Staff's Mental Models as a Basis for Developing a Decision Support System , 2017, HCI.

[10]  Boonserm Kulvatunyou,et al.  Maturity Models and Tools for Enabling Smart Manufacturing Systems: Comparison and Reflections for Future Developments , 2017, PLM.

[11]  Birgit Vogel-Heuser,et al.  A virtual training system for aging employees in machine operation , 2017, 2017 IEEE 15th International Conference on Industrial Informatics (INDIN).

[12]  Melinda R. Hodkiewicz,et al.  Are managerial pressure, technological control and intrinsic motivation effective in improving data quality? , 2013, Reliab. Eng. Syst. Saf..

[13]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[14]  Isabella Peters,et al.  Folksonomies - Indexing and Retrieval in Web 2.0 , 2009, Knowledge and Information.

[15]  Boonserm Kulvatunyou,et al.  Smart Manufacturing Through a Framework for a Knowledge-Based Diagnosis System , 2017 .

[16]  Gordon D Logan,et al.  Cumulative progress in formal theories of attention. , 2004, Annual review of psychology.

[17]  N. Adams Bloom's taxonomy of cognitive learning objectives. , 2015, Journal of the Medical Library Association : JMLA.

[18]  Michael Brundage,et al.  Hybrid datafication of maintenance logs from AI-assisted human tags , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[19]  Barry Kirwan,et al.  Nuclear Action Reliability Assessment (NARA): A Data-Based HRA Tool , 2005 .

[20]  Melinda R. Hodkiewicz,et al.  Goal Hierarchy: Improving Asset Data Quality by Improving Motivation , 2011, Reliab. Eng. Syst. Saf..

[21]  Hyoil Han,et al.  Approaches to text mining for clinical medical records , 2006, SAC '06.

[22]  Capt. Sameh Kabary Rashed The Concept of Human Reliability Assessment Tool CREAM and Its Suitability for Shipboard Operations Safety , 2016 .

[23]  Barbara Jean Bell Human Reliability Analysis: A Case Study , 1984 .

[24]  Daniel T. Heinze,et al.  Mining free-text medical records , 2001, AMIA.