Data quality assessment of maintenance reporting procedures

Evidence that data quality is hardly considered in expert & intelligent systems is provided.A decision-support tool for maintenance data reporting assessment is developed.A company uses the proposed tool to rank branch offices in terms of reporting quality.Enhanced reporting quality results in enhanced business activities & decision-making. Today's largest and fastest growing companies' assets are no longer physical, but rather digital (software, algorithms...). This is all the more true in the manufacturing, and particularly in the maintenance sector where quality of enterprise maintenance services are closely linked to the quality of maintenance data reporting procedures. If quality of the reported data is too low, it can results in wrong decision-making and loss of money. Furthermore, various maintenance experts are involved and directly concerned about the quality of enterprises' daily maintenance data reporting (e.g., maintenance planners, plant managers...), each one having specific needs and responsibilities. To address this Multi-Criteria Decision Making (MCDM) problem, and since data quality is hardly considered in existing expert maintenance systems, this paper develops a maintenance reporting quality assessment (MRQA) dashboard that enables any company stakeholder to easily - and in real-time - assess/rank company branch offices in terms of maintenance reporting quality. From a theoretical standpoint, AHP is used to integrate various data quality dimensions as well as expert preferences. A use case describes how the proposed MRQA dashboard is being used by a Finnish multinational equipment manufacturer to assess and enhance reporting practices in a specific or a group of branch offices.

[1]  T. V. Garcez,et al.  Decision on Maintenance Outsourcing , 2015 .

[2]  Carlos E. Escobar-Toledo,et al.  The Efficiency of Preventive Maintenance Planning and the Multicriteria Methods: A Case Study , 2008, Computación y Sistemas.

[3]  John Sessions,et al.  Scheduling forest road maintenance using the analytic hierarchy process and heuristics , 2006 .

[4]  Somasundaram Kumanan,et al.  Application of Hybrid VIKOR Model in Selection of Maintenance Strategy , 2012 .

[5]  A. Smilde,et al.  Multicriteria decision making , 1992 .

[6]  Aditya Parida,et al.  Maintenance audits using balanced scorecard and maturity model , 2011 .

[7]  María Carmen Carnero,et al.  Selection of a Computerised Maintenance Management System: a case study in a regional health service , 2011 .

[8]  Mohammad Sheikhalishahi,et al.  An integrated simulation-data envelopment analysis approach for maintenance activities planning , 2014, Int. J. Comput. Integr. Manuf..

[9]  Ortwin Renn,et al.  Expert Judgment and Expert Systems , 1987, NATO ASI Series.

[10]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[11]  Nebojsa J. Bojovic,et al.  Evaluation of vehicle fleet maintenance management indicators by application of DEMATEL and ANP , 2012, Expert Syst. Appl..

[12]  Chulhyun Kim,et al.  Measuring efficiency of total productive maintenance (TPM): a three-stage data envelopment analysis (DEA) approach , 2011 .

[13]  Klaus-Dieter Thoben,et al.  Information Quality in PLM: A Product Design Perspective , 2015, APMS.

[14]  Jianfeng Li,et al.  An evaluation of maintenance strategy using risk based inspection , 2011 .

[15]  Marcello Braglia,et al.  The analytic hierarchy process applied to maintenance strategy selection , 2000, Reliab. Eng. Syst. Saf..

[16]  E. Reissner.  On asymptotic solutions for nonsymmetric deformations of shallow shells of revolution , 1964 .

[17]  Marcello Braglia,et al.  An analytical method for maintenance outsourcing service selection , 2004 .

[18]  Donald E. Grierson,et al.  Multicriteria decision making in n-D , 2007 .

[19]  Mehmet E. Ozbek,et al.  Efficiency Measurement of Bridge Maintenance Using Data Envelopment Analysis , 2010 .

[20]  Kumar Neeraj Jha,et al.  Prioritization of bridges for maintenance planning using data envelopment analysis , 2011 .

[21]  Ikuobase Emovon,et al.  Hybrid MCDM based methodology for selecting the optimum maintenance strategy for ship machinery systems , 2018, J. Intell. Manuf..

[22]  Peter Söderholm,et al.  Selection of maintenance actions using the analytic hierarchy process (AHP): decision-making in railway infrastructure , 2010 .

[23]  Madson B. S. Monte,et al.  A Multicriteria Approach Using MAUT to Assist the Maintenance of a Water Supply System Located in a Low-Income Community , 2016, Water Resources Management.

[24]  Abraham Charnes,et al.  A developmental study of data envelopment analysis in measuring the efficiency of maintenance units in the U.S. air forces , 1984, Ann. Oper. Res..

[25]  Adiel Almeida Filho,et al.  A MCDM Model for Preventive Maintenance on Wells for Water Distribution , 2015, SMC.

[26]  Takashi Uematsu,et al.  From maintenance to management , 2009 .

[27]  Maurizio Bevilacqua,et al.  A combined goal programming - AHP approach to maintenance selection problem , 2006, Reliab. Eng. Syst. Saf..

[28]  Seyed Mojtaba Sajadi,et al.  Selecting a preventive maintenance scheduling method by using simulation and multi criteria decision making , 2014 .

[29]  Adiel Teixeira de Almeida,et al.  A preventive maintenance decision model based on multicriteria method PROMETHEE II integrated with Bayesian approach , 2010 .

[30]  Tsai Chi Kuo,et al.  The optimisation of maintenance service levels to support the product service system , 2012 .

[31]  Danielle Costa Morais,et al.  Using ELECTRE TRI to support maintenance of water distribution networks , 2012 .

[32]  José T. Palma,et al.  Scheduling of maintenance work: A constraint-based approach , 2010, Expert Syst. Appl..

[33]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[34]  James Odeck,et al.  Efficiency of trucks in road construction and maintenance: An evaluation with data envelopment analysis , 1996, Comput. Oper. Res..

[35]  R. Keith Mobley,et al.  An introduction to predictive maintenance , 1989 .

[36]  Aditya Parida,et al.  Study and analysis of maintenance performance indicators (MPIs) for LKAB: A case study , 2007 .

[37]  Jui-Sheng Chou,et al.  Web-based CBR system applied to early cost budgeting for pavement maintenance project , 2009, Expert Syst. Appl..

[38]  Luca Fumagalli,et al.  A maintenance maturity assessment method for the manufacturing industry , 2013 .

[39]  B. Arputhamary,et al.  Data Integration in Big Data Environment , 2015 .

[40]  Lisa Simpson,et al.  Do Decision Makers Know What They Prefer?: MAVT and ELECTRE II , 1996 .

[41]  Morteza Yazdani,et al.  A state-of the-art survey of TOPSIS applications , 2012, Expert Syst. Appl..

[42]  E. Levrat,et al.  E-maintenance: review and conceptual framework , 2008 .

[43]  Diane M. Strong,et al.  Information quality benchmarks: product and service performance , 2002, CACM.

[44]  Dragan Banjevic,et al.  Prioritization of medical equipment for maintenance decisions , 2011, J. Oper. Res. Soc..

[45]  Selim Zaim,et al.  Maintenance strategy selection using AHP and ANP algorithms: a case study , 2012 .

[46]  Milo W. Peck,et al.  ASSESSING THE RELATIVE EFFICIENCY OF AIRCRAFT MAINTENANCE TECHNOLOGIES: AN APPLICATION OF DATA ENVELOPMENT ANALYSIS , 1998 .

[47]  Dan M. Frangopol,et al.  Decision Support System for Bridge Network Maintenance Planning , 2006 .

[48]  S. R. Devadasan,et al.  Multicriteria decision making in Maintenance Quality Function Deployment through the Analytical Hierarchy Process , 2007 .

[49]  Ramayya Krishnan,et al.  A hybrid approach to supplier selection for the maintenance of a competitive supply chain , 2008, Expert Syst. Appl..

[50]  M. Ilangkumaran,et al.  Selection of maintenance policy for textile industry using hybrid multi‐criteria decision making approach , 2009 .

[51]  Ehsan Pourjavad,et al.  Selecting optimum maintenance strategy by analytic network process with a case study in the mining industry , 2012 .

[52]  Adiel Teixeira de Almeida,et al.  A DSS Based on Multiple Criteria Decision Making for Maintenance Planning in an Electrical Power Distributor , 2013, EMO.

[53]  Chen Li-qiong.  Utility Optimality Method for Pipeline Integrity Maintenance Costs , 2005 .

[54]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[55]  Ludo Gelders,et al.  Maintenance management decision making , 1992 .

[56]  Yeu-Shiang Huang,et al.  A Bayesian decision analysis in determining the optimal policy for pricing, production, and warranty of repairable products , 2008, Expert Syst. Appl..

[57]  Mehmet E. Ozbek,et al.  Data and Modeling Issues Faced during the Efficiency Measurement of Road Maintenance Using Data Envelopment Analysis , 2010 .

[58]  Erik Demeulemeester,et al.  A three-stage approach for aircraft line maintenance personnel rostering using MIP, discrete event simulation and DEA , 2013, Expert Syst. Appl..

[59]  Philippe Lepert,et al.  Multicriteria Decision Analysis for Prioritizing Road Network Maintenance Interventions , 2011 .

[60]  Aida Azizi,et al.  Selection of optimum maintenance strategies based on a fuzzy analytic hierarchy process , 2014 .

[61]  Halil Ceylan,et al.  Integrated fuzzy analytic hierarchy process and VIKOR method in the prioritization of pavement maintenance activities , 2016 .

[62]  Arthur L. Blumenthal,et al.  The process of cognition , 1977 .

[63]  Virgilio Cruz-Machado,et al.  Decision Methodology for Maintenance KPI Selection: Based on ELECTRE I , 2014 .

[64]  Edmundas Kazimieras Zavadskas,et al.  Maintenance strategy selection using AHP and COPRAS under fuzzy environment , 2012 .

[65]  A. T. de Almeida,et al.  A multi‐criteria decision‐aiding model using PROMETHEE III for preventive maintenance planning under uncertain conditions , 2007 .

[66]  Sandra de F. Mendes Sampaio,et al.  DQ2S - A framework for data quality-aware information management , 2015, Expert Syst. Appl..

[67]  Boris Otto,et al.  A Maturity Model for Enterprise Data Quality Management , 2013, Enterp. Model. Inf. Syst. Archit. Int. J. Concept. Model..

[68]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[69]  Salih O. Duffuaa,et al.  A generic conceptual simulation model for maintenance systems , 2001 .

[70]  Edmundas Kazimieras Zavadskas,et al.  Fuzzy multiple criteria decision-making techniques and applications - Two decades review from 1994 to 2014 , 2015, Expert Syst. Appl..

[71]  Kai Fan,et al.  Integration of fuzzy AHP and FPP with TOPSIS methodology for aeroengine health assessment , 2010, Expert Syst. Appl..

[72]  Carlos A. Bana e Costa,et al.  A multi-criteria model for auditing a Predictive Maintenance Programme , 2012, Eur. J. Oper. Res..

[73]  John Krogstie,et al.  Defining quality aspects for conceptual models , 1995, ISCO.

[74]  Mahdieh Ahmadi,et al.  Maintenance Optimization Using Multi-attribute Utility Theory , 2016 .

[75]  Paul Rouse,et al.  Integrated Performance Measurement Design: Insights from an Application in Aircraft Maintenance , 2002 .

[76]  Yaakov Roll,et al.  Measuring the efficiency of maintenance units in the Israeli Air Force , 1989 .

[77]  Fei Tao,et al.  Big Data in product lifecycle management , 2015, The International Journal of Advanced Manufacturing Technology.

[78]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[79]  Benjamin T. Hazen,et al.  Applying Control Chart Methods to Enhance Data Quality , 2014, Technometrics.

[80]  Noradin Ghadimi,et al.  Optimal preventive maintenance policy for electric power distribution systems based on the fuzzy AHP methods , 2016, Complex..

[81]  Gerald M. Knapp,et al.  Determining the most important criteria in maintenance decision making , 1997 .

[82]  M. Ilangkumaran,et al.  Multi‐criteria decision‐making approach to evaluate optimum maintenance strategy in textile industry , 2008 .

[83]  Yunhao Liu,et al.  Big Data: A Survey , 2014, Mob. Networks Appl..

[84]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[85]  Adiel Teixeira de Almeida,et al.  Multicriteria Model for Selection of Preventive Maintenance Intervals , 2012, Qual. Reliab. Eng. Int..

[86]  Shinn Sun,et al.  Assessing joint maintenance shops in the Taiwanese Army using data envelopment analysis , 2004 .

[87]  Jan Holmström,et al.  Sustainable PLM through Intelligent Products , 2013, Eng. Appl. Artif. Intell..

[88]  Tien Fang Fwa,et al.  Pavement Maintenance Prioritization Using Analytic Hierarchy Process , 2009 .

[89]  Hamid Behbahani,et al.  Pavement rehabilitation and maintenance prioritization of urban roads using fuzzy logic , 2011, Expert Syst. Appl..

[90]  Mahmood Shafiee,et al.  Maintenance strategy selection problem: an MCDM overview , 2015 .

[91]  Ludo Gelders,et al.  Development of maintenance function performance measurement framework and indicators , 2011 .

[92]  Matthias Jarke,et al.  Dwq : Esprit Long Term Research Project, No 22469 Data Warehouse Quality: a Review of the Dwq Project , 2022 .

[93]  Adiel Teixeira de Almeida,et al.  Preventive Maintenance Decisions , 2015 .

[94]  Antonella Certa,et al.  ELECTRE III to dynamically support the decision maker about the periodic replacements configurations for a multi-component system , 2013, Decis. Support Syst..

[95]  Liliane Pintelon,et al.  Development of a maintenance performance measurement framework—using the analytic network process (ANP) for maintenance performance indicator selection , 2014 .

[96]  Danielle Costa Morais,et al.  Prioritising alternatives for maintenance of water distribution networks: A group decision approach , 2012 .

[97]  Ana Paula Cabral Seixas Costa,et al.  Multicriteria Model of Preventive Maintenance , 2010 .

[98]  Mahmud Fotuhi-Firuzabad,et al.  Critical Component Identification in Reliability Centered Asset Management of Power Distribution Systems Via Fuzzy AHP , 2012, IEEE Systems Journal.

[99]  Ehsan Pourjavad,et al.  Selecting maintenance strategy in mining industry by analytic network process and TOPSIS , 2013 .

[100]  Minqiang Xu,et al.  ELECTRE III Based on Ranking Fuzzy Numbers for Deterministic and Fuzzy Maintenance Strategy Decision Problems , 2007, 2007 IEEE International Conference on Automation and Logistics.

[101]  Jhareswar Maiti,et al.  Modeling risk based maintenance using fuzzy analytic network process , 2012, Expert Syst. Appl..

[102]  D. Galar,et al.  Maintenance metrics: A hierarchical model of balanced scorecard , 2011, 2011 IEEE International Conference on Quality and Reliability.

[103]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[104]  Adiel Teixeira de Almeida,et al.  Multicriteria decision making on maintenance: Spares and contracts planning , 2001, Eur. J. Oper. Res..

[105]  María Teresa Lamata,et al.  Selection of a cleaning system for engine maintenance based on the analytic hierarchy process , 2009, Comput. Ind. Eng..

[106]  Rob J. I. Basten,et al.  Exploring maintenance policy selection using the Analytic Hierarchy Process; An application for naval ships , 2015, Reliab. Eng. Syst. Saf..

[107]  Shahrul Kamaruddin,et al.  Comparison of Multi Criteria Decision Making Methods From The Maintenance Alternative Selection Perspective , 2013 .

[108]  Salvatore Cafiso,et al.  Multicriteria Analysis Method for Pavement Maintenance Management , 2002 .

[109]  S. Jain,et al.  Assessing the Accuracy of Administrative Data in Health Information Systems , 2004, Medical care.

[110]  Adiel Teixeira de Almeida,et al.  Decisions on Priority Assignment for Maintenance Planning , 2015 .

[111]  Qu Chang-zheng.  A Priority Sorting Approach of Maintenance Task During Mission Based on ELECTRE TRI , 2012 .

[112]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[113]  Jürgen Umbrich,et al.  Quality assessment & evolution of Open Data portals , 2015 .

[114]  Sylvain Kubler,et al.  Universal Messaging Standards for the IoT From a Lifecycle Management Perspective , 2014, IEEE Internet of Things Journal.

[115]  M. Sheikhalishahi,et al.  An integrated fuzzy simulation–fuzzy data envelopment analysis approach for optimum maintenance planning , 2014, Int. J. Comput. Integr. Manuf..

[116]  Orlando Durán,et al.  Computer-aided maintenance management systems selection based on a fuzzy AHP approach , 2011, Adv. Eng. Softw..

[117]  Ali Azadeh,et al.  An integrated multi-criteria Taguchi computer simulation-DEA approach for optimum maintenance policy and planning by incorporating learning effects , 2013 .

[118]  Inci Batmaz,et al.  A review of data mining applications for quality improvement in manufacturing industry , 2011, Expert Syst. Appl..

[119]  Alireza Ahmadi,et al.  SELECTION OF MAINTENANCE STRATEGY FOR AIRCRAFT SYSTEMS USING MULTI-CRITERIA DECISION MAKING METHODOLOGIES , 2010 .

[120]  Konstantinos P. Triantis,et al.  Measuring dynamic efficiency of highway maintenance operations , 2015 .

[121]  Jürgen Umbrich,et al.  Quality Assessment and Evolution of Open Data Portals , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[122]  Uday Kumar,et al.  The measurement of maintenance function efficiency through financial KPIs , 2012 .

[123]  Ashraf Labib,et al.  An effective maintenance system using the analytic hierarchy process , 1998 .

[124]  M.J. Alarcon,et al.  Application of ELECTRE I Method to Restoration Actions in Telecommunication Network Maintenance , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[125]  Jian Liu,et al.  Evaluation of plant maintenance based on data envelopment analysis , 2004 .

[126]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[127]  Yashon O. Ouma,et al.  Comparison of Fuzzy AHP and Fuzzy TOPSIS for Road Pavement Maintenance Prioritization: Methodological Exposition and Case Study , 2015 .