Cost-sensitive optimization of automated inspection

Automated inspection plays a critical role in many industrial processes, including modern assembly lines. In these processes, components are inspected to ensure adherence to design specifications. Components that are determined to be out-of-specifications are rejected. The benefits of inspection are two-fold. First, defects can be removed early in the process, preventing higher costs incurred in detecting them downstream. Second, the inspection results provide information for manual troubleshooting of root-causes, potentially leading to an improvement in overall quality. However, this form of inspection may also incurs costs if there are false alarms associated with the automated inspection method. Analysis of false alarm costs are rarely addressed in the data mining literature. In this paper, we develop a simple framework to estimate the value of an inspection process, and demonstrate how predictive modeling can be used to increase this value under the right circumstances. In the second part of the paper, we report results from a case-study at a Bosch manufacturing plant, involving tens of thousands of parts and hundreds of quality attributes. A key challenge in this study was the extremely low rate of defects resulting from the operation of a highly-optimized manufacturing process. We show that for such modern assembly lines, machine learning techniques that are robust to class imbalance are particularly well suited. The solution from the case-study yields a positive ROI for the manufacturing plant.

[1]  Damminda Alahakoon,et al.  Minority report in fraud detection: classification of skewed data , 2004, SKDD.

[2]  Peter S. Pande,et al.  The Six Sigma Way: How GE, Motorola, and Other Top Companies are Honing Their Performance , 2000 .

[3]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[4]  Concha Bielza,et al.  Comparison of Bayesian networks and artificial neural networks for quality detection in a machining process , 2009, Expert Syst. Appl..

[5]  Richard D. Shainin.  STRATEGIES FOR TECHNICAL PROBLEM SOLVING , 1993 .

[6]  Mahmoud El-Banna,et al.  A novel approach for classifying imbalance welding data: Mahalanobis genetic algorithm (MGA) , 2014, The International Journal of Advanced Manufacturing Technology.

[7]  László Monostori,et al.  Machine Learning Approaches to Manufacturing , 1996 .

[8]  Stefan H. Steiner,et al.  An Overview of the Shainin System™ for Quality Improvement , 2007 .

[9]  Mohammad Khalilia,et al.  Predicting disease risks from highly imbalanced data using random forest , 2011, BMC Medical Informatics Decis. Mak..

[10]  田口 玄一,et al.  System of experimental design : engineering methods to optimize quality and minimize costs , 1987 .

[11]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[12]  Adam Kowalczyk,et al.  Extreme re-balancing for SVMs: a case study , 2004, SKDD.

[13]  Victor A. Skormin,et al.  Data mining technology for failure prognostic of avionics , 2002 .

[14]  Dirk Van den Poel,et al.  Handling class imbalance in customer churn prediction , 2009, Expert Syst. Appl..

[15]  Nitesh V. Chawla,et al.  Editorial: special issue on learning from imbalanced data sets , 2004, SKDD.

[16]  Han Tong Loh,et al.  Imbalanced text classification: A term weighting approach , 2009, Expert Syst. Appl..

[17]  Xin Yao,et al.  Using Class Imbalance Learning for Software Defect Prediction , 2013, IEEE Transactions on Reliability.

[18]  John Langford,et al.  Cost-sensitive learning by cost-proportionate example weighting , 2003, Third IEEE International Conference on Data Mining.

[19]  Manoj Kumar Tiwari,et al.  Data mining in manufacturing: a review based on the kind of knowledge , 2009, J. Intell. Manuf..

[20]  J. Douglas Barrett,et al.  Taguchi's Quality Engineering Handbook , 2007, Technometrics.

[21]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[22]  Taghi M. Khoshgoftaar,et al.  Improving Software-Quality Predictions With Data Sampling and Boosting , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Salvatore J. Stolfo,et al.  Toward Cost-Sensitive Modeling for Intrusion Detection and Response , 2002, J. Comput. Secur..

[24]  Zhi-Hua Zhou,et al.  Exploratory Undersampling for Class-Imbalance Learning , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Yan Li,et al.  Application to Car Quality Evaluation Using Decision Tree Technology with Imbalance Correction Coefficient , 2013 .

[26]  Taghi M. Khoshgoftaar,et al.  RUSBoost: A Hybrid Approach to Alleviating Class Imbalance , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[28]  Thomas Pyzdek,et al.  The Six Sigma handbook : a complete guide for green belts, black belts, and managers at all levels , 2014 .