Using ensemble and metaheuristics learning principles with artificial neural networks to improve due date prediction performance

One of the common and important problems in production scheduling is to quote an attractive but attainable due date for an arriving customer order. Among a wide variety of prediction methods proposed to improve due date quotation (DDQ) accuracy, artificial neural networks (ANN) are considered the most effective because of their flexible non-linear and interaction effects modelling capability. In spite of this growing use of ANNs in a DDQ context, ANNs have several intrinsic shortcomings such as instability, bias and variance problems that undermine their accuracy. In this paper, we develop an enhanced ANN-based DDQ model using machine learning, evolutionary and metaheuristics learning concepts. Computational experiments suggest that the proposed model outperforms the conventional ANN-based DDQ method under different shop environments and different training data sizes.

[1]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[2]  David P. Helmbold,et al.  Leveraging for Regression , 2000, COLT.

[3]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[4]  Shao-Chung Hsu,et al.  Due date assignment using artificial neural networks under different shop floor control strategies , 2004 .

[5]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[6]  D. Y. Sha,et al.  Using Data Mining for Due Date Assignment in a Dynamic Job Shop Environment , 2005 .

[7]  G. Ragatz,et al.  A simulation analysis of due date assignment rules , 1984 .

[8]  Stephen A. Billings,et al.  Properties of neural networks with applications to modelling non-linear dynamical systems , 1992 .

[9]  S. Tayur,et al.  Due Date Management Policies , 2004 .

[10]  Raymond J. Mooney,et al.  Combining Bias and Variance Reduction Techniques for Regression Trees , 2005, ECML.

[11]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[12]  T.C.E. Cheng,et al.  Survey of scheduling research involving due date determination decisions , 1989 .

[13]  Ihsan Sabuncuoglu,et al.  Operation-based flowtime estimation in a dynamic job shop , 2002 .

[14]  Randall S. Sexton,et al.  Improving Decision Effectiveness of Artificial Neural Networks: A Modified Genetic Algorithm Approach , 2003, Decis. Sci..

[15]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[16]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[17]  Panayiotis E. Pintelas,et al.  Combining Bagging and Boosting , 2007 .

[18]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[19]  S. Hsu,et al.  Due-date assignment in wafer fabrication using artificial neural networks , 2004 .

[20]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[21]  Godwin J. Udo,et al.  Neural networks applications in manufacturing processes , 1992 .

[22]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[23]  Tapan Sen,et al.  A state-of-art survey of static scheduling research involving due dates , 1984 .

[24]  Jerome H. Friedman,et al.  Recent Advances in Predictive (Machine) Learning , 2006, J. Classif..

[25]  Loren Paul Rees,et al.  Using Neural Networks to Determine Internally-Set Due-Date Assignments for Shop Scheduling* , 1994 .

[26]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[27]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[28]  L. P. Rees,et al.  Cost‐based due‐date assignment with the use of classical and neural‐network approaches , 1997 .

[29]  J. Friedman.  Stochastic gradient boosting , 2002 .

[30]  Cl Huang,et al.  The construction of production performance prediction system for semiconductor manufacturing with artificial neural networks , 1999 .