A Novel Hybrid Machine Learning Algorithm for Limited and Big Data Modeling With Application in Industry 4.0

To meet the challenges of manufacturing smart products, the manufacturing plants have been radically changed to become smart factories underpinned by industry 4.0 technologies. The transformation is assisted by employment of machine learning techniques that can deal with modeling both big or limited data. This manuscript reviews these concepts and present a case study that demonstrates the use of a novel intelligent hybrid algorithms for Industry 4.0 applications with limited data. In particular, an intelligent algorithm is proposed for robust data modeling of nonlinear systems based on input-output data. In our approach, a novel hybrid data-driven combining the Group-Method of Data-Handling and Singular-Value Decomposition is adapted to find an offline deterministic model combined with Pareto multi-objective optimization to overcome the overfitting issue. An Unscented-Kalman-Filter is also incorporated to update the coefficient of the deterministic model and increase its robustness against data uncertainties. The effectiveness of the proposed method is examined on a set of real industrial measurements.

[1]  Yi Li,et al.  Gaussian Process Regression With Automatic Relevance Determination Kernel for Calendar Aging Prediction of Lithium-Ion Batteries , 2020, IEEE Transactions on Industrial Informatics.

[2]  Yifan Gong,et al.  Restructuring of deep neural network acoustic models with singular value decomposition , 2013, INTERSPEECH.

[3]  M. Naebe,et al.  PAN precursor fabrication, applications and thermal stabilization process in carbon fiber production: Experimental and mathematical modelling , 2020 .

[4]  J. Paulo. Davim,et al.  Design of Experiments in Production Engineering , 2016 .

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[7]  A. Milani,et al.  Big Data Modeling Approaches for Engineering Applications , 2019, Nonlinear Approaches in Engineering Applications.

[8]  Athanasios V. Vasilakos,et al.  A Manufacturing Big Data Solution for Active Preventive Maintenance , 2017, IEEE Transactions on Industrial Informatics.

[9]  Tapani Raiko,et al.  Tkk Reports in Information and Computer Science Practical Approaches to Principal Component Analysis in the Presence of Missing Values Tkk Reports in Information and Computer Science Practical Approaches to Principal Component Analysis in the Presence of Missing Values , 2022 .

[10]  Saeed Sharifian,et al.  A hybrid wavelet decomposer and GMDH-ELM ensemble model for Network function virtualization workload forecasting in cloud computing , 2020, Appl. Soft Comput..

[11]  Torsten Wik,et al.  Charging Pattern Optimization for Lithium-Ion Batteries With an Electrothermal-Aging Model , 2018, IEEE Transactions on Industrial Informatics.

[12]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Bengt Andersson,et al.  Mathematical Modeling in Chemical Engineering , 2014 .

[14]  Hamid Khayyam,et al.  Limited Data Modelling Approaches for Engineering Applications , 2018 .

[15]  Kuldip K. Paliwal,et al.  Linear discriminant analysis for the small sample size problem: an overview , 2014, International Journal of Machine Learning and Cybernetics.

[16]  Abbas S. Milani,et al.  Support vector regression modelling and optimization of energy consumption in carbon fiber production line , 2018, Comput. Chem. Eng..

[17]  Hamid Khayyam,et al.  Adaptive intelligent energy management system of plug-in hybrid electric vehicle , 2014 .

[18]  Hao Yu,et al.  Selection of Proper Neural Network Sizes and Architectures—A Comparative Study , 2012, IEEE Transactions on Industrial Informatics.

[19]  Kan Wang,et al.  Control rod position reconstruction based on K-Nearest Neighbor Method , 2017 .

[20]  Xinyu Shao,et al.  An on-line variable fidelity metamodel assisted Multi-objective Genetic Algorithm for engineering design optimization , 2018, Appl. Soft Comput..

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Bernhard Sendhoff,et al.  Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Joeri Van Mierlo,et al.  Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review , 2019, Renewable and Sustainable Energy Reviews.

[24]  Ali Jamali,et al.  A multi-objective differential evolution approach based on ε-elimination uniform-diversity for mechanism design , 2015 .

[25]  Hamid Khayyam,et al.  Dynamic Prediction Models and Optimization of Polyacrylonitrile (PAN) Stabilization Processes for Production of Carbon Fiber , 2015, IEEE Transactions on Industrial Informatics.

[26]  Kang Li,et al.  Data-Driven Hybrid Internal Temperature Estimation Approach for Battery Thermal Management , 2018, Complex..

[27]  Rammohan Mallipeddi,et al.  Multi-objective differential evolution algorithm with fuzzy inference-based adaptive mutation factor for Pareto optimum design of suspension system , 2020, Swarm Evol. Comput..

[28]  Hamid Khayyam,et al.  Stochastic optimization models for energy management in carbonization process of carbon fiber production , 2015 .

[29]  Li Yao,et al.  Argumentation Based Joint Learning: A Novel Ensemble Learning Approach , 2015, PloS one.

[30]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[31]  Abbas S. Milani,et al.  A comprehensive chemical model for the preliminary steps of the thermal stabilization process in a carbon fibre manufacturing line , 2018 .

[32]  Liping Zhao,et al.  WITHDRAWN: A Review of Machine Learning Algorithms for Identification and Classification of Non-Functional Requirements , 2019, Expert Systems with Applications.

[33]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[34]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[35]  Abbas S. Milani,et al.  A multi-objective Gaussian process approach for optimization and prediction of carbonization process in carbon fiber production under uncertainty , 2019, Advanced Composites and Hybrid Materials.

[36]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[37]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[38]  Abbas S. Milani,et al.  A machine learning case study with limited data for prediction of carbon fiber mechanical properties , 2019, Comput. Ind..

[39]  Minoo Naebe,et al.  Multi-Objective Optimization of Manufacturing Process in Carbon Fiber Industry Using Artificial Intelligence Techniques , 2019, IEEE Access.

[40]  Abbas S. Milani,et al.  Predictive modelling and optimization of carbon fiber mechanical properties through high temperature furnace , 2017 .

[41]  Manish Varma Datla.  Bench marking of classification algorithms: Decision Trees and Random Forests - a case study using R , 2015, 2015 International Conference on Trends in Automation, Communications and Computing Technology (I-TACT-15).

[42]  Nader Nariman-Zadeh,et al.  Probability of failure for uncertain control systems using neural networks and multi-objective uniform-diversity genetic algorithms (MUGA) , 2013, Eng. Appl. Artif. Intell..

[43]  Reza N. Jazar,et al.  Genetic Programming Approaches in Design and Optimization of Mechanical Engineering Applications , 2019, Nonlinear Approaches in Engineering Applications.

[44]  Datong Liu,et al.  Lithium-ion battery remaining useful life estimation with an optimized Relevance Vector Machine algorithm with incremental learning , 2015 .

[45]  Yi Li,et al.  Modified Gaussian Process Regression Models for Cyclic Capacity Prediction of Lithium-Ion Batteries , 2019, IEEE Transactions on Transportation Electrification.

[46]  Abbas S. Milani,et al.  Production of Low Cost Carbon-Fiber through Energy Optimization of Stabilization Process , 2018, Materials.