An evolutionary generation method of deep neural network sets combined with Gaussian random field

As a research hotspot in the field of machine learning, ensemble learning improved the prediction accuracy of the final model by constructing and combining multiple basic models. In recent years, many experts and scholars are committed to combining deep networks with ensemble learning to improve the accuracy of neural network models in various scenarios and tasks. But not all neural networks are suitable for participating in the construction of ensemble models. Deep networks with ensemble learning require that the single neural network involved in the integration has high accuracy and great discrepancy with other networks. In the initial stage of deep networks with ensemble learning, the process of generating sets of candidate deep networks is first required. After studying an existing multiobjective deep belief networks ensemble (MODBNE) method, the Gaussian random field model is used as a pre-screening strategy in the process of generating the candidate deep network sets. Individuals with great potential for improvement are selected for fitness function evaluation so that a large number of neural network models with higher accuracy and the larger discrepancy between networks can be easily obtained, which effectively improves the quality of the solution and reduces the time consumed in training the neural networks.

[1]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[2]  Dingde Jiang,et al.  An Energy-Efficient Networking Approach in Cloud Services for IIoT Networks , 2020, IEEE Journal on Selected Areas in Communications.

[3]  Zhihan Lv,et al.  Big Data Analysis Based Network Behavior Insight of Cellular Networks for Industry 4.0 Applications , 2020, IEEE Transactions on Industrial Informatics.

[4]  Zhiwen Yu,et al.  Semi-Supervised Deep Coupled Ensemble Learning With Classification Landmark Exploration , 2020, IEEE Transactions on Image Processing.

[5]  Jianbo Yu,et al.  A selective deep stacked denoising autoencoders ensemble with negative correlation learning for gearbox fault diagnosis , 2019, Comput. Ind..

[6]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[7]  Junpeng Zhang,et al.  SSEM: A Novel Self-Adaptive Stacking Ensemble Model for Classification , 2019, IEEE Access.

[8]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Kathryn Kasmarik,et al.  A novel design of differential evolution for solving discrete traveling salesman problems , 2020, Swarm Evol. Comput..

[10]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Ye Tian,et al.  A Classification-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[14]  Peng Sun,et al.  A Computer-Aided Detection System for the Detection of Lung Nodules Based on 3D-ResNet , 2019, Applied Sciences.