Data Augmentation for Intelligent Manufacturing with Generative Adversarial Framework

The global economy is greatly shaped by the unprecedented booming of ICT and artificial intelligence technologies. Their applications in manufacturing has led to the advent of intelligent manufacturing and industry 4.0. Data has become a precious asset for modern industry. This paper first introduces an energy monitoring and data acquisition system namely the Point Energy Technology, which has been developed by the team and installed in several industrial partners, including a local bakery. The lack of data always exists due to various reasons, such as measurement or transmission errors at data collection and transmission stage, leading to the loss of varied length of data samples that are key for process monitoring and control. To solve this problem, we introduce a generative adversarial framework which is based on a game theory for data augmentation. This framework consists of two multilayer perceptron networks, namely generator and discriminator. An improved framework with Q-net that extracts the latent variables from real data is also proposed, in which the Q-net shares the structure with discriminator except for the last layer. In addition, the two optimization methods, namely mini-batch gradient descent and adaptive moment estimation are adopted to tune the parameters. To evaluate the performance of these algorithms, energy consumption data collected from a bakery process is used in the experiment. The experimental results confirm that the latent generative adversarial framework with adaptive moment estimation could generate good quality data samples to compensate the random loss of samples in time series data.

[1]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[2]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[3]  Geoffrey P. Hammond,et al.  Enabling technologies for industrial energy demand management , 2008 .

[4]  R. Perera Research methods journal club: a gentle introduction to imputation of missing values , 2008, Evidence-based medicine.

[5]  Yu Hen Hu,et al.  Maximum likelihood multiple-source localization using acoustic energy measurements with wireless sensor networks , 2005, IEEE Transactions on Signal Processing.

[6]  David Barber,et al.  The IM algorithm: a variational approach to Information Maximization , 2003, NIPS 2003.

[7]  Jinde Cao,et al.  Normalization and Solvability of Dynamic-Algebraic Boolean Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Paul W. Griffin,et al.  Industrial energy use and carbon emissions reduction: a UK perspective , 2016 .

[9]  Craig K. Enders,et al.  A Primer on Maximum Likelihood Algorithms Available for Use With Missing Data , 2001 .

[10]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[11]  Otmar Hilliges,et al.  Guiding InfoGAN with Semi-supervision , 2017, ECML/PKDD.

[12]  Patrick Royston,et al.  Multiple Imputation of Missing Values: Update of Ice , 2005 .

[13]  Paul D. Allison,et al.  Handling Missing Data by Maximum Likelihood , 2012 .

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[17]  John Kline,et al.  Power modeling for an industrial installation , 2017, 2017 IEEE-IAS/PCA Cement Industry Technical Conference.

[18]  B. Sturm,et al.  Energy efficiency, carbon emissions, and measures towards their improvement in the food and beverage sector for six European countries , 2016 .

[19]  O. V. Ekechukwu,et al.  Optimization of energy and manpower requirements in Nigerian bakeries. , 2011 .

[20]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[21]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[22]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[23]  Manuel Rizzo,et al.  SMEs finance and bankruptcies: The role of credit guarantee schemes in the UK , 2018 .

[24]  Jun Guo,et al.  The Role of Data Analysis in the Development of Intelligent Energy Networks , 2017, IEEE Network.

[25]  Amos J. Storkey,et al.  Data Augmentation Generative Adversarial Networks , 2017, ICLR 2018.

[26]  Craig K. Enders,et al.  The Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models , 2001 .

[27]  Raed Mesleh,et al.  Quadrature Spatial Modulation , 2015, IEEE Transactions on Vehicular Technology.