Conditional StyleGAN modelling and analysis for a machining digital twin

Manufacturing digitalisation is a critical part of the transition towards Industry 4.0. Digital twin plays a significant role as the instrument that enables digital access to precise real-time information about physical objects and supports the optimisation of the related processes through conversion of the big data associated with them into actionable information. A number of frameworks and conceptual models has been proposed in the research literature that addresses the requirements and benefits of digital twins, yet their applications are explored to a lesser extent. A time-domain machining vibration model based on a generative adversarial network (GAN) is proposed as a digital twin component in this paper. The developed conditional StyleGAN architecture enables (1) the extraction of knowledge from existing models and (2) a data-driven simulation applicable for production process optimisation. A novel solution to the challenges in GAN analysis is then developed, where the comparison of maps of generative accuracy and sensitivity reveals patterns of similarity between these metrics. The sensitivity analysis is also extended to the mid-layer network level, identifying the sources of abnormal generative behaviour. This provides a sensitivity-based simulation uncertainty estimate, which is important for validation of the optimal process conditions derived from the proposed model.

[1]  Jing Lin,et al.  A comprehensive review on convolutional neural network in machine fault diagnosis , 2020, Neurocomputing.

[2]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[3]  Cindy Cappelle,et al.  Multi-object tracking with discriminant correlation filter based deep learning tracker , 2019, Integr. Comput. Aided Eng..

[4]  Tuğrul Özel,et al.  Process simulation using finite element method — prediction of cutting forces, tool stresses and temperatures in high-speed flat end milling , 2000 .

[5]  Bajibabu Bollepalli,et al.  Speech Waveform Synthesis from MFCC Sequences with Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Manas Bajaj,et al.  Architecture To Geometry - Integrating System Models With Mechanical Design , 2016 .

[8]  Jun Wang,et al.  An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition , 2018, Neurocomputing.

[9]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  A. Forbes.  Uncertainty associated with form assessment in coordinate metrology , 2013 .

[12]  Daniel Kirschen,et al.  Model-Free Renewable Scenario Generation Using Generative Adversarial Networks , 2017, IEEE Transactions on Power Systems.

[13]  Yusuf Altintas,et al.  An Improved Time Domain Simulation for Dynamic Milling at Small Radial Immersions , 2003 .

[14]  Svetan Ratchev,et al.  Modelling and simulation of micro-milling cutting forces , 2010 .

[15]  Michael W. Grieves,et al.  Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems , 2017 .

[16]  Alexander Verl,et al.  Online Learning of Stability Lobe Diagrams in Milling , 2018 .

[17]  Junliang Wang,et al.  AdaBalGAN: An Improved Generative Adversarial Network With Imbalanced Learning for Wafer Defective Pattern Recognition , 2019, IEEE Transactions on Semiconductor Manufacturing.

[18]  Vicente Matellán Olivera,et al.  Neural networks for recognizing human activities in home-like environments , 2018, Integr. Comput. Aided Eng..

[19]  Otmar Hilliges,et al.  Guiding InfoGAN with Semi-supervision , 2017, ECML/PKDD.

[20]  Sylvain Verron,et al.  Bridging data-driven and model-based approaches for process fault diagnosis and health monitoring: A review of researches and future challenges , 2016, Annu. Rev. Control..

[21]  László Monostori,et al.  AI and machine learning techniques for managing complexity, changes and uncertainties in manufacturing , 2003 .

[22]  Jin Wang,et al.  Statistical process monitoring as a big data analytics tool for smart manufacturing , 2017, Journal of Process Control.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  Peng Wang,et al.  Anomaly detection in milling tools using acoustic signals and generative adversarial networks , 2020, Procedia Manufacturing.

[25]  Weiming Shen,et al.  An integrated feature-based dynamic control system for on-line machining, inspection and monitoring , 2015, Integr. Comput. Aided Eng..

[26]  Manfred Weck,et al.  Chatter Stability of Metal Cutting and Grinding , 2004 .

[27]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Chris Donahue,et al.  Adversarial Audio Synthesis , 2018, ICLR.

[29]  Meng Li,et al.  GAN-SRAF: Sub-Resolution Assist Feature Generation Using Conditional Generative Adversarial Networks , 2019, 2019 56th ACM/IEEE Design Automation Conference (DAC).

[30]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[31]  Jen-Tzung Chien,et al.  Deep reinforcement learning for automated radiation adaptation in lung cancer , 2017, Medical physics.

[32]  M. A. Selles,et al.  Machining Chatter Prediction Using a Data Learning Model , 2019, Journal of Manufacturing and Materials Processing.

[33]  Nevin L. Zhang,et al.  A deep learning–based method for the design of microstructural materials , 2019, Structural and Multidisciplinary Optimization.

[34]  Oliver Niggemann,et al.  Data-Driven Monitoring of Cyber-Physical Systems Leveraging on Big Data and the Internet-of-Things for Diagnosis and Control , 2015, DX.

[35]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[36]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[37]  N. Shetty,et al.  A review on finite element method for machining of composite materials , 2017 .

[38]  Visakan Kadirkamanathan,et al.  A Bayesian framework to estimate part quality and associated uncertainties in multistage manufacturing , 2019, Comput. Ind..

[39]  Min Zheng,et al.  Data Augmentation for Intelligent Manufacturing with Generative Adversarial Framework , 2019, 2019 1st International Conference on Industrial Artificial Intelligence (IAI).

[40]  Ralph Riedel,et al.  Challenges and Requirements for the Application of Industry 4.0: A Special Insight with the Usage of Cyber-Physical System , 2017, Chinese Journal of Mechanical Engineering.

[41]  S. Shevchik,et al.  Acoustic emission for in situ quality monitoring in additive manufacturing using spectral convolutional neural networks , 2017 .

[42]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[43]  Andrew Kusiak,et al.  Convolutional and generative adversarial neural networks in manufacturing , 2019, Int. J. Prod. Res..

[44]  Duc Truong Pham,et al.  Machine-learning techniques and their applications in manufacturing , 2005 .

[45]  Divyakant Agrawal,et al.  Big data and cloud computing: current state and future opportunities , 2011, EDBT/ICDT '11.

[46]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[47]  S. Smith,et al.  An Overview of Modeling and Simulation of the Milling Process , 1991 .

[48]  Yong Li,et al.  Applying Neural-Network-Based Machine Learning to Additive Manufacturing: Current Applications, Challenges, and Future Perspectives , 2019, Engineering.

[49]  Olof Mogren,et al.  C-RNN-GAN: Continuous recurrent neural networks with adversarial training , 2016, ArXiv.

[50]  Luca Fumagalli,et al.  Flexible Automation and Intelligent Manufacturing , FAIM 2017 , 27-30 June 2017 , Modena , Italy A review of the roles of Digital Twin in CPS-based production systems , 2017 .

[51]  J. Agapiou,et al.  Machining Dynamics , 2018, Metal Cutting Theory and Practice.

[52]  Nina Narodytska,et al.  RelGAN: Relational Generative Adversarial Networks for Text Generation , 2019, ICLR.

[53]  Robert G. Wilhelm,et al.  Task Specific Uncertainty in Coordinate Measurement , 2001 .

[54]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[55]  Berend Denkena,et al.  Virtual process systems for part machining operations , 2014 .

[56]  Yang Gao,et al.  Voice Impersonation Using Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[57]  Visakan Kadirkamanathan,et al.  Towards a Digital Twin with Generative Adversarial Network Modelling of Machining Vibration , 2020, EANN.

[58]  Fei Tao,et al.  Digital twin-driven product design, manufacturing and service with big data , 2017, The International Journal of Advanced Manufacturing Technology.

[59]  Francisco Javier Vera-Olmos,et al.  DeepEye: Deep convolutional network for pupil detection in real environments , 2018, Integr. Comput. Aided Eng..

[60]  Jeff Donahue,et al.  Large Scale GAN Training for High Fidelity Natural Image Synthesis , 2018, ICLR.

[61]  Tuğrul Özel,et al.  3-D finite element process simulation of micro-end milling Ti-6Al-4V titanium alloy: Experimental validations on chip flow and tool wear , 2015 .

[62]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[63]  Bengt Lennartson,et al.  An event-driven manufacturing information system architecture for Industry 4.0 , 2017, Int. J. Prod. Res..

[64]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[65]  Dirk Abel,et al.  Surface Defect Detection for Automated Inspection Systems using Convolutional Neural Networks , 2019, 2019 27th Mediterranean Conference on Control and Automation (MED).

[66]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[67]  Kumar Krishna Agrawal,et al.  GANSynth: Adversarial Neural Audio Synthesis , 2019, ICLR.

[68]  László Monostori,et al.  Complexity in engineering design and manufacturing , 2012 .

[69]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[70]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[71]  Gunnar Rätsch,et al.  Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs , 2017, ArXiv.

[72]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[73]  Thomas Bauernhansl,et al.  Mobilizing SMEs Towards Industrie 4.0-enabled Smart Products , 2017 .

[74]  Sung-Hoon Ahn,et al.  Smart Machining Process Using Machine Learning: A Review and Perspective on Machining Industry , 2018, International Journal of Precision Engineering and Manufacturing-Green Technology.

[75]  Carlos Pardo,et al.  A machine-learning based solution for chatter prediction in heavy-duty milling machines , 2018, Measurement.

[76]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.