Digital twin-driven supervised machine learning for the development of artificial intelligence applications in manufacturing

ABSTRACT Digital Twin (DT) implementations can contribute to smart manufacturing by integrating the physical and the cyber space. Artificial Intelligence (AI) applications based on Machine Learning (ML) are widely accepted as promising technologies in manufacturing. However, ML methods require large volumes of quality training datasets and in the case of supervised ML, manual input is usually required for labelling those datasets. Such an approach is expensive, prone to errors and labour as well as time-intensive, especially in a highly complex and dynamic production environment. DT models can be utilized for accelerating the training phase in ML by creating suitable training datasets as well as by automatic labelling via the simulation tools chain and thus alleviating user’s involvement during training. These synthetic datasets can be enhanced and cross-validated with real-world information which is not required to be extensive. A framework for implementing the proposed DT-driven approach for developing ML models is presented. The proposed framework has been implemented in an industrially relevant use case. The use case has provided evidence that the proposed concept can be used for training vision-based recognition of parts’ orientation using simulation of DT models, which in turn can be used for adaptively controlling the production process.

[1]  Franz Dietrich,et al.  A Machine Learning-Enhanced Digital Twin Approach for Human-Robot-Collaboration , 2018 .

[2]  Varun Jampani,et al.  Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  George Chryssolouris,et al.  The digital twin implementation for linking the virtual representation of human-based production tasks to their physical counterpart in the factory-floor , 2018, Int. J. Comput. Integr. Manuf..

[4]  László Monostori,et al.  AI and machine learning techniques for managing complexity, changes and uncertainties in manufacturing , 2003 .

[5]  Dimitris Kiritsis,et al.  Deep learning for big data applications in CAD and PLM - Research review, opportunities and case study , 2018, Comput. Ind..

[6]  Qiao Wang,et al.  VirtualWorlds as Proxy for Multi-object Tracking Analysis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Matthias Klusch,et al.  Digital reality: a model-based approach to supervised learning from synthetic data , 2019, AI Perspectives.

[8]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Meng Zhang,et al.  Digital Twin Shop-Floor: A New Shop-Floor Paradigm Towards Smart Manufacturing , 2017, IEEE Access.

[11]  Bo Lu,et al.  Image-based manufacturing analytics: Improving the accuracy of an industrial pellet classification system using deep neural networks , 2018, Chemometrics and Intelligent Laboratory Systems.

[12]  He Zhang,et al.  Digital Twin in Industry: State-of-the-Art , 2019, IEEE Transactions on Industrial Informatics.

[13]  László Monostori,et al.  ScienceDirect Variety Management in Manufacturing . Proceedings of the 47 th CIRP Conference on Manufacturing Systems Cyber-physical production systems : Roots , expectations and R & D challenges , 2014 .

[14]  George Michalos,et al.  A Machine Learning Approach for Visual Recognition of Complex Parts in Robotic Manipulation , 2017 .

[15]  Abe Zeid,et al.  Solving large scale disassembly line balancing problem with uncertainty using reinforcement learning , 2014, J. Intell. Manuf..

[16]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[17]  Wojciech Zaremba,et al.  Domain randomization for transferring deep neural networks from simulation to the real world , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Jamal Shahrabi,et al.  A reinforcement learning approach to parameter estimation in dynamic job shop scheduling , 2017, Comput. Ind. Eng..

[19]  Jürgen Schmidhuber,et al.  Steel defect classification with Max-Pooling Convolutional Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[20]  Dimitris Mourtzis,et al.  Digital manufacturing: History, perspectives, and outlook , 2009 .

[21]  Sotiris Makris,et al.  An industrial Internet of things based platform for context-aware information services in manufacturing , 2018, Int. J. Comput. Integr. Manuf..

[22]  Roland Rosen,et al.  About The Importance of Autonomy and Digital Twins for the Future of Manufacturing , 2015 .

[23]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[24]  Horacio Ahuett-Garza,et al.  A brief discussion on the trends of habilitating technologies for Industry 4.0 and Smart manufacturing , 2018 .

[25]  Xiaojun Liu,et al.  Dynamic Evaluation Method of Machining Process Planning Based on Digital Twin , 2019, IEEE Access.

[26]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[27]  Ronay Ak,et al.  A Survey of the Advancing Use and Development of Machine Learning in Smart Manufacturing. , 2018, Journal of manufacturing systems.

[28]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).