Review of tool condition monitoring in machining and opportunities for deep learning

Tool condition monitoring and machine tool diagnostics are performed using advanced sensors and computational intelligence to predict and avoid adverse conditions for cutting tools and machinery. Undesirable conditions during machining cause chatter, tool wear, and tool breakage, directly affecting the tool life and consequently the surface quality, dimensional accuracy of the machined parts, and tool costs. Tool condition monitoring is, therefore, extremely important for manufacturing efficiency and economics. Acoustic emission, vibration, power, and temperature sensors monitor the stability and efficiency of the machining process, collecting large amounts of data to detect tool wear, breakage, and chatter. Studies on monitoring the vibrations and acoustic emissions from machine tools have provided information and data regarding the detection of undesirable conditions. Herein, studies on tool condition monitoring are reviewed and classified. As Industry 4.0 penetrates all manufacturing sectors, the amount of manufacturing data generated has reached the level of big data, and classical artificial intelligence analyses are no longer adequate. Nevertheless, recent advances in deep learning methods have achieved revolutionary success in numerous industries. Deep multi-layer perceptron (DMLP), long-short-term memory (LSTM), convolutional neural network (CNN), and deep reinforcement learning (DRL) are among the most preferred methods of deep learning in recent years. As data size increases, these methods have shown promising performance improvement in prediction and learning, compared to classical artificial intelligence methods. This paper summarizes tool condition monitoring first, then presents the underlying theory of some of the most recent deep learning methods, and finally, attempts to identify new opportunities in tool condition monitoring, toward the realization of Industry 4.0.

[1]  Li Dan,et al.  Tool wear and failure monitoring techniques for turning—A review , 1990 .

[2]  B.S.N. Murthy,et al.  Cutting tool condition monitoring by analyzing surface roughness, work piece vibration and volume of metal removed for AISI 1040 steel in boring , 2013 .

[3]  Earnest Paul Ijjina,et al.  Illumination invariant face recognition using convolutional neural networks , 2015, 2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES).

[4]  Sohyung Cho,et al.  Tool breakage detection using support vector machine learning in a milling process , 2005 .

[5]  David Reitter,et al.  Learning Simpler Language Models with the Delta Recurrent Neural Network Framework , 2017, ArXiv.

[6]  M. T. Telsang,et al.  Real Time Tool Wear Condition Monitoring in Hard Turning of Inconel 718 Using Sensor Fusion System , 2017 .

[7]  Pranav Gokhale,et al.  Applications of Convolutional Neural Networks , 2016 .

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  Yang Hu,et al.  Fault diagnostics between different type of components: A transfer learning approach , 2020, Appl. Soft Comput..

[10]  Shang-Liang Chen,et al.  Data fusion neural network for tool condition monitoring in CNC milling machining , 2000 .

[11]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[12]  Gérard-André Capolino,et al.  Advances in Electrical Machine, Power Electronic, and Drive Condition Monitoring and Fault Detection: State of the Art , 2015, IEEE Transactions on Industrial Electronics.

[13]  James Griffin,et al.  Multiple classification of the force and acceleration signals extracted during multiple machine processes: part 1 intelligent classification from an anomaly perspective , 2017 .

[14]  Surjya K. Pal,et al.  Tool Condition Monitoring in Turning by Applying Machine Vision , 2016 .

[15]  Francesco Napolitano,et al.  Dimensionality Reduction of Sensorial Features by Principal Component Analysis for ANN Machine Learning in Tool Condition Monitoring of CFRP Drilling , 2018 .

[16]  Barry K. Fussell,et al.  Real-time tool wear monitoring in milling using a cutting condition independent method , 2015 .

[17]  Carlos Henrique Lauro,et al.  Monitoring and processing signal applied in machining processes – A review , 2014 .

[18]  Sebastian Ramos,et al.  Detecting unexpected obstacles for self-driving cars: Fusing deep learning and geometric modeling , 2016, 2017 IEEE Intelligent Vehicles Symposium (IV).

[19]  N. R. Sakthivel,et al.  Tool condition monitoring techniques in milling process — a review , 2020 .

[20]  Zhiqiang Chen,et al.  Deep neural networks-based rolling bearing fault diagnosis , 2017, Microelectron. Reliab..

[21]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Devesh Pratap Singh,et al.  A Comprehensive Study of Big Data Machine Learning Approaches and Challenges , 2017, 2017 International Conference on Next Generation Computing and Information Systems (ICNGCIS).

[24]  Zhiqiang Chen,et al.  Rolling bearing fault diagnosis based on Deep Boltzmann machines , 2016, 2016 Prognostics and System Health Management Conference (PHM-Chengdu).

[25]  Marc Thomas,et al.  Tool condition monitoring using spectral subtraction and convolutional neural networks in milling process , 2018, The International Journal of Advanced Manufacturing Technology.

[26]  Ming-Chyuan Lu,et al.  Application of backpropagation neural network for spindle vibration-based tool wear monitoring in micro-milling , 2011, The International Journal of Advanced Manufacturing Technology.

[27]  Julian Padget,et al.  Multi-sensor data fusion framework for CNC machining monitoring , 2016 .

[28]  Min Peng,et al.  Face recognition from near-infrared images with convolutional neural network , 2016, 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP).

[29]  Norbert Michael Mayer Echo State Condition at the Critical Point , 2017, Entropy.

[30]  Vishal Wayal,et al.  Tool Condition Monitoring System: A Review , 2015 .

[31]  M. F. DeVries,et al.  Neural Network Sensor Fusion for Tool Condition Monitoring , 1990 .

[32]  Dragos Axinte,et al.  A critical analysis of effectiveness of acoustic emission signals to detect tool and workpiece malfunctions in milling operations , 2008 .

[33]  Jose Vicente Abellan-Nebot,et al.  A review of machining monitoring systems based on artificial intelligence process models , 2010 .

[34]  Erdogan Dogdu,et al.  MIS-IoT: Modular Intelligent Server Based Internet of Things Framework with Big Data and Machine Learning , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[35]  Hongmei Liu,et al.  Rolling Bearing Fault Diagnosis Based on STFT-Deep Learning and Sound Signals , 2016 .

[36]  Ratko Obradovic,et al.  Novel texture-based descriptors for tool wear condition monitoring , 2018 .

[37]  D. E. Dimla,et al.  On-line metal cutting tool condition monitoring.: II: tool-state classification using multi-layer perceptron neural networks , 2000 .

[38]  Robert Lewis Reuben,et al.  Development of a system for monitoring tool wear using artificial intelligence techniques , 2001, Dynamic Systems and Control.

[39]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[40]  Hermann Ney,et al.  From Feedforward to Recurrent LSTM Neural Networks for Language Modeling , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[41]  Ichiro Inasaki,et al.  Tool Condition Monitoring (TCM) — The Status of Research and Industrial Application , 1995 .

[42]  Wei Xue,et al.  Review of tool condition monitoring methods in milling processes , 2018 .

[43]  Weidong Li,et al.  A multi-sensor based online tool condition monitoring system for milling process , 2018 .

[44]  David Dornfeld,et al.  Sensor Integration Using Neural Networks for Intelligent Tool Condition Monitoring , 1990 .

[45]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[46]  Steven Y. Liang,et al.  Machining Process Monitoring and Control: The State–of–the–Art , 2002 .

[47]  Peng Wang,et al.  Temporal Pyramid Pooling-Based Convolutional Neural Network for Action Recognition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Myeongsuk Pak,et al.  A review of deep learning in image recognition , 2017, 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT).

[50]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[51]  Pavlo Molchanov,et al.  Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Yang Zhang,et al.  Sequence-to-sequence prediction of personal computer software by recurrent neural network , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[53]  Giulio Paci,et al.  A Multi-scale Approach to Gesture Detection and Recognition , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[54]  Che Hassan Che Haron,et al.  Online tool wear prediction system in the turning process using an adaptive neuro-fuzzy inference system , 2013, Appl. Soft Comput..

[55]  Lixiang Duan,et al.  Multisensory fusion based virtual tool wear sensing for ubiquitous manufacturing , 2017 .

[56]  Roshun Paurobally,et al.  A review of flank wear prediction methods for tool condition monitoring in a turning process , 2012, The International Journal of Advanced Manufacturing Technology.

[57]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[58]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[59]  Jin Jiang,et al.  Erratum to: State-of-the-art methods and results in tool condition monitoring: a review , 2005 .

[60]  Mohammad Teshnehlab,et al.  Face Recognition Using Convolutional Neural Network and Simple Logistic Classifier , 2014 .

[61]  Ramón Quiza,et al.  Comparing statistical models and artificial neural networks on predicting the tool wear in hard machining D2 AISI steel , 2008 .

[62]  Connor Jennings,et al.  Cloud-Based Parallel Machine Learning for Tool Wear Prediction , 2018 .

[63]  Pichao Wang,et al.  Large-scale Isolated Gesture Recognition using Convolutional Neural Networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[64]  Xilin Chen,et al.  Two streams Recurrent Neural Networks for Large-Scale Continuous Gesture Recognition , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[65]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[66]  James Griffin,et al.  Multiple classification of the force and acceleration signals extracted during multiple machine processes: part 2 intelligent control simulation perspective , 2017, The International Journal of Advanced Manufacturing Technology.

[67]  Mohd. Zaki Nuawi,et al.  Monitoring online cutting tool wear using low-cost technique and user-friendly GUI , 2011 .

[68]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[69]  Sandeep Paul,et al.  A review on advances in deep learning , 2015, 2015 IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI).

[70]  Krzysztof Jemielniak,et al.  Advanced monitoring of machining operations , 2010 .

[71]  Roger Serra,et al.  Detection process approach of tool wear in high speed milling , 2010 .

[72]  K. Abou-El-Hossein,et al.  Tool life estimation based on acoustic emission monitoring in end-milling of H13 mould-steel , 2015 .

[73]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[74]  David Dornfeld,et al.  Integrated vibration and acoustic data fusion for chatter and tool condition classification in milling , 2016, 2016 International Symposium on Flexible Automation (ISFA).

[75]  A. Murat Ozbayoglu,et al.  Estimation of parameters for the free-form machining with deep neural network , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[76]  Min-Yuh Day,et al.  Deep Learning for Sentiment Analysis on Google Play Consumer Review , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[77]  Ihsan Korkut,et al.  Application of regression and artificial neural network analysis in modelling of tool-chip interface temperature in machining , 2011, Expert Syst. Appl..

[78]  Rui Liu,et al.  Application of audible sound signals for tool wear monitoring using machine learning techniques in end milling , 2017, The International Journal of Advanced Manufacturing Technology.

[79]  Bernhard Sick,et al.  ON-LINE AND INDIRECT TOOL WEAR MONITORING IN TURNING WITH ARTIFICIAL NEURAL NETWORKS: A REVIEW OF MORE THAN A DECADE OF RESEARCH , 2002 .

[80]  Jeong-Du Kim,et al.  Development of a tool failure detection system using multi-sensors , 1996 .

[81]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[82]  C H Srinivasa Rao,et al.  Online prediction of diffusion wear on the flank through tool tip temperature in turning using artificial neural networks , 2006 .

[83]  Tuğrul Özel,et al.  Predictive modeling of surface roughness and tool wear in hard turning using regression and neural networks , 2005 .

[84]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[85]  Yuxuan Chen,et al.  Predicting tool wear with multi-sensor data using deep belief networks , 2018, The International Journal of Advanced Manufacturing Technology.

[86]  Stefan Wermter,et al.  Gesture Recognition with a Convolutional Long Short-Term Memory Recurrent Neural Network , 2016, ESANN.

[87]  Xifan Yao,et al.  Tool Condition Monitoring and Remaining Useful Life Prognostic Based on a Wireless Sensor in Dry Milling Operations , 2016, Sensors.

[88]  Xiaoli Li,et al.  A brief review: acoustic emission method for tool wear monitoring during turning , 2002 .

[89]  Krzysztof Jemielniak,et al.  Sensor Signal Segmentation for Tool Condition Monitoring , 2016 .

[90]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[91]  Laine Mears,et al.  Quality and inspection of machining operations: Tool condition monitoring , 2010 .

[92]  Hongkai Jiang,et al.  An adaptive deep convolutional neural network for rolling bearing fault diagnosis , 2017 .

[93]  Robert X. Gao,et al.  A Deep Learning Approach for Fault Diagnosis of Induction Motors in Manufacturing , 2017, Chinese Journal of Mechanical Engineering.

[94]  Wei Zhang,et al.  Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation , 2018, Journal of Intelligent Manufacturing.

[95]  N. R. Sakthivel,et al.  Multi component fault diagnosis of rotational mechanical system based on decision tree and support vector machine , 2011, Expert Syst. Appl..

[96]  Ronglei Sun,et al.  Automatic feature constructing from vibration signals for machining state monitoring , 2019, J. Intell. Manuf..

[97]  Wafaa Rmili,et al.  An automatic system based on vibratory analysis for cutting tool wear monitoring , 2016 .

[98]  Diego Cabrera,et al.  Fault Diagnosis for Rotating Machinery Using Vibration Measurement Deep Statistical Feature Learning , 2016, Sensors.

[99]  R. Krishnamurthy,et al.  In-process tool wear and chip-form monitoring in face milling operation using acoustic emission. , 1994 .

[100]  Rui Liu,et al.  Audio-Based Condition Monitoring in Milling of the Workpiece Material With the Hardness Variation Using Support Vector Machines and Convolutional Neural Networks , 2018 .