Machine Learning Applied to an Intelligent and Adaptive Robotic Inspection Station

Industry 4.0 promotes the use of emergent technologies, such as Internet of Things (IoT), Big Data, artificial intelligence (AI) and cloud computing, sustained by cyber-physical systems to reach smart factories. The idea is to decen-tralize the production systems and allow to reach monitoring, adaptation and optimization to be made in real time, based on the large amount of data available at shop floor that feed the use of machine learning techniques. This technological revolution will bring significant productivity gains, resources savings and reduced maintenance costs, as machines will have information to operate more efficiently, adaptable and following demand fluctuations. This paper discusses the application of supervised Machine Learning techniques allied with artificial vision, to implement an intelligent, collaborative and adaptive robotic inspection station, which carries out the quality control of Human Machine Interface (HMI) consoles, equipped with pressure buttons and LCD displays. Machine learning techniques were applied for the recognition of the operator’s face, to classify the type of HMI console to be inspected, to classify the state condition of the pressure buttons and detect anomalies in the LCD displays. The developed solution reaches promising results, with almost 100% accuracy in the correct classification of the consoles and anomalies in the pressure buttons, and also high values in the detection of defects in the LCD displays.

[1]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Ray Y. Zhong,et al.  Intelligent Manufacturing in the Context of Industry 4.0: A Review , 2017 .

[3]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  José Barbosa,et al.  Implementation of a Multi-Agent System to Support ZDM Strategies in Multi-Stage Environments , 2018, 2018 IEEE 16th International Conference on Industrial Informatics (INDIN).

[6]  Jiwen Lu,et al.  Deep Metric Learning for Visual Understanding: An Overview of Recent Advances , 2017, IEEE Signal Processing Magazine.

[7]  Oscar Déniz-Suárez,et al.  Face recognition using Histograms of Oriented Gradients , 2011, Pattern Recognit. Lett..

[8]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[9]  Dimitris Mourtzis,et al.  Digital manufacturing: History, perspectives, and outlook , 2009 .

[10]  Patrik Kamencay,et al.  A new method for face recognition using convolutional neural network , 2017 .

[11]  T. Mahalakshmi,et al.  Review Article: An Overview of Template Matching Technique in Image Processing , 2012 .

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  C. Paiva Quality Management: Important Aspects for the Food Industry , 2013 .