A Versatile Machine Vision Algorithm for Real-Time Counting Manually Assembled Pieces

The Industry 4.0 paradigm is based on transparency and co-operation and, hence, on monitoring and pervasive data collection. In highly standardized contexts, it is usually easy to gather data using available technologies, while, in complex environments, only very advanced and customizable technologies, such as Computer Vision, are intelligent enough to perform such monitoring tasks well. By the term “complex environment”, we especially refer to those contexts where human activity which cannot be fully standardized prevails. In this work, we present a Machine Vision algorithm which is able to effectively deal with human interactions inside a framed area. By exploiting inter-frame analysis, image pre-processing, binarization, morphological operations, and blob detection, our solution is able to count the pieces assembled by an operator using a real-time video input. The solution is compared with a more advanced Machine Learning-based custom object detector, which is taken as reference. The proposed solution demonstrates a very good performance in terms of Sensitivity, Specificity, and Accuracy when tested on a real situation in an Italian manufacturing firm. The value of our solution, compared with the reference object detector, is that it requires no training and is therefore extremely flexible, requiring only minor changes to the working parameters to translate to other objects, making it appropriate for plant-wide implementation.

[1]  Ali Darwich,et al.  Background Subtraction Based on a New Fuzzy Mixture of Gaussians for Moving Object Detection , 2018, J. Imaging.

[2]  Michael Sony,et al.  Industry 4.0 and lean management: a proposed integration model and research propositions , 2018 .

[3]  Valerie C. Coffey,et al.  Machine Vision: The Eyes of Industry 40 , 2018, Optics and Photonics News.

[4]  Lucia Maddalena,et al.  Background Subtraction for Moving Object Detection in RGBD Data: A Survey , 2018, J. Imaging.

[5]  Bashir Salah,et al.  Industry 4.0-Based Real-Time Scheduling and Dispatching in Lean Manufacturing Systems , 2020, Sustainability.

[6]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  B. Solvang,et al.  Multilevel control of flexible manufacturing systems , 2008, 2008 Conference on Human System Interactions.

[8]  Marizan Sulaiman,et al.  Implementation of Shape – Based Matching Vision System in Flexible Manufacturing System , 2010 .

[9]  Keyur D. Joshi,et al.  Small Parts Classification with Flexible Machine Vision and a Hybrid Classifier , 2018, 2018 25th International Conference on Mechatronics and Machine Vision in Practice (M2VIP).

[10]  János Abonyi,et al.  Enabling Technologies for Operator 4.0: A Survey , 2018, Applied Sciences.

[11]  Ivan G. Matveev,et al.  Fast Object Detection Using Dimensional Based Features for Public Street Environments , 2020 .

[12]  Muris Lage Junior,et al.  Variations of the kanban system: Literature review and classification , 2010 .

[13]  Yongkui Liu,et al.  Industry 4.0 and Cloud Manufacturing: A Comparative Analysis , 2017 .

[14]  Bernd Noche,et al.  Dynamic material flow control in mixed model assembly lines , 2015, Comput. Ind. Eng..

[15]  S. Qian,et al.  Research on Object Detection based on Mathematical Morphology , 2015, ICIT 2015.

[16]  Jayme Garcia Arnal Barbedo,et al.  A Review on Methods for Automatic Counting of Objects in Digital Images , 2012 .

[17]  Iñigo Barandiaran,et al.  Real-time automatic optical system to assist operators in the assembling of electronic components , 2020, The International Journal of Advanced Manufacturing Technology.

[18]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[19]  Benjamin Haefner,et al.  Optimization of selective assembly and adaptive manufacturing by means of cyber-physical system based matching , 2015 .

[20]  Li Fu,et al.  Research and application of machine vision in intelligent manufacturing , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[21]  Sachin S. Kamble,et al.  Sustainable Industry 4.0 framework: A systematic literature review identifying the current trends and future perspectives , 2018, Process Safety and Environmental Protection.

[22]  László Monostori,et al.  ScienceDirect Variety Management in Manufacturing . Proceedings of the 47 th CIRP Conference on Manufacturing Systems Cyber-physical production systems : Roots , expectations and R & D challenges , 2014 .

[23]  Álvaro Segura,et al.  Visual computing technologies to support the Operator 4.0 , 2020, Comput. Ind. Eng..

[24]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Arif Budiarto,et al.  An Improved Version of Texture-based Foreground Segmentation: Block-based Adaptive Segmenter , 2018 .

[26]  Didier Stricker,et al.  Graphics and Media Technologies for Operators in Industry 4.0 , 2018, IEEE Computer Graphics and Applications.