Fast Blob and Air Line Defects Detection for High Speed Glass Tube Production Lines

During the production of pharmaceutical glass tubes, a machine-vision based inspection system can be utilized to perform the high-quality check required by the process. The necessity to improve detection accuracy, and increase production speed determines the need for fast solutions for defects detection. Solutions proposed in literature cannot be efficiently exploited due to specific factors that characterize the production process. In this work, we have derived an algorithm that does not change the detection quality compared to state-of-the-art proposals, but does determine a drastic reduction in the processing time. The algorithm utilizes an adaptive threshold based on the Sigma Rule to detect blobs, and applies a threshold to the variation of luminous intensity along a row to detect air lines. These solutions limit the detection effects due to the tube’s curvature, and rotation and vibration of the tube, which characterize glass tube production. The algorithm has been compared with state-of-the-art solutions. The results demonstrate that, with the algorithm proposed, the processing time of the detection phase is reduced by 86%, with an increase in throughput of 268%, achieving greater accuracy in detection. Performance is further improved by adopting Region of Interest reduction techniques. Moreover, we have developed a tuning procedure to determine the algorithm’s parameters in the production batch change. We assessed the performance of the algorithm in a real environment using the “certification” functionality of the machine. Furthermore, we observed that out of 1000 discarded tubes, nine should not have been discarded and a further seven should have been discarded.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  T. Kurfess,et al.  Automatic thresholding for defect detection by background histogram mode extents , 2015 .

[3]  In-So Kweon,et al.  Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones , 2016, IEEE Transactions on Industrial Informatics.

[4]  Di Li,et al.  Defect inspection and extraction of the mobile phone cover glass based on the principal components analysis , 2014 .

[5]  Davud Asemani,et al.  Surface defect detection in tiling Industries using digital image processing methods: analysis and evaluation. , 2014, ISA transactions.

[6]  Rashmi,et al.  Algorithm and Technique on Various Edge Detection : A Survey , 2013 .

[7]  Pierfrancesco Foglia,et al.  Algorithms for the Detection of Blob Defects in High Speed Glass Tube Production Lines , 2019, 2019 IEEE 8th International Workshop on Advances in Sensors and Interfaces (IWASI).

[8]  J. Keurentjes,et al.  Bubble formation in co-fed gas–liquid flows in a rotor-stator spinning disc reactor , 2016 .

[9]  J. Gómez Ortega,et al.  An industrial vision system for surface quality inspection of transparent parts , 2013, The International Journal of Advanced Manufacturing Technology.

[10]  R. Schaut,et al.  Historical Review of Glasses Used for Parenteral Packaging , 2017, PDA Journal of Pharmaceutical Science and Technology.

[11]  Pierfrancesco Foglia,et al.  Row-level algorithm to improve real-time performance of glass tube defect detection in the production phase , 2020, IET Image Process..

[12]  Yaonan Wang,et al.  Machine vision based defect detection system for oral liquid vial , 2018, 2018 13th World Congress on Intelligent Control and Automation (WCICA).

[13]  Zude Zhou,et al.  An online defects inspection method for float glass fabrication based on machine vision , 2008 .

[14]  Hamid A. Jalab,et al.  Defect detection based on extreme edge of defective region histogram , 2018, J. King Saud Univ. Comput. Inf. Sci..

[15]  Pierfrancesco Foglia,et al.  A pre-processing technique to decrease inspection time in glass tube production lines , 2021, IET Image Process..

[16]  William A. Lee,et al.  Glass Vials for Small Volume Parenterals: Influence of Drug and Manufacturing Processes on Glass Delamination , 2001, Pharmaceutical development and technology.

[17]  S. Farid,et al.  Application of Niblack's method on images , 2009, 2009 International Conference on Emerging Technologies.

[18]  Pierfrancesco Foglia,et al.  Exploiting replication to improve performances of NUCA-based CMP systems , 2014, ACM Trans. Embed. Comput. Syst..

[19]  Jian Yang,et al.  Accurate and Efficient Inspection of Speckle and Scratch Defects on Surfaces of Planar Products , 2017, IEEE Transactions on Industrial Informatics.

[20]  Zhaowei Zhong,et al.  Defect detection on semiconductor wafer surfaces , 2005 .

[21]  Euripides G. M. Petrakis,et al.  A survey on industrial vision systems, applications, tools , 2003, Image Vis. Comput..

[22]  H. Izadbakhsh,et al.  Automatic dimensional defect detection for glass vials based on machine vision: A heuristic segmentation method , 2021, Journal of Manufacturing Processes.

[23]  H. Berry PHARMACEUTICAL ASPECTS OF GLASS AND RUBBER , 2011, The Journal of pharmacy and pharmacology.

[24]  Sung Kim,et al.  Development of Auto-Seeding System Using Image Processing Technology in the Sapphire Crystal Growth Process via the Kyropoulos Method , 2017 .

[25]  Tomislav Matić,et al.  Real-time biscuit tile image segmentation method based on edge detection. , 2018, ISA transactions.

[26]  David L. Olson,et al.  Advanced Data Mining Techniques , 2008 .

[27]  Francisco J. Cazorla,et al.  Measurement-Based Worst-Case Execution Time Estimation Using the Coefficient of Variation , 2017, ACM Trans. Design Autom. Electr. Syst..

[28]  R. Iacocca,et al.  Corrosive attack of glass by a pharmaceutical compound , 2007 .

[29]  R. Iacocca,et al.  Factors Affecting the Chemical Durability of Glass Used in the Pharmaceutical Industry , 2010, AAPS PharmSciTech.

[30]  E. Guadagnino,et al.  Delamination Propensity of Pharmaceutical Glass Containers by Accelerated Testing with Different Extraction Media , 2012, PDA Journal of Pharmaceutical Science and Technology.

[31]  Youping Chen,et al.  A classification method of glass defect based on multiresolution and information fusion , 2011 .

[32]  Pin Cao,et al.  Surface Defect Detection for Mobile Phone Back Glass Based on Symmetric Convolutional Neural Network Deep Learning , 2020 .

[33]  ZongFang Yang,et al.  Vial bottle mouth defect detection based on machine vision , 2015, 2015 IEEE International Conference on Information and Automation.

[34]  Pierfrancesco Foglia,et al.  Re-NUCA: Boosting CMP Performance Through Block Replication , 2010, 2010 13th Euromicro Conference on Digital System Design: Architectures, Methods and Tools.

[35]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[36]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[37]  F. Pukelsheim The Three Sigma Rule , 1994 .

[38]  Fei Zhang,et al.  An Online Technology for Measuring Icing Shape on Conductor Based on Vision and Force Sensors , 2017, IEEE Transactions on Instrumentation and Measurement.

[39]  Stefano Campanelli,et al.  An architecture to integrate IEC 61131-3 systems in an IEC 61499 distributed solution , 2015, Comput. Ind..

[40]  Foglia Pierfrancesco,et al.  Towards Relating Physiological Signals to Usability Metrics: A Case Study with a Web Avatar , 2014 .

[41]  P. Foglia,et al.  An inspection system for pharmaceutical glass tubes , 2015 .

[42]  Filippo Attivissimo,et al.  A low-cost inspection system for online defects assessment in satin glass , 2009 .

[43]  Sile Ma,et al.  Research and implementation of machine vision technologies for empty bottle inspection systems , 2018 .

[44]  Michael J Akers,et al.  Practical fundamentals of glass, rubber, and plastic sterile packaging systems , 2010, Pharmaceutical development and technology.

[45]  Lalit Prakash Saxena Niblack’s binarization method and its modifications to real-time applications: a review , 2017, Artificial Intelligence Review.

[46]  Jared S. Bee,et al.  Effects of surfaces and leachables on the stability of biopharmaceuticals. , 2011, Journal of pharmaceutical sciences.

[47]  Zhijun Chen,et al.  A comprehensive review of defect detection in 3C glass components , 2020 .