Complex-Object Visual Inspection: Empirical Studies on A Multiple Lighting Solution

The design of an automatic visual inspection system is usually performed in two stages. While the first stage consists in selecting the most suitable hardware setup for highlighting most effectively the defects on the surface to be inspected, the second stage concerns the development of algorithmic solutions to exploit the potentials offered by the collected data. In this paper, first, we present a novel illumination setup embedding four illumination configurations to resemble diffused, dark-field, and front lighting techniques. Second, we analyze the contributions brought by deploying the proposed setup in the training phase only, mimicking the scenario in which an already developed visual inspection system cannot be modified on the customer site. Along with an exhaustive set of experiments, in this paper, we demonstrate the suitability of the proposed setup for effective illumination of complex-objects, defined as manufactured items with variable surface characteristics that cannot be determined a priori. Eventually, we provide insights into the importance of multiple light configurations availability during training and their natural boosting effect which, without the need to modify the system design in the evaluation phase, lead to improvements in the overall system performance.

[1]  Ge Zhang,et al.  Approaches for improvement of the X-ray image defect detection of automobile casting aluminum parts based on deep learning , 2019, NDT & E International.

[2]  Vittorio Murino,et al.  Modality Distillation with Multiple Stream Networks for Action Recognition , 2018, ECCV.

[3]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[4]  Kaikai Guo,et al.  Microscopy illumination engineering using a low-cost liquid crystal display. , 2015, Biomedical optics express.

[5]  Mu-Chun Su,et al.  A self organizing map optimization based image recognition and processing model for bridge crack inspection , 2017 .

[6]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[7]  Charles A. Harlow,et al.  Automated Visual Inspection: A Survey , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Petia Radeva,et al.  Multi-face tracking by extended bag-of-tracklets in egocentric photo-streams , 2015, Comput. Vis. Image Underst..

[9]  Bayram Akdemir,et al.  Real-time product quality control system using optimized Gabor filter bank , 2018 .

[10]  S. Kokoschka,et al.  Visual inspection of sealing rings—a case study on lighting and visibility , 1986 .

[11]  Shubin Li,et al.  Detection of rail surface defects based on CNN image recognition and classification , 2018, 2018 20th International Conference on Advanced Communication Technology (ICACT).

[12]  Ming Chang,et al.  Development of an optical inspection platform for surface defect detection in touch panel glass , 2016 .

[13]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[14]  Jesse Davis,et al.  Unachievable Region in Precision-Recall Space and Its Effect on Empirical Evaluation , 2012, ICML.

[15]  Yundong Li,et al.  Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[16]  Sabine Süsstrunk,et al.  Automatic detection of dust and scratches in silver halide film using polarized dark-field illumination , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Colin G. Drury,et al.  The Role of Visual Inspection in the 21st Century , 2017 .

[18]  Di Wu,et al.  Colour measurements by computer vision for food quality control – A review , 2013 .

[19]  In-So Kweon,et al.  Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones , 2016, IEEE Transactions on Industrial Informatics.