Real-time automated visual inspection of color tablets in pharmaceutical blisters

In pharmaceutical blister packing, it is today part of the recommended security standard to inspect tablets in each blister before it is sealed: In this paper an automated visual inspection system is described, which detects missing and broken tablets, tablet fragments, as well as the color, size, and shape of individual tablets. The system operates either in "training" or "inspection" mode. In training mode, the image of defect-free blisters is used to extract the blister model, which is composed of the spatial color nonuniformity correction function, positions of blisters, positions of tablets in blisters, the color labeling function, and position, size, and shape of each tablet and corresponding pre-specified tolerances. The blister model allows effective and real-time analysis of blisters in inspection mode. The most important parts of the system are correction of the adverse effects of spatial color nonuniformity and color segmentation. A method recently proposed for spatial intensity nonuniformity correction has been extended to suppress spatial color nonuniformity in color images. A novel nonparametric clustering-based segmentation method is proposed, which finds the valleys between color clusters. The experimental results indicate that the segmentation method preceded by spatial color nonuniformity correction accurately extracts color clusters with complex shapes and therefore correctly segments the inspected images. The automated visual inspection system can thus be used in industrial environments where real-time inspection of color objects is required.

[1]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[2]  Roland T. Chin,et al.  Automated visual inspection: 1981 to 1987 , 1988, Computer Vision Graphics and Image Processing.

[3]  Steven A. Shafer,et al.  Segmentation and Interpretation of Multicolored Objects with Highlights , 2000, Comput. Vis. Image Underst..

[4]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[5]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[6]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Nikolaos G. Bourbakis,et al.  A fuzzy region growing approach for segmentation of color images , 1997, Pattern Recognit..

[8]  Stephen J. Sangwine,et al.  The Colour Image Processing Handbook (Optoelectronics, Imaging and Sensing) , 1998 .

[9]  Viergever,et al.  Retrospective shading correction based on entropy minimization , 2000, Journal of microscopy.

[10]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[11]  John D. Holt,et al.  Real-time Industrial Visual Inspection: A Review , 1995, Real Time Imaging.

[12]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[13]  Bostjan Likar,et al.  Retrospective correction of MR intensity inhomogeneity by information minimization , 2000, IEEE Transactions on Medical Imaging.

[14]  Sang Uk Lee,et al.  Color image segmentation based on 3-D clustering: morphological approach , 1998, Pattern Recognit..

[15]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[16]  Didier Zugaj,et al.  A new approach of color images segmentation based on fusing region and edge segmentations outputs , 1998, Pattern Recognit..

[17]  Anil K. Jain,et al.  A Survey of Automated Visual Inspection , 1995, Comput. Vis. Image Underst..

[18]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[19]  Jorge L. C. Sanz,et al.  Recent Progress in Industrial Machine Vision , 1990 .

[20]  Glenn Healey,et al.  Segmenting images using normalized color , 1992, IEEE Trans. Syst. Man Cybern..

[21]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Raimondo Schettini,et al.  A segmentation algorithm for color images , 1993, Pattern Recognit. Lett..

[23]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[24]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[25]  Shang-Hong Lai,et al.  Novel illumination compensation algorithm for industrial inspection , 2001, J. Electronic Imaging.

[26]  Gerard Lacey,et al.  Industrial inspection using Gaussian functions in a colour space , 2000, Image Vis. Comput..