The Design and Implementation of an Embedded Real-Time Automated IC Marking Inspection System

This paper presents the system and algorithm designs of a real-time automated integrated circuit (IC) marking inspection system based on the embedded platform. Specifically, the system-level design and the integration of hardware and software components are illustrated in this paper. Furthermore, in order to enhance the accuracy of IC inspection, this paper presents a novel algorithm which integrates the classic template matching approach with an efficient angle estimation method, so that the rotation and location of the IC chip can be identified precisely. Formal outline of the proposed algorithm is given in this paper. Moreover, aiming at reducing the computation time, the algorithmic optimizations based on the multi-core embedded processor and the single instruction, multiple data architecture are presented. The experiment results show that, compared to the conventional IC marking inspection algorithm, the proposed system and algorithm greatly improve the efficiency and accuracy of image processing on the embedded system. In particular, when the size of the target image is <inline-formula> <tex-math notation="LaTeX">$640\times480$ </tex-math></inline-formula> pixels and size of the template image is 80 <inline-formula> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> 100, the average inspection time is 31 ms, which is an approximately <inline-formula> <tex-math notation="LaTeX">$20{\times }$ </tex-math></inline-formula> improvement from the conventional inspection scheme.

[1]  Shang-Liang Chen,et al.  A Machine Vision Based Automatic Optical Inspection System for Measuring Drilling Quality of Printed Circuit Boards , 2017, IEEE Access.

[2]  Nicusor Birsan,et al.  Embedded systems platform-based design from teaching to industry or vice-versa , 2010, 2010 12th International Conference on Optimization of Electrical and Electronic Equipment.

[3]  Bernard C. Jiang,et al.  Machine vision-based gray relational theory applied to IC marking inspection , 2002 .

[4]  Hua Yang,et al.  Polygon-Invariant Generalized Hough Transform for High-Speed Vision-Based Positioning , 2016, IEEE Transactions on Automation Science and Engineering.

[5]  Chia-Pin Chiu,et al.  Cooling a Microprocessor Chip , 2006, Proceedings of the IEEE.

[6]  Han Wang,et al.  A New IC Solder Joint Inspection Method for an Automatic Optical Inspection System Based on an Improved Visual Background Extraction Algorithm , 2016, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[7]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[8]  Holger Blume,et al.  OpenMP-based parallelization on an MPCore multiprocessor platform - A performance and power analysis , 2008, J. Syst. Archit..

[9]  Liang-Gee Chen,et al.  Analysis and architecture design of variable block-size motion estimation for H.264/AVC , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[10]  Lai-Man Po,et al.  Transform-Domain Fast Sum of the Squared Difference Computation for H.264/AVC Rate-Distortion Optimization , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Chin-Hsing Chen,et al.  A Fast Template Matching Method With Rotation Invariance by Combining the Circular Projection Transform Process and Bounded Partial Correlation , 2012, IEEE Signal Processing Letters.

[12]  N. Amin,et al.  Interface development for cost effective automated IC orientation checking systems , 2007, 2007 10th international conference on computer and information technology.

[13]  Marzuki Khalid,et al.  A real time marking inspection scheme for semiconductor industries , 2007 .

[14]  Zou Yuanyuan Research on Automatic Visual Inspection Method for Character on Cartridge Fuse Based on Template Matching , 2016, 2016 3rd International Conference on Information Science and Control Engineering (ICISCE).

[15]  Wen Gao,et al.  An efficient NEON-based quarter-pel interpolation method for HEVC , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[16]  N. Jazdi,et al.  Cyber physical systems in the context of Industry 4.0 , 2014, 2014 IEEE International Conference on Automation, Quality and Testing, Robotics.

[17]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[18]  Reinhard Gerndt,et al.  Embedded vision system for robotics and industrial automation , 2011, 2011 9th IEEE International Conference on Industrial Informatics.

[19]  Norbert Wehn,et al.  An advanced embedded architecture for connected component analysis in industrial applications , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[20]  Ioannis Stamelos,et al.  Performance and energy evaluation of spark applications on low-power SoCs , 2016, 2016 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation (SAMOS).

[21]  Hua Yang,et al.  A Region-Based Normalized Cross Correlation Algorithm for the Vision-Based Positioning of Elongated IC Chips , 2015, IEEE Transactions on Semiconductor Manufacturing.