Heuristic hybrid genetic algorithm based shape matching approach for the pose detection of backlight units in LCD module assembly

Backlight unit (BLU) and open cell are two critical parts of the liquid crystal display (LCD) module (LCM) which is the most significant component of LCD TV. To place the open cell into a BLU automatically using an assembly robot, this paper proposes a heuristic hybrid genetic algorithm (HHGA) based shape matching approach to detect the pose (orientation and position) of the BLU. The approach takes advantages of line structures of the BLUs to avoid the most time-consuming exhaustive search. Firstly, obtain initial orientation of a BLU by the dominant orientations which can be obtained with the statistical gradient orientation histograms. Secondly, search the optimal pose through the HHGA which mainly consists of local search strategy, crossover strategy, clone strategy, and mutation strategy. Local search strategy is designed according to the rising trend of matching features around the optimal pose and along the lines. Crossover and clone are heuristic strategies designed according to the distribution characteristics of local maxima to produce new meaningful offspring. Mutation is a necessary strategy to keep the diversity of the population. The performance of the proposed approach has been tested on an image database acquired from the LCM assembly lines and compared with standard hybrid GA and exhaustive search by a new statistical indicator. Experimental results show that the proposed approach has a high efficiency within limited time and is suitable for the pose detection of the BLUs.

[1]  Yacov Hel-Or,et al.  Matching by Tone Mapping: Photometric Invariant Template Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Markus Ulrich,et al.  Hierarchical real-time recognition of compound objects in images , 2003 .

[4]  Guoqing Yu,et al.  Groove-center detection in gas metal arc welding using a template-matching method , 2016 .

[5]  Arif Mahmood,et al.  Correlation-Coefficient-Based Fast Template Matching Through Partial Elimination , 2012, IEEE Transactions on Image Processing.

[6]  Tae-Hyoung Park,et al.  Wavelet transform based image template matching for automatic component inspection , 2010 .

[7]  Ahmad J. Afshari,et al.  A hybrid genetic algorithm for integrated process planning and scheduling problem with precedence constraints , 2012 .

[8]  Xinyu Xu,et al.  High-speed object matching and localization using gradient orientation features , 2013, Electronic Imaging.

[9]  Qiao Sun,et al.  Further development of adaptable automated visual inspection—part II: implementation and evaluation , 2015 .

[10]  Carsten Steger,et al.  Similarity Measures for Occlusion, Clutter, and Illumination Invariant Object Recognition , 2001, DAGM-Symposium.

[11]  E. R. Davies Computer and Machine Vision: Theory, Algorithms, Practicalities , 2012 .

[12]  Pablo Moscato,et al.  A memetic algorithm for the total tardiness single machine scheduling problem , 2001, Eur. J. Oper. Res..

[13]  Mostafa Zandieh,et al.  An improved hybrid multi-objective parallel genetic algorithm for hybrid flow shop scheduling with unrelated parallel machines , 2010 .

[14]  Fuqiang Zhong,et al.  Blob analyzation-based template matching algorithm for LED chip localization , 2017 .

[15]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alan Crispin,et al.  Automated inspection of PCB components using a genetic algorithm template-matching approach , 2007 .

[18]  Ibrahim Kucukkoc,et al.  Integrating ant colony and genetic algorithms in the balancing and scheduling of complex assembly lines , 2016 .

[19]  Lizhuang Ma,et al.  Algorithm of locating PCB components based on colour distribution of solder joints , 2011 .

[20]  G. Derringer,et al.  Simultaneous Optimization of Several Response Variables , 1980 .