An assembly system based on industrial robot with binocular stereo vision

This paper proposes an electronic part and component assembly system based on an industrial robot with binocular stereo vision. Firstly, binocular stereo vision with a visual attention mechanism model is used to get quickly the image regions which contain the electronic parts and components. Secondly, a deep neural network is adopted to recognize the features of the electronic parts and components. Thirdly, in order to control the end-effector of the industrial robot to grasp the electronic parts and components, a genetic algorithm (GA) is proposed to compute the transition matrix and the inverse kinematics of the industrial robot (end-effector), which plays a key role in bridging the binocular stereo vision and the industrial robot. Finally, the proposed assembly system is tested in LED component assembly experiments, and the results denote that it has high efficiency and good applicability.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  Li Jiang,et al.  Genetic Algorithm for Solving the Inverse Kinematics Problem for General 6R Robots , 2015 .

[3]  Steve Renals,et al.  Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[4]  Nan Feng Xiao,et al.  Robot Stereo Vision Guidance System Based on Attention Mechanism , 2013 .

[5]  Claudia Raluca Tudorie.  Different Approaches in Feeding of a Flexible Manufacturing Cell , 2010, SIMPAR.

[6]  José Santos-Victor,et al.  Motor-Primed Visual Attention for Humanoid Robots , 2015, IEEE Transactions on Autonomous Mental Development.

[7]  Akihiro Yamamoto,et al.  Visual Odometry by Multi-frame Feature Integration , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[8]  P. C. Hills.  Introduction to robots: Arthur J. Critchlow , 1986, Autom..

[9]  Chih-Hung Chang,et al.  The learning problem of multi-layer neural networks , 2013, Neural Networks.

[10]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Joel C. Huegel,et al.  Inverse Kinematics Solution for Robotic Manipulators Using a CUDA-Based Parallel Genetic Algorithm , 2011, MICAI.

[13]  Zhao Dong-biao.  Harris-SIFT Algorithm and Its Application in Binocular Stereo Vision , 2010 .

[14]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[15]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.