Deep-Learning Based Robotic Manipulation of Flexible PCBs

In the past 10 years, due to the fast development of 3C industries such as mobile phones and computers, people have higher requirements for the automatic soldering technology of flexible PCBs. However, the deformation and the small size of flexible PCBs open up significant challenges to robotic soldering. This paper proposes a deep-learning based manipulation scheme for automatic soldering of flexible PCBs. The proposed controller can enable the robot to automatically contact the flexible PCB first, then actively control the flexible PCB to the desired position with the visual feedback, and finally, the soldering machine will solder the flexible PCBs smoothly. First, the approach of deep learning is used to detect the position of the solder pad (feature). Then, the vision-based controller drives the robot to manipulate the solder pad to the desired position, such that the soldering machine can work to solder two pieces of flexible PCBs together. The use of a deep learning approach can explore the human’s experience to improve the accuracy of detection and hence deals with the issues of clustered environment, change of illumination, and different initial position, etc. The proposed detection approach and control scheme is implemented in a soldering robot for flexible PCBs and the results validate the performance of the proposed methods.

[1]  Xiang Li,et al.  Cooperative robotic soldering of flexible PCBs , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Yun-Hui Liu,et al.  Vision-Based Robotic Manipulation of Flexible PCBs , 2018, IEEE/ASME Transactions on Mechatronics.

[3]  Gaurav S. Sukhatme,et al.  Using Manipulation Primitives for Object Sorting in Cluttered Environments , 2015, IEEE Transactions on Automation Science and Engineering.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Zhi Chen,et al.  Development of an Autonomous Soldering Robot for USB Wires , 2020, 2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[6]  Yu Sun,et al.  Robotic grasping for instrument manipulations , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[7]  Hong Qiao,et al.  Grasping Objects: The Relationship Between the Cage and the Form-Closure Grasp , 2017, IEEE Robotics & Automation Magazine.

[8]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[9]  Xiang Li,et al.  Adaptive region control for robotic soldering of flexible PCBs , 2017, 2017 18th International Conference on Advanced Robotics (ICAR).

[10]  Jungwon Seo,et al.  Shallow-Depth Insertion: Peg in Shallow Hole Through Robotic In-Hand Manipulation , 2019, IEEE Robotics and Automation Letters.

[11]  Hua Liu,et al.  An adaptive ball-head positioning visual servoing method for aircraft digital assembly , 2019, Assembly Automation.

[12]  Otmar Hilliges,et al.  Learning to Assemble: Estimating 6D Poses for Robotic Object-Object Manipulation , 2020, IEEE Robotics and Automation Letters.

[13]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yu Qiu,et al.  Concurrent-learning-based visual servo tracking and scene identification of mobile robots , 2019 .

[15]  Yunhui Liu,et al.  On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments , 2014, Int. J. Robotics Res..