Digitisation of a moving assembly operation using multiple depth imaging sensors

Several manufacturing operations continue to be manual even in today’s highly automated industry because the complexity of such operations makes them heavily reliant on human skills, intellect and experience. This work aims to aid the automation of one such operation, the wheel loading operation on the trim and final moving assembly line in automotive production. It proposes a new method that uses multiple low-cost depth imaging sensors, commonly used in gaming, to acquire and digitise key shopfloor data associated with the operation, such as motion characteristics of the vehicle body on the moving conveyor line and the angular positions of alignment features of the parts to be assembled, in order to inform an intelligent automation solution. Experiments are conducted to test the performance of the proposed method across various assembly conditions, and the results are validated against an industry standard method using laser tracking. Some disadvantages of the method are discussed, and suggestions for improvements are suggested. The proposed method has the potential to be adopted to enable the automation of a wide range of moving assembly operations in multiple sectors of the manufacturing industry.

[1]  A. K. Gupta,et al.  Industrial Automation and Robotics: An Introduction , 2016 .

[2]  Robert Schmitt,et al.  Single camera-based synchronisation within a concept of robotic assembly in motion , 2014 .

[3]  Sotiris Makris,et al.  Automotive assembly technologies review: challenges and outlook for a flexible and adaptive approach , 2010 .

[4]  Sang Choi,et al.  Trends and opportunities for robotic automation of trim & final assembly in the automotive industry , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[5]  Vinayak Ashok Prabhu,et al.  Monitoring and Digitising Human-Workpiece Interactions during a Manual Manufacturing Assembly Operation Using KinectTM , 2013 .

[6]  Ashutosh Tiwari,et al.  Intelligent Composite Layup by the Application of Low Cost Tracking and Projection Technologies , 2014 .

[7]  Gunther Reinhart,et al.  Flexible Automation for the Assembly in Motion , 2007 .

[8]  Friedrich Lange,et al.  Assembling wheels to continuously conveyed car bodies using a standard industrial robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[10]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[11]  Vinayak Ashok Prabhu,et al.  Dynamic Alignment Control Using Depth Imagery for Automated Wheel Assembly , 2014 .

[12]  Jane Shi Preliminary analysis of conveyor dynamic motion for automation applications , 2008, PerMIS.

[13]  William Eakins,et al.  Robotic wheel loading process in automotive manufacturing automation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Sungchul Kang,et al.  Macro-micro manipulation with visual tracking and its application to wheel assembly , 2005 .

[15]  Roland Menassa,et al.  Flexible robotic assembly in dynamic environments , 2010, PerMIS.

[16]  Henry Fuchs,et al.  Reducing interference between multiple structured light depth sensors using motion , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[17]  Luiz Velho,et al.  Kinect and RGBD Images: Challenges and Applications , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials.

[18]  Thomas A. Fuhlbrigge,et al.  Towards performance analysis of wheel loading process in automotive manufacturing , 2010, 2010 IEEE International Conference on Automation Science and Engineering.