Recognition of dynamic environments for robotic assembly on moving workpieces

Automated robotic assembly on a moving workpiece, referred to as assembly in motion, demands that the assembly robot is synchronised in all degrees of freedom to the moving workpiece, on which assembly parts are installed. Currently, this requirement cannot be met due to the lack of robust recognition of the 3D position and the trajectory of the moving workpiece. In this paper, an assembly robot-guided, monocular camera system approaching this problem of recognition of dynamic environments is introduced, which considers the motion trajectory of the workpiece as a linear combination of trajectory bases, such as Discrete Cosine Transform (DCT) bases. The experimental results show that the proposed method is able to reconstruct arbitrary trajectories of a predefined assembly point on the workpiece moving in 3D space. The limitation of the developed method of environment recognition for robotic assembly in motion is also analysed.

[1]  D. Simon.  Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[2]  Jeroen D. Hol,et al.  Sensor Fusion and Calibration of Inertial Sensors, Vision, Ultra-Wideband and GPS , 2011 .

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Robert Schmitt,et al.  Estimation of the absolute camera pose for environment recognition of industrial robotics , 2013, Prod. Eng..

[5]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[6]  Robert Schmitt,et al.  Validation of iGPS as an external measurement system for cooperative robot positioning , 2013 .

[7]  Heping Chen,et al.  Assembly on moving production line based on sensor fusion , 2009 .

[8]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[9]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[10]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[11]  Christian Brecher,et al.  Measurement of structure dynamics using a tracking-interferometer , 2012, Prod. Eng..

[12]  Friedrich Lange,et al.  Robot based system for the automation of flow assembly lines , 2009, Prod. Eng..

[13]  Yaser Sheikh,et al.  3D Reconstruction of a Moving Point from a Series of 2D Projections , 2010, ECCV.

[14]  Amnon Shashua,et al.  Trajectory Triangulation: 3D Reconstruction of Moving Points from a Monocular Image Sequence , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Takeo Kanade,et al.  Trajectory Space: A Dual Representation for Nonrigid Structure from Motion , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Katsushi Ikeuchi,et al.  Recognizing Assembly Tasks Through Human Demonstration , 2007, Int. J. Robotics Res..

[17]  Gunther Reinhart,et al.  Flexible Automation for the Assembly in Motion , 2007 .

[18]  George Chryssolouris,et al.  Assembly system design and operations for product variety , 2011 .