Vision-guided active collision avoidance for human-robot collaborations

This paper reports a novel methodology of real-time active collision avoidance in an augmented environment, where virtual 3D models of robots and real camera images of operators are used for monitoring and collision detection. A prototype system is developed and linked to robot controllers for adaptive robot control, with zero robot programming for end users. According to the result of collision detection, the system can alert an operator, stop a robot, or modify the robot’s trajectory away from an approaching operator. Through a case study, it shows that this method can be applied to real-world applications such as human-robot collaborative assembly to safeguard human operators.

[1]  Jeffrey Too Chuan Tan,et al.  Triple stereo vision system for safety monitoring of human-robot collaboration in cellular manufacturing , 2011, 2011 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[2]  Dominik Henrich,et al.  3D Collision Detection for Industrial Robots and Unknown Obstacles using Multiple Depth Images , 2009 .

[3]  Masatoshi Ishikawa,et al.  Safe human-robot-coexistence: emergency-stop using a high-speed vision-chip , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[5]  Oussama Khatib,et al.  A depth space approach to human-robot collision avoidance , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  B. Nickolay,et al.  Image based 3D surveillance for flexible man-robot-cooperation , 2005 .

[7]  Lihui Wang,et al.  A sensor-driven 3D model-based approach to remote real-time monitoring , 2011 .

[8]  Dominik Henrich,et al.  Human-robot cooperation: safe pick-and-place operations , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[9]  Francisco A. Candelas,et al.  Safe human-robot interaction based on dynamic sphere-swept line bounding volumes , 2011 .

[10]  Shozo Takata,et al.  Human and robot allocation method for hybrid assembly systems , 2011 .

[11]  Antonio Bicchi,et al.  Integration of active and passive compliance control for safe human-robot coexistence , 2009, 2009 IEEE International Conference on Robotics and Automation.