Robot programming using augmented reality: An interactive method for planning collision-free paths

Current robot programming approaches lack the intuitiveness required for quick and simple applications. As new robotic applications are being identified, there is a greater need to be able to programme robots safely and quickly. This paper discusses the use of an augmented reality (AR) environment for facilitating intuitive robot programming, and presents a novel methodology for planning collision-free paths for an n-d.o.f. (degree-of-freedom) manipulator in a 3D AR environment. The methodology is interactive because the human is involved in defining the free space or collision-free volume (CFV), and selecting the start and goal configurations. The methodology uses a heuristic beam search algorithm to generate the paths. A number of possible scenarios are discussed.

[1]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Rainer Bischoff,et al.  Perspectives on augmented reality based human-robot interaction with industrial robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[3]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[4]  Emerico Natonek,et al.  Model based vision as feedback for virtual reality robotics environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[5]  Alexander Zelinsky,et al.  Programing by Demonstration: Coping with Suboptimal Teaching Actions , 2003 .

[6]  J. Molineros,et al.  Computer vision for guiding manual assembly , 2001, Proceedings of the 2001 IEEE International Symposium on Assembly and Task Planning (ISATP2001). Assembly and Disassembly in the Twenty-first Century. (Cat. No.01TH8560).

[7]  Stefan Schaal,et al.  Learning tasks from a single demonstration , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[9]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[10]  J. Norberto Pires,et al.  Object oriented and distributed software applied to industrial robotic welding , 2002 .

[11]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human inconsistency in improving 3D robot trajectories , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[12]  Layek Abdel-Malek,et al.  The application of inverse kinematics in the optimum sequencing of robot tasks , 1990 .

[13]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[14]  Rajeev Motwani,et al.  Path Planning in Expansive Configuration Spaces , 1999, Int. J. Comput. Geom. Appl..

[15]  Rüdiger Dillmann,et al.  Building elementary robot skills from human demonstration , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[16]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[17]  Nathan Delson,et al.  Robot programming by human demonstration: adaptation and inconsistency in constrained motion , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[18]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human variation in identifying obstacle free trajectories , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[19]  I. Sabuncuoglu,et al.  Stochastic assembly line balancing using beam search , 2005 .

[20]  Ihsan Sabuncuoglu,et al.  Analysis of reactive scheduling problems in a job shop environment , 2000, Eur. J. Oper. Res..

[21]  R. D. Schraft,et al.  New robot applications in production and service , 1993, Proceedings of 1993 IEEE/Tsukuba International Workshop on Advanced Robotics.

[22]  Simon Parsons,et al.  Principles of Robot Motion: Theory, Algorithms and Implementations by Howie Choset, Kevin M. Lynch, Seth Hutchinson, George Kantor, Wolfram Burgard, Lydia E. Kavraki and Sebastian Thrun, 603 pp., $60.00, ISBN 0-262-033275 , 2007, The Knowledge Engineering Review.

[23]  Stefano Caselli,et al.  Leveraging on a virtual environment for robot programming by demonstration , 2004, Robotics Auton. Syst..

[24]  Michael F. Zäh,et al.  Interactive laser-projection for programming industrial robots , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[25]  Rüdiger Dillmann,et al.  What Can Robots Learn from Humans , 1996 .

[26]  H. Harry Asada,et al.  Automatic program generation from teaching data for the hybrid control of robots , 1989, IEEE Trans. Robotics Autom..

[27]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[28]  J. Bobrow,et al.  Time-Optimal Control of Robotic Manipulators Along Specified Paths , 1985 .

[29]  John Pretlove,et al.  Augmented reality for programming industrial robots , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[30]  J. Norberto Pires,et al.  CAD interface for automatic robot welding programming , 2004, Ind. Robot.