A Robot Control and Augmented Reality Interface for Multiple Robots

Augmented reality technology is useful for interactionwith robotic devices. A user can see the status of and direct orders to robots in the actual operating environmentrather than on a remote computer console. A system is presented where fiducial markers are used for the dual purpose of reading the position of a multi-robot system and for user interaction using augmented reality. A user can observe, with the assistance of a hand-held device or wearable eyepiece display, the planned motion and tasks of the robots. An intuitive interface allows the robots to be retasked dynamically. A scalable system architecture and a prototype is presented.

[1]  Satoshi Kagami,et al.  Augmented Reality for Robot Development and Experimentation , 2005 .

[2]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Hiroyuki Yamamoto,et al.  A registration evaluation system using an industrial robot , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[4]  Ehud Sharlin,et al.  Robot expressionism through cartooning , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Atsushi Konno,et al.  U-Tsu-Shi-O-Mi: the virtual humanoid you can reach , 2006, SIGGRAPH '06.

[6]  Takeo Kanade,et al.  Overlay what Humanoid Robot Perceives and Thinks to the Real-world by Mixed Reality System , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  Toby H. J. Collett,et al.  Augmented reality visualisation for mobile robot developers , 2007 .

[8]  Chang Shu,et al.  Self-identifying patterns for plane-based camera calibration , 2008, Machine Vision and Applications.

[9]  John Pretlove,et al.  Augmented reality for programming industrial robots , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[10]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[12]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[13]  Gregory Dudek,et al.  Simultaneous planning, localization, and mapping in a camera sensor network , 2006, Robotics Auton. Syst..