Developer oriented visualisation of a robot program

Robot programmers are faced with the challenging problem of understanding the robot's view of its world, both when creating and when debugging robot software. As a result tools are created as needed in different laboratories for different robots and different applications. We discuss the requirements for effective interaction under these conditions, and propose an augmented reality approach to visualising robot input, output and state information, including geometric data such as laser range scans, temporal data such as the past robot path, conditional data such as possible future robot paths, and statistical data such as localisation distributions. The visualisation techniques must scale appropriately as robot data and complexity increases. Our current progress in developing a robot visualisation toolkit is presented.

[1]  Rainer Bischoff,et al.  Perspectives on augmented reality based human-robot interaction with industrial robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[3]  Rajeev Sharma,et al.  Interactive evaluation of assembly sequences using augmented reality , 1999, IEEE Trans. Robotics Autom..

[4]  Eckhard Freund,et al.  State oriented modeling as enabling technology for projective virtual reality , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[5]  Vesna Brujic-Okretic,et al.  Remote vehicle manoeuvring using augmented reality , 2003 .

[6]  David W. Payton,et al.  World embedded interfaces for human-robot interaction , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[7]  Brian Scassellati,et al.  Active vision for sociable robots , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Bruce A. MacDonald,et al.  An evaluation of the sequential Monte Carlo technique for simultaneous localisation and map-building , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Bruce A. MacDonald,et al.  Graphical Simulation and Visualisation Tool for a Distributed Robot Programming Environment , 2003 .

[10]  Andrew H. Fagg,et al.  Real time visualization of robot state with mobile virtual reality , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Hiroshi Noborio,et al.  Wearable-based evaluation of human-robot interactions in robot path-planning , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Stefano Carpin,et al.  Validating USARsim for use in HRI Research , 2005 .

[13]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[14]  John Pretlove,et al.  Augmented reality for programming industrial robots , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..