Using a hand-drawn sketch to control a team of robots

In this paper, we describe a prototype interface that facilitates the control of a mobile robot team by a single operator, using a sketch interface on a Tablet PC. The user draws a sketch map of the scene and includes the robots in approximate starting positions. Both path and target position commands are supported as well as editing capabilities. Sensor feedback from the robots is included in the display such that the sketch interface acts as a two-way communication device between the user and the robots. The paper also includes results of a usability study, in which users were asked to perform a series of tasks.

[1]  Marjorie Skubic,et al.  Hidden Markov Model Symbol Recognition for Sketch-Based Interfaces , 2004, AAAI Technical Report.

[2]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[3]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[4]  Christine Alvarado,et al.  A Framework for Multi-Domain Sketch Recognition , 2002 .

[5]  R.R. Murphy,et al.  Human-robot interaction in USAR technical search: two heads are better than one , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[6]  Charles E. Thorpe,et al.  PdaDriver: A Handheld System for Remote Driving , 2003 .

[7]  Marjorie Skubic,et al.  Robot navigation using qualitative landmark states from sketched route maps , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[8]  D. M. Wilkes,et al.  TOWARD EGOCENTRIC NAVIGATION , 2002 .

[9]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[10]  Randall Davis,et al.  Automatically Transforming Symbolic Shape Descriptions for Use in Sketch Recognition , 2004, AAAI.

[11]  Reinhard Klein,et al.  Scale Space Based Feature Point Detection on Surfaces , 2008, J. WSCG.

[12]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[13]  Reinhard Moratz,et al.  Schematic Maps for Robot Navigation , 2000, Spatial Cognition.

[14]  Yoram Koren,et al.  The vector field histogram-fast obstacle avoidance for mobile robots , 1991, IEEE Trans. Robotics Autom..

[15]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[16]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[17]  Terrence Fong,et al.  Multi-robot remote driving with collaborative control , 2003, IEEE Trans. Ind. Electron..

[18]  Henrik I. Christensen,et al.  PDA interface for a field robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[19]  Masatsugu Kidode,et al.  Robot navigation in corridor environments using a sketch floor map , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[20]  Wilfried Brauer,et al.  Spatial Cognition II, Integrating Abstract Theories, Empirical Studies, Formal Methods, and Practical Applications , 2000 .