Multi-touch interface for controlling multiple mobile robots

We must give some form of a command to robots in order to have the robots do a complex task. An initial instruction is required even if they do their tasks autonomously. We therefore need interfaces for the operation and teaching of robots. Natural languages, joysticks, and other pointing devices are currently used for this purpose. These interfaces, however, have difficulty in operating multiple robots simultaneously. We developed a multi-touch interface with a top-down view from a ceiling camera for controlling multiple mobile robots. The user specifies a vector field followed by all robots on the view. This paper describes the user interface and its implementation, and future work of the project.

[1]  Derek Anderson,et al.  Using a hand-drawn sketch to control a team of robots , 2007, Auton. Robots.

[2]  Charles C. Kemp,et al.  Laser pointers and a touch screen: intuitive interfaces for autonomous mobile manipulation for the motor impaired , 2008, Assets '08.

[3]  Duc Truong Pham,et al.  Adaptive and cooperative mobile robots , 2007 .

[4]  Jun Rekimoto,et al.  HoloWall: designing a finger, hand, body, and object sensitive wall , 1997, UIST '97.

[5]  W ReynoldsCraig Flocks, herds and schools: A distributed behavioral model , 1987 .

[6]  Jun Rekimoto,et al.  Marble Market: Bimanual Interactive Game with a Body Shape Sensor , 2007, ICEC.

[7]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[8]  Michael Lewis,et al.  Human control for cooperating robot teams , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  R. Dillmann,et al.  Using gesture and speech control for commanding a robot assistant , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[10]  Hiraku Okada,et al.  Technical Report of IEICE , 2000 .

[11]  Frauke Driewer,et al.  Discussion of Challenges for User Interfaces in Human-Robot Teams , 2007, EMCR.

[12]  Samir Kouro,et al.  Unidimensional Modulation Technique for Cascaded Multilevel Converters , 2009, IEEE Transactions on Industrial Electronics.

[13]  Koren,et al.  Real-Time Obstacle Avoidance for Fast Mobile Robots , 2022 .

[14]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[15]  Terrence Fong,et al.  Multi-robot remote driving with collaborative control , 2003, IEEE Trans. Ind. Electron..

[16]  Charles E. Thorpe,et al.  PdaDriver: A Handheld System for Remote Driving , 2003 .