Novel interfaces for remote driving: gesture, haptic, and PDA

Remote driving is a difficult task. Not only do operators have problems perceiving and evaluating the remote environment, but they frequently make incorrect or sub-optimal control decisions. Thus, there is a need to develop alternative approaches which make remote driving easier and more productive. To address this need, we have developed three novel user interfaces: GestureDriver, HapticDriver and PdaDriver. In this paper, we present the motivation for and design of each interface. We also discuss research issues related to the use of gesture, haptics, and palm-size computers for remote driving. Finally, we describe lessons learned, potential applications and planned extensions for each interface.

[1]  Douglas E. McGovern,et al.  Experience and results in teleoperation of land vehicles , 1991 .

[2]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. II. Finger touch feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[3]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. I. Finger force feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[4]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[5]  I. S. Mackenzie,et al.  Virtual Environments and Advanced Interface Design , 1995 .

[6]  M. Bergamasco,et al.  Haptic interfaces: the study of force and tactile feedback systems , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[7]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[8]  Martin Kurze,et al.  Rendering drawings for interactive haptic perception , 1997, CHI.

[9]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[10]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Charles E. Thorpe,et al.  STRIPE: Low-Bandwidth and High-Latency Teleoperation , 1997 .

[12]  Daniel Thalmann,et al.  Real-time interactions with virtual agents driven by human action identification , 1997, AGENTS '97.

[13]  Lynn Conway,et al.  Video mirroring and iconic gestures: enhancing basic videophones to provide visual coaching and visual control , 1998 .

[14]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[15]  D. W. Repperger,et al.  Effects of force feedback on operator's skills in tele-operated systems , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[16]  Lorenzo Flückiger,et al.  Interface pour le pilotage et l'analyse des robots basée sur un générateur de cinématiques , 1998 .

[17]  Terrence Fong,et al.  Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Web-based Tools , 2000 .

[18]  Terrence Fong,et al.  Effective vehicle teleoperation on the World Wide Web , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  S. Grange,et al.  Vision-based Sensor Fusion for Active Interfaces , 2000 .

[20]  Alan C. Schultz,et al.  Towards Seamless Integration in a Multi-modal Interface , 2000 .

[21]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .

[22]  Terrence Fong,et al.  Vehicle Teleoperation Interfaces , 2001, Auton. Robots.