Stereoscopic human interfaces

This article focuses on the use of stereoscopic video interfaces for telerobotics. Topics concerning human visual perception, binocular image capturing, and stereoscopic devices are described. There is a wide variety of video interfaces for telerobotic systems. Choosing the best video interface depends on the telerobotic application requirements. Simple monoscopic cameras are good enough for watching remote robot movements or for teleprogramming a sequence of commands. However, when operators seek precise robot guidance or wish to manipulate objects, a better perception of the remote environment must be achieved, for which more advanced visual interfaces are required. This implies a higher degree of telepresence, and, therefore, the most suitable visual interface has to be chosen. The aim of this article is to describe the two main aspects using stereoscopic interfaces: the capture of binocular video images, according to the disparity limits in human perception and the proper selection of the visualization interface for stereoscopic images.

[1]  Ning Xi,et al.  A case study of 3D stereoscopic vs. 2D monoscopic tele-reality in real-time dexterous teleoperation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Gerd Hirzinger,et al.  Sensor-based space robotics-ROTEX and its telerobotic features , 1993, IEEE Trans. Robotics Autom..

[3]  Harry L. Snyder,et al.  Comparison of depth cues for relative depth judgments , 1990, Other Conferences.

[4]  Robert E. Cole,et al.  Remote-manipulator tasks impossible without stereo TV , 1990, Other Conferences.

[5]  David Zeltzer,et al.  Three Dimensional Visual Display Systems for Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[6]  Paul Milgram,et al.  Learning effects in telemanipulation with monoscopic versus stereoscopic remote viewing , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[7]  Dan Wright,et al.  Survey of projection-based immersive displays , 2000, Electronic Imaging.

[8]  José M. Sebastián,et al.  Telerobotic system for live-power line maintenance: ROBTET , 2002 .

[9]  M. Halle Autostereoscopic displays and computer graphics , 1997, COMG.

[10]  J. Michael Textbook of Medical Physiology , 2005 .

[11]  Donald C. Hood,et al.  Sensitivity to Light , 1986 .

[12]  Gregg Podnar,et al.  Geometry of binocular imaging , 1994, Electronic Imaging.

[13]  Bin Wang,et al.  A robot arm/hand teleoperation system with telepresence and shared control , 2005, Proceedings, 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics..

[14]  Lawrence W. Stark,et al.  Sensing and Manipulation Problems in Endoscopic Surgery: Experiment, Analysis, and Observation , 1993, Presence: Teleoperators & Virtual Environments.

[15]  Stephen R. Ellis,et al.  Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot , 2008, Surgical Endoscopy.

[16]  Chong-Won Lee,et al.  Human and robot integrated teleoperation , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[17]  Chong-Won Lee,et al.  Human-robot integrated teleoperation , 1998, Adv. Robotics.

[18]  Kazuhito Yokoi,et al.  Enhanced Teleoperation Through Virtual Reality Techniques , 2007, Advances in Telerobotics.

[19]  Y. Yeh,et al.  Limits of Fusion and Depth Judgment in Stereoscopic Color Displays , 1990, Human factors.

[20]  Franz Freyberger,et al.  Interactive stereo vision telepresence for correct communication of spatial geometry , 2003, Adv. Robotics.

[21]  Manuel Ferre,et al.  Stereoscopic video images for telerobotic applications , 2005 .

[22]  Wa James Tam,et al.  Perceptual basis of stereoscopic video , 1999, Electronic Imaging.

[23]  Stephen R. Ellis,et al.  Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot , 2005, IS&T/SPIE Electronic Imaging.

[24]  Zygmunt Pizlo,et al.  Issues in the design of studies to test the effectiveness of stereo imaging , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[25]  Gregory B. Newby,et al.  Virtual reality: Scientific and technological challenges , 1996 .

[26]  Rafael Aracil,et al.  Stereoscopic video images for telerobotic applications , 2005, J. Field Robotics.

[27]  John W. Roberts,et al.  Display characteristics and the impact on usability for stereo , 2000, Electronic Imaging.

[28]  Eckhard Freund,et al.  Projective virtual reality as a basis for on-line control of complex systems-not only-over the internet , 2005 .

[29]  Günther Schmidt,et al.  Interaktives Stereo-Telesehen – ein Baustein wirklichkeitsnaher Telepräsenz (Interactive Tele-Stereo-Vision – a Module for High Fidelity Telepresence) , 2001 .

[30]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[31]  Robert E. Cole,et al.  Stereo TV Improves Manipulator Performance , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[32]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .

[33]  Alexandre Bernardino,et al.  Stereoscopic Image Visualization for Telerobotics. Experiments with Active Binocular Cameras , 2007, Advances in Telerobotics.

[34]  Blake Hannaford,et al.  Quantitative Evaluation of Perspective and Stereoscopic Displays in Three-Axis Manual Tracking Tasks , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[35]  David Eadie,et al.  Stereoscopic 3-D Acquisition, Processing, and Display for Telerobotic Applications , 2007, Advances in Telerobotics.

[36]  John Baker Generating Images For A Time-Multiplexed Stereoscopic Computer Graphics System , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[37]  H. Benjamin Brown,et al.  Human telesupervision of a fleet of autonomous robots for safe and efficient space exploration , 2006, HRI '06.