The Convergence of Robotics, Vision, and Computer Graphics for User Interaction

Mechanical interfaces to virtual environments and the creation of virtual environments represent important and relatively new application areas for robotics. The creation of immersive interfaces will require codevelopment of visual displays that complement mechanical stimuli with appropriate visual cues, ultimately determined from human psychophysics. Advances in interactive rendering and geometric modeling from computer graphics will play a key role. Examples are drawn from haptic and locomotion interface projects.

[1]  Larry F. Hodges,et al.  The Perception of Distance in Simulated Visual Displays:A Comparison of the Effectiveness and Accuracy of Multiple Depth Cues Across Viewing Distances , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Ruud G. J. Meulenbroek,et al.  Planning Reaches by Evaluating Stored Postures. , 1995 .

[3]  Gerd Hirzinger,et al.  Sensor-based space robotics-ROTEX and its telerobotic features , 1993, IEEE Trans. Robotics Autom..

[4]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[5]  Elaine Cohen,et al.  Direct haptic rendering of sculptured models , 1997, SI3D.

[6]  Thurston L. Brooks,et al.  Operator vision aids for telerobotic assembly and servicing in space , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[7]  K. E. MacLean,et al.  The “Haptic Camera”: A Technique for Characterizing and Playing Back Haptic Properties of Real Environments , 1996, Dynamic Systems and Control.

[8]  Pascal Mamassian,et al.  Illusory motion from shadows , 1996, Nature.

[9]  David A. Forsyth,et al.  Shading primitives: finding folds and shallow grooves , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  H L Pick,et al.  The role of binocular information in ball catching. , 1992, Journal of motor behavior.

[11]  Radomír Mech,et al.  Realistic modeling and rendering of plant ecosystems , 1998, SIGGRAPH.

[12]  Martin Buehler,et al.  Control of Virtual Motion Systems Figure 1: Legged Robot on a Treadmill , 1993 .

[13]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[14]  Rudy Darken,et al.  The omni-directional treadmill: a locomotion device for virtual worlds , 1997, UIST '97.

[15]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[16]  Elaine Cohen,et al.  A framework for efficient minimum distance computations , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[17]  Peter Shirley,et al.  Geospecific Rendering of Alpine Terrain , 1999, Rendering Techniques.

[18]  Hitoshi Maekawa,et al.  Haptic display for object grasping and manipulating in virtual environment , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[19]  John M. Hollerbach,et al.  Slope Display on a Locomotion Interface , 1999, ISER.

[20]  David Baraff,et al.  Linear-time dynamics using Lagrange multipliers , 1996, SIGGRAPH.

[21]  Jack M. Loomis,et al.  Absolute motion parallax weakly determines visual scale in real and virtual environments , 1995, Electronic Imaging.

[22]  Hiroo Iwata,et al.  Walking about virtual environments on an infinite floor , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[23]  Martin Buehler,et al.  Control of virtual motion systems , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[24]  Hugues Hoppe.  Smooth view-dependent level-of-detail control and its application to terrain rendering , 1998 .

[25]  Nathaniel I. Durlach,et al.  Virtual Reality: Scientific and Technological Challenges , 1994 .

[26]  K. A. Shomper,et al.  Haptic rendering , 1997, 14th Annual AESS/IEEE Dayton Section Symposium. Synthetic Visualization: Systems and Applications.

[27]  Gerd Hirzinger,et al.  Robotics research : the seventh international symposium , 1996 .

[28]  Tsuneo Yoshikawa,et al.  Haptic Virtual Reality: Display of Operating Feel of Dynamic Virtual Objects , 1996 .

[29]  Gerald P. Roston,et al.  A whole body kinesthetic display device for virtual reality applications , 1997, Proceedings of International Conference on Robotics and Automation.

[30]  Tsutomu Miyasato,et al.  Design for Locomotion Interface in a Large Scale Virtual Environment ATLAS: ATR Locomotion Interface for Active Self Motion , 1998, Dynamic Systems and Control.

[31]  J. Trinkle,et al.  Dynamic multi-rigid-body systems with concurrent distributed contacts , 2001, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  Peter Shirley,et al.  Visual Glue , 1998 .

[33]  Anne E. Garing,et al.  Calibration of human locomotion and models of perceptual-motor organization. , 1995, Journal of experimental psychology. Human perception and performance.

[34]  David E. Johnson,et al.  Improved method for haptic tracing of a sculptured surface , 1998 .

[35]  H. Noma,et al.  Design for Locomotion Interface in a Large Scale Virtual Environment ATLAS: ATR Locomotion Interface for Active Self Motion , 1998, Dynamic Systems and Control.

[36]  D Kersten,et al.  Moving Cast Shadows Induce Apparent Motion in Depth , 1997, Perception.

[37]  David C. Brogan,et al.  Dynamically simulated characters in virtual environments , 1998, SIGGRAPH '97.

[38]  Elaine Cohen,et al.  Bound coherence for minimum distance computations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[39]  Elaine Cohen,et al.  Maneuverable NURBS models within a haptic virtual environment , 1997 .

[40]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[41]  Loukia D. Loukopoulos,et al.  Planning reaches by evaluating stored postures. , 1995, Psychological review.

[42]  Peter J. Werkhoven,et al.  The Effects of Proprioceptive and Visual Feedback on Geographical Orientation in Virtual Environments , 1999, Presence: Teleoperators & Virtual Environments.

[43]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[44]  J. Robert Ensor,et al.  Peloton: A VRML-based bicycling simulator , 1997, SIGGRAPH '97.

[45]  Peter Shirley,et al.  A practical analytic model for daylight , 1999, SIGGRAPH.