Requirements, Implementation and Applications of Hand-held Virtual Reality

While hand-held computing devices are capable of rendering advanced 3D graphics and processing of multimedia data, they are not designed to provide and induce sufficient sense of immersion and presence for virtual reality. In this paper, we propose minimal requirements for realizing VR on a hand-held device. Furthermore, based on the proposed requirements, we have designed and implemented a low cost hand-held VR platform by adding multimodal sensors and display components to a hand-held PC. The platform enables a motion based interface, an essential part of realizing VR on a small hand-held device, and provides outputs in three modalities, visual, aural and tactile/haptic for a reasonable sensory experience. We showcase our platform and demonstrate the possibilities of hand-hand VR through three VR applications: a typical virtual walkthrough, a 3D multimedia contents browser, and a motion based racing game. Index Terms—Virtual Reality, Computer interface human factors

[1]  Hod Lipson,et al.  Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Richard H. Bartels,et al.  Constraint-based curve manipulation , 1993, IEEE Computer Graphics and Applications.

[3]  Eugene Fiume,et al.  Wires: a geometric deformation technique , 1998, SIGGRAPH.

[4]  Leonard McMillan,et al.  Sketching with projective 2D strokes , 1999, UIST '99.

[5]  Yongseok Jang,et al.  Designing a Vibro-Tactile Wear for "Close Range" Interaction for VR-based Motion Training , 2002 .

[6]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[7]  Frank W. Letniowski,et al.  Three-Dimensional Delaunay Triangulations for Finite Element Approximations to a Second-Order Diffusion Operator , 1992, SIAM J. Sci. Comput..

[8]  Hongxin Zhang,et al.  Prototype Modeling from Sketched Silhouettes based on Convolution Surfaces , 2004, Comput. Graph. Forum.

[9]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[10]  Takeo Igarashi,et al.  Sketch interface for 3D modeling of flowers , 2004, SIGGRAPH '04.

[11]  Carl Gutwin,et al.  Interacting with Big Interfaces on Small Screens: a Comparison of Fisheye, Zoom, and Panning Techniques , 2004, Graphics Interface.

[12]  Sungkil Lee,et al.  Formation of Spatial Presence: By Form or Content? , 2004 .

[13]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[14]  Mel Slater,et al.  The Influence of Body Movement on Subjective Presence in Virtual Environments , 1998, Hum. Factors.

[15]  Ramesh Raskar,et al.  Epipolar methods for multi-view sketching , 2004, SBM'04.

[16]  N. Sukumar,et al.  Voronoi cell finite difference method for the diffusion operator on arbitrary unstructured grids , 2003 .

[17]  Pedro Santos,et al.  Constraint stroke-based oversketching for 3D curves , 2004, SBM'04.

[18]  Cindy Grimm,et al.  A Framework for Synchronized Editing of Multiple Curve Representations , 1998, Comput. Graph. Forum.

[19]  Scott Schaefer,et al.  Lofting curve networks using subdivision surfaces , 2004, SGP '04.

[20]  Dae-Hyun Kim,et al.  Sketch- and constraint-based design of B-spline surfaces , 2002, SMA '02.

[21]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[22]  Lee Markosian,et al.  An interface for sketching 3D curves , 1999, SI3D.

[23]  Thomas Baudel,et al.  A mark-based interaction paradigm for free-hand drawing , 1994, UIST '94.

[24]  Jun Rekimoto,et al.  TouchEngine: a tactile display for handheld devices , 2002, CHI Extended Abstracts.

[25]  Jaehoon Jung,et al.  Hand-held virtual reality: a feasibility study , 2006, VRST '06.

[26]  Frank Nielsen,et al.  A sketching interface for modeling the internal structures of 3D shapes , 2006, Smart Graphics.

[27]  Eric Horvitz,et al.  Foreground and background interaction with sensor-enhanced mobile devices , 2005, TCHI.

[28]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.