Optical Marionette: Graphical Manipulation of Human's Walking Direction

We present a novel manipulation method that subconsciously changes the walking direction of users via visual processing on a head mounted display (HMD). Unlike existing navigation systems that require users to recognize information and then follow directions as two separate, conscious processes, the proposed method guides users without them needing to pay attention to the information provided by the navigation system and also allows them to be graphically manipulated by controllers. In the proposed system, users perceive the real world by means of stereo images provided by a stereo camera and the HMD. Specifically, while walking, the navigation system provides users with real-time feedback by processing the images they have just perceived and giving them visual stimuli. This study examined two image-processing methods for manipulation of human's walking direction: moving stripe pattern and changing focal region. Experimental results indicate that the changing focal region method most effectively leads walkers as it changes their walking path by approximately 200 mm/m on average.

[1]  William B. Thompson,et al.  HMD calibration and its effects on distance judgments , 2008, APGV '08.

[2]  H. Kajimoto,et al.  “Hanger reflex”:A reflex motion of a head by temporal pressure for wearable interface , 2008, 2008 SICE Annual Conference.

[3]  David R. Morse,et al.  AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface , 2002, Personal and Ubiquitous Computing.

[4]  Gerd Bruder,et al.  Cognitive Resource Demands of Redirected Walking , 2015, IEEE Transactions on Visualization and Computer Graphics.

[5]  Tomohiro Amemiya,et al.  Shaking the world: galvanic vestibular stimulation as a novel sensation interface , 2005, SIGGRAPH '05.

[6]  Bernhard E. Riecke,et al.  Compelling Self-Motion Through Virtual Environments Without Actual Self-Motion – Using Self-Motion Illusions ('Vection') to Improve VR User Experience , 2010 .

[7]  Michael Rohs,et al.  Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation , 2015, CHI.

[8]  Frank Dellaert,et al.  SWAN: System for Wearable Audio Navigation , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[9]  Hiroyuki Kajimoto,et al.  Pull-navi: a novel tactile navigation interface by pulling the ears , 2009, SIGGRAPH '09.

[10]  Gerd Bruder,et al.  Tuning Self-Motion Perception in Virtual Reality with Visual Illusions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jens Herder,et al.  Steering actors through a virtual set employing vibro-tactile feedback , 2009, Tangible and Embedded Interaction.

[12]  Gerd Bruder,et al.  Going with the flow: Modifying self-motion perception with computer-mediated optic flow , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[13]  Akira Ishii,et al.  Graphical manipulation of human's walking direction with visual illusion , 2016, SIGGRAPH Emerging Technologies.

[14]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[15]  Takuji Narumi,et al.  Reflex-Based Navigation by Inducing Self-motion Perception with Head-Mounted Vection Display , 2012, Advances in Computer Entertainment.

[16]  Heinrich H. Bülthoff,et al.  Circular, Linear, and Curvilinear Vection in a Large-screen Virtual Environment with Floor Projection , 2008, 2008 IEEE Virtual Reality Conference.

[17]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[18]  J. Lishman,et al.  The Autonomy of Visual Kinaesthesis , 1973, Perception.

[19]  K. Heilman,et al.  Effects of monocular viewing and eye dominance on spatial attention. , 2002, Brain : a journal of neurology.

[20]  Pedro Lopes,et al.  Affordance++: Allowing Objects to Communicate Dynamic Use , 2015, CHI.

[21]  M. Carrasco,et al.  How do attention and adaptation affect contrast sensitivity? , 2007, Journal of vision.

[22]  Mark T. Bolas,et al.  Making small spaces feel large: infinite walking in virtual reality , 2015, SIGGRAPH Emerging Technologies.

[23]  Hideyuki Ando,et al.  Effective galvanic vestibular stimulation in synchronizing with ocular movement , 2011, AH '11.

[24]  Hiroyuki Kajimoto,et al.  Development of a wrist-twisting haptic display using the hanger reflex , 2014, Advances in Computer Entertainment.

[25]  Gerd Bruder,et al.  A taxonomy for deploying redirection techniques in immersive virtual environments , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[26]  R. Fitzpatrick,et al.  Effects of galvanic vestibular stimulation during human walking , 1999, The Journal of physiology.

[27]  M. Sile O'Modhrain,et al.  GpsTunes: controlling navigation via audio feedback , 2005, Mobile HCI.

[28]  Hideyuki Ando,et al.  Virtual acceleration with galvanic vestibular stimulation in a virtual reality environment , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[29]  Hiroyuki Kajimoto,et al.  "Vection field" for pedestrian traffic control , 2011, AH '11.

[30]  J. Gibson.  The visual perception of objective motion and subjective movement. , 1994, Psychological review.

[31]  Michael Wong,et al.  The Effect of Optical Magnification/Minimization on Distance Estimation by Stationary and Walking Observers , 2010 .