Inspired by Human Eye: Vestibular Ocular Reflex Based Gimbal Camera Movement to Minimize Viewpoint Changes

Human eyeballs move relative to the head, resulting in optimal changes in the viewpoint. We tested similar vestibular ocular reflex (VOR)-based movement on Zenmuse-X3 gimbal camera relative to pre-defined YAW movements of the DJI Matrice-100 unmanned aerial vehicle (UAV). Changes in viewpoint have various consequences for visual and graphical rendering. Therefore, this study investigated how to minimize these changes. OpenGL visualization was performed to simulate and measure viewpoint changes using the proposed VOR-based eyeball movement algorithm and compared with results of VOR based gimbal movement. The gimbal camera was setup to render images (scenes) on flat monitors. Positions of pre-fixed targets in the images were used to measure the viewpoint changes. The proposed approach could successfully control and significantly reduce the viewpoint changes and stabilize the image to improve visual tracking of targets on flat monitors. The proposed method can also be used to render real-time camera feed to a head-mounted display (HMD) in an ergonomically pleasing way.

[1]  François Chaumette,et al.  Optimal Camera Trajectory with Image-Based Control , 2003, Int. J. Robotics Res..

[2]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[3]  G. Barnes.  Vestibulo‐ocular function during co‐ordinated head and eye movements to acquire visual targets. , 1979, The Journal of physiology.

[4]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[5]  Andreas Bulling,et al.  Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction , 2014, UbiComp Adjunct.

[6]  Young Ho Chai,et al.  An experimental study on relationship between foveal range and FoV of a human eye using eye tracking devices , 2018, 2018 International Conference on Electronics, Information, and Communication (ICEIC).

[7]  J R Wilson,et al.  Virtual environments applications and applied ergonomics. , 1999, Applied ergonomics.

[8]  Markus Huff,et al.  Tracking multiple objects across abrupt viewpoint changes , 2009 .

[9]  Joohwan Kim,et al.  Towards foveated rendering for gaze-tracked virtual reality , 2016, ACM Trans. Graph..

[10]  Abdenour Amamra,et al.  Smooth head tracking for virtual reality applications , 2016, Signal Image Video Process..

[11]  Robert J. Teather,et al.  Viewpoint Snapping to Reduce Cybersickness in Virtual Reality , 2018, Graphics Interface.

[12]  Colin Ware,et al.  Using the bat: a six-dimensional mouse for object placement , 1988, IEEE Computer Graphics and Applications.

[13]  James C. Lester,et al.  Cinematographic User Models for Automated Realtime Camera Control in Dynamic 3D Environments , 1997 .

[14]  G. Barnes,et al.  Independent control of head and gaze movements during head‐free pursuit in humans , 1999, The Journal of physiology.

[15]  Päivi Majaranta,et al.  Gaze Interaction and Applications of Eye Tracking - Advances in Assistive Technologies , 2011 .

[16]  O. Stepánková,et al.  Beyond Communication and Control: Environmental Control and Mobility by Gaze , 2012 .

[17]  Henry J. Gardner,et al.  Head Tracking in First-Person Games: Interaction Using a Web-Camera , 2009, INTERACT.

[18]  Markus Huff,et al.  Eye movements across viewpoint changes in multiple object tracking , 2010 .

[19]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[20]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[21]  Eric D. Ragan,et al.  Effects of Field of View and Visual Complexity on Virtual Reality Training Effectiveness for a Visual Scanning Task , 2015, IEEE Transactions on Visualization and Computer Graphics.

[22]  Fady T Charbel,et al.  Accuracy of ventriculostomy catheter placement using a head- and hand-tracked high-resolution virtual reality simulator with haptic feedback. , 2007, Journal of neurosurgery.

[23]  Sven Behnke,et al.  Feature-based head pose estimation from images , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[24]  Michael Fetter,et al.  Vestibulo-ocular reflex. , 2007, Developments in ophthalmology.

[25]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[26]  Li Shi.  Unmanned Aerial Vehicle Flight Simulation and Training System Based on Virtual Reality , 2002 .

[27]  Kyung-Soo Kim,et al.  Bioinspired Image Stabilization Control Using the Adaptive Gain Adjustment Scheme of Vestibulo-Ocular Reflex , 2016, IEEE/ASME Transactions on Mechatronics.

[28]  J. Leigh,et al.  Scientists in wonderland: A report on visualization applications in the CAVE virtual reality environment , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[29]  Claus B. Madsen,et al.  A Viewpoint Planning Strategy for Determining True Angles on Polyhedral Objects by Camera Alignment , 1997, IEEE Trans. Pattern Anal. Mach. Intell..