Simulating eye-head coordination during smooth pursuit using an ocular biomechanic model

The main objective of all eye movements is to keep the image of the object of interest focused. Head motion makes this objective more complex. However, the vestibular system is responsible for eye movement that compensate head motion. Simulating and analysing eye movement in coordination with head and neck movements is useful for assessing visual system contribution to discomfort in different tasks especially related to motion such as simulation sickness. In this paper, we present an ocular biomechanic model integrated into a head and neck model and used to simulate and analyse eye-head coordination movement during smooth pursuit. The proposed model is based on the physiological and the kinematics properties of the human eye provided from clinical trials performed by Robinson and Collins and also magnetic resonance imaging studies. The model incorporates six extraocular muscles (EOMs) and their connective tissues, known as pulleys. The pulleys are modelled as moving points on the muscle path according to the Active Pulley Hypothesis (APH) provided by Kono et al. Dynamic simulations of smooth pursuit with head movement is presented. The model achieved root mean square error (RMSE) of 0.77°, 0.29°and 0.14°for the horizontal, vertical and torsional rotation angles. It can be further used to simulate and analyse the vestibulo-ocular reflex of the eye.

[1]  Saeid Nahavandi,et al.  Body joints regression using deep convolutional neural networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Saeid Nahavandi,et al.  Efficacy comparison of clustering systems for limb detection , 2014, 2014 9th International Conference on System of Systems Engineering (SOSE).

[3]  Jingjing Xiao,et al.  LGT/VOT tracking performance evaluation of depth images , 2014, 2014 9th International Conference on System of Systems Engineering (SOSE).

[4]  Saeid Nahavandi,et al.  Feature-Based Image Fusion Quality Metrics , 2008, ICIRA.

[5]  Paul Jaffe,et al.  Orbital mechanics , 2017, IEEE Spectrum.

[6]  Julie Iskander,et al.  Ergonomic effects of using Lift Augmentation Devices in mining activities , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[7]  Matthew Millard,et al.  Flexing computational muscle: modeling and simulation of musculotendon dynamics. , 2013, Journal of biomechanical engineering.

[8]  Saeid Nahavandi,et al.  Towards autonomous image fusion , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[9]  Nahavandi Saeid,et al.  Semantic body parts segmentation for quadrupedal animals , 2016 .

[10]  J. L. Gordon,et al.  A model of the smooth pursuit eye movement system , 1986, Biological Cybernetics.

[11]  R. Leigh,et al.  The neurology of eye movements , 2006 .

[12]  J. Demer,et al.  Active pulleys: magnetic resonance imaging of rectus muscle paths in tertiary gazes. , 2002, Investigative ophthalmology & visual science.

[13]  Jeffrey A Reinbolt,et al.  OpenSim: a musculoskeletal modeling and simulation framework for in silico investigations and exchange. , 2011, Procedia IUTAM.

[14]  D. Tweed,et al.  Adaptive neural mechanism for listing's law revealed in patients with fourth nerve palsy. , 2002, Investigative ophthalmology & visual science.

[15]  S. Nahavandi,et al.  Color map-based image fusion , 2008, 2008 6th IEEE International Conference on Industrial Informatics.

[16]  J M Miller,et al.  A model of the mechanics of binocular alignment. , 1984, Computers and biomedical research, an international journal.

[17]  Saeid Nahavandi,et al.  Real Time Ergonomic Assessment for Assembly Operations Using Kinect , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[18]  Saeid Nahavandi,et al.  An adaptable system for RGB-D based human body detection and pose estimation: Incorporating attached props , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[19]  Saeid Nahavandi,et al.  Body Parts Segmentation with Attached Props Using RGB-D Imaging , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[20]  Qi Wei,et al.  Physically-based modeling and simulation of extraocular muscles. , 2010, Progress in biophysics and molecular biology.

[21]  J. Demer,et al.  Evidence for a pulley of the inferior oblique muscle. , 2003, Investigative ophthalmology & visual science.

[22]  Mohammed Hossny,et al.  Skeleton-free RULA ergonomic assessment using Kinect sensors , 2017, Intell. Decis. Technol..

[23]  Jochen Triesch,et al.  OpenEyeSim: A biomechanical model for simulation of closed-loop visual perception. , 2016, Journal of vision.

[24]  Saeid Nahavandi,et al.  Image Fusion Metrics: Evolution in a Nutshell , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[25]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[26]  Saeid Nahavandi,et al.  A Skeleton-Free Fall Detection System From Depth Images Using Random Decision Forest , 2018, IEEE Systems Journal.

[27]  D. Robinson,et al.  Mechanical components of human eye movements. , 1969, Journal of applied physiology.

[28]  S. Delp,et al.  Influence of Muscle Morphometry and Moment Arms on the Moment‐Generating Capacity of Human Neck Muscles , 1998, Spine.

[29]  Saeid Nahavandi,et al.  Measuring depth accuracy in RGBD cameras , 2013, 2013, 7th International Conference on Signal Processing and Communication Systems (ICSPCS).

[30]  Emilio Bizzi,et al.  The coordination of eye and head movement during smooth pursuit , 1978, Brain Research.

[31]  Mohammed Hossny,et al.  Skeleton-free task-specific rapid upper limb ergonomie assessment using depth imaging sensors , 2016, 2016 IEEE SENSORS.

[32]  Saeid Nahavandi,et al.  An Evaluation Mechanism for Saliency Functions Used in Localized Image Fusion Quality Metrics , 2012, 2012 UKSim 14th International Conference on Computer Modelling and Simulation.

[33]  Saeid Nahavandi,et al.  Image fusion algorithms and metrics duality index , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[34]  W. D. Wright Physiological Optics , 1958, Nature.

[35]  T. Haslwanter,et al.  SEE++: A Biomechanical Model of the Oculomotor Plant , 2005, Annals of the New York Academy of Sciences.

[36]  H. Burian,et al.  Binocular vision and ocular motility , 1975 .

[37]  Saeid Nahavandi,et al.  Zero and infinity images in multi-scale image fusion , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[38]  S. Nahavandi,et al.  A Quadtree Driven Image Fusion Quality Assessment , 2007, 2007 5th IEEE International Conference on Industrial Informatics.

[39]  Dora E. Angelaki,et al.  The oculomotor plant and its role in three-dimensional eye orientation , 2011 .

[40]  D. Robinson A quantitative analysis of extraocular muscle cooperation and squint. , 1975, Investigative ophthalmology.