Study on interaction-induced symptoms with respect to virtual grasping and manipulation

Owing to the popularity of various hand tracking interfaces, there have been numerous applications developed to provide intuitive hand interaction with the virtual world. As users start with great anticipation, they end up with dissatisfaction due to difficulties of manipulation or physical tiredness coming very short. Although the task itself is rather trivial in a real life situation, it requires much effort in the virtual environment. We address this awkwardness as 'VR interaction-induced fatigue symptom' and hypothesize its causes based on our observations. We argue that the source of the fatigue comes from the restricted sensory information of the VR interfaces, and that users try to accommodate the missing sensory feedback by excessive motion leading to wrong posture or bad timing. We demonstrate our hypothesis by conducting experiments of two types of virtual interaction scenarios: object transport and 3D selection. Furthermore, by analyzing the behaviors of users' action collected from our experiment, we derive essential factors to be considered in designing VR applications, and propose a conceptual interaction model for orchestrating virtual grasping.

[1]  R S Johansson,et al.  Sensory input and control of grip. , 1998, Novartis Foundation symposium.

[2]  Grigore C. Burdea,et al.  Virtual reality simulation modeling for a haptic glove , 1999, Proceedings Computer Animation 1999.

[3]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[4]  J. Noth,et al.  Precision grip deficits in cerebellar disorders in man , 2001, Clinical Neurophysiology.

[5]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[6]  G. Allen,et al.  Cerebrocerebellar communication systems. , 1974, Physiological reviews.

[7]  Thomas A Matyas,et al.  Training of Somatosensory Discrimination After Stroke: Facilitation of Stimulus Generalization , 2005, American journal of physical medicine & rehabilitation.

[8]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[9]  M. Munih,et al.  Grasping and manipulation in virtual environment using 3By6 finger device , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[10]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[11]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[12]  Karl F. Stock,et al.  A COMPUTATIONAL MODEL , 2011 .

[13]  F C Guill,et al.  An evaluation of proposed causal mechanisms for "ejection associated" neck injuries. , 1989, Aviation, space, and environmental medicine.

[14]  Joachim Hermsdörfer,et al.  Moving objects with clumsy fingers: how predictive is grip force control in patients with impaired manual sensibility? , 2003, Clinical Neurophysiology.

[15]  N. Vøllestad.  Measurement of human muscle fatigue , 1997, Journal of Neuroscience Methods.

[16]  James F. Knight,et al.  Effect of Head-Mounted Displays on Posture , 2007, Hum. Factors.

[17]  Robert J. Wood,et al.  Towards a 3g crawling robot through the integration of microrobot technologies , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[18]  T. Ullmann,et al.  Intuitive virtual grasping for non haptic environments , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[19]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[20]  R. Johansson,et al.  Control of grip force during restraint of an object held between finger and thumb: responses of muscle and joint afferents from the digits , 2004, Experimental Brain Research.

[21]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[22]  Ming C. Lin,et al.  Haptic Rendering : Foundations, Algorithms, and Applications , 2008 .

[23]  T. M. Hamm,et al.  Influence of fatigue on hand muscle coordination and EMG-EMG coherence during three-digit grasping. , 2010, Journal of neurophysiology.

[24]  C. Hess,et al.  General features of motor fatigue - a review , 2010 .

[25]  R. Johansson,et al.  Control of grip force during restraint of an object held between finger and thumb: responses of cutaneous afferents from the digits , 1996, Experimental Brain Research.

[26]  G. Schlesinger.  Der mechanische Aufbau der künstlichen Glieder , 1919 .

[27]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[28]  Takami Yamaguchi,et al.  Physiological Studies of Human Fatigue by a Virtual Reality System , 1999, Presence: Teleoperators & Virtual Environments.

[29]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[30]  M. Jeannerod.  The formation of finger grip during prehension. A cortically mediated visuomotor pattern , 1986, Behavioural Brain Research.

[31]  Mellar P. Davis,et al.  Mechanisms of fatigue. , 2010, The journal of supportive oncology.

[32]  S. Adamovich,et al.  Sensorimotor Training in a Virtual Reality Environment: Does It Improve Functional Recovery Poststroke? , 2006, Neurorehabilitation and neural repair.

[33]  Gordon Cheng,et al.  A computational model of anterior intraparietal (AIP) neurons , 2006, Neurocomputing.

[34]  J. Fischer,et al.  The Prehensile Movements of the Human Hand , 2014 .

[35]  Daniel Thalmann,et al.  Multi-finger manipulation of virtual objects , 1996, VRST.

[36]  Jinah Park,et al.  Physically based grasping and manipulation method using pre-contact grasping quality measure , 2009, VRST '09.

[37]  Matei T. Ciocarlie,et al.  Grasp analysis using deformable fingers , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  John R. Wilson,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999, Presence: Teleoperators & Virtual Environments.

[39]  Christoph W. Borst,et al.  A Spring Model for Whole-Hand Virtual Grasping , 2006, Presence: Teleoperators & Virtual Environments.

[40]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[41]  Heni Ben Amor,et al.  An Animation System for Imitation of Object Grasping in Virtual Reality , 2006, ICAT.