[POSTER] ChiroChroma: An Augmented Reality Game for the Assessment of Hand Motor Functionality

For a better understanding of how different diseases (e.g. neurovascular diseases, neurodegenerative diseases, and musculoskeletal pain conditions) affect human motor function, a uniform, standardized and objective evaluation is a desirable goal expressed within the clinical community. We explore the capabilities of an augmented reality (AR) game that uses free hand interaction to facilitate an objective assessment of the upper extremity motor dysfunction. First, the design process of the game and the system architecture are described. Second, a study about usability of the AR framework and game engagement is presented based on an experiment we conducted with five patients and ten healthy people. Lastly, a short analysis of the accuracy of the hand data when participants performed “fingers tapping” gesture is done. The results of the study show that even though users experienced the system as physically and mentally demanding, it was engaging enough to make them complete the game. The study also shows that hand data captured is accurate enough to allow a high degree (95%) of pinching gesture recognition.

[1]  Ehud Dayan,et al.  Virtual reality immersion method of distraction to control experimental ischemic pain. , 2006, The Israel Medical Association journal : IMAJ.

[2]  Meng Ma,et al.  MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system , 2016, Comput. Methods Programs Biomed..

[3]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Xun Luo,et al.  An augmented reality training environment for post-stroke finger extension rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[5]  Walter Correia,et al.  Virtual Reality Immersion: An Important Tool for Diagnostic Analysis and Rehabilitation of People with Disabilities , 2013, HCI.

[6]  Neil A. Dodgson,et al.  Variation and extrema of human interpupillary distance , 2004, IS&T/SPIE Electronic Imaging.

[7]  Cristina V. Lopes,et al.  Free-hand interaction with leap motion controller for stroke rehabilitation , 2014, CHI Extended Abstracts.

[8]  John R. Wilson,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999, Presence: Teleoperators & Virtual Environments.

[9]  D. Kort,et al.  The Game Experience Questionnaire , 2013 .

[10]  Karolien Poels,et al.  Measuring the experience of digital game enjoyment , 2008 .

[11]  Abdulmotaleb El-Saddik,et al.  AR-REHAB: An Augmented Reality Framework for Poststroke-Patient Rehabilitation , 2010, IEEE Transactions on Instrumentation and Measurement.

[12]  Brenda K. Wiederhold,et al.  Virtual Reality and Interactive Simulation for Pain Distraction , 2007 .

[13]  Y. Shen,et al.  Hand rehabilitation based on augmented reality , 2009, i-CREATe.

[14]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[15]  Bartholomäus Wissmath,et al.  Immersion in Computer Games: The Role of Spatial Presence and Flow , 2011, Int. J. Comput. Games Technol..

[16]  P. Martínez-Martín,et al.  Unified Parkinson's disease rating scale characteristics and structure , 1994, Movement disorders : official journal of the Movement Disorder Society.

[17]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[18]  R. D. de Haan,et al.  Determinants of disability and quality of life in mild to moderate Parkinson disease , 2008, Neurology.

[19]  Cristina V. Lopes,et al.  A Spatial Augmented Reality Rehab System for Post-Stroke Hand Rehabilitation , 2013, MMVR.

[20]  Amanda G Thrift,et al.  Factors associated with quality of life in 7-year survivors of stroke , 2011, Journal of Neurology, Neurosurgery & Psychiatry.