Integration of Augmented Reality with Pressing Evaluation and Training System for Finger Force Training

One major concern for the elderly is the decline in their ability to control their hands, which can significantly affect their ability to perform activities of daily living. One of the important hand functions that deteriorate over time is the ability to control finger force exertion, due to the gradual decrease in finger muscle strength as people age. Previous studies have shown that with proper training, it is possible to regain finger strength. However, when designing training systems for finger force control, visualization of the finger forces plays an important role in its effectiveness. In this paper, we describe the development of the augmented reality pressing and evaluation system (AR-PETS), an augmented reality based prototype system for finger force control training. We discuss the development of the system, as well as the design considerations during the development of the system.

[1]  Vicky Chan,et al.  Robot-assisted Guitar Hero for finger rehabilitation after stroke , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Hossein Mousavi Hondori,et al.  Choice of Human–Computer Interaction Mode in Stroke Rehabilitation , 2016, Neurorehabilitation and neural repair.

[3]  E. Noé,et al.  Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke , 2016, Journal of NeuroEngineering and Rehabilitation.

[4]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[5]  G. Yue,et al.  Effects of Aging on Hand Function , 2001, Journal of the American Geriatrics Society.

[6]  Hirokazu Kato,et al.  AR-PETS: Development of an Augmented Reality Supported Pressing Evaluation Training System , 2018, HCI.

[7]  Ke Li,et al.  Removal of visual feedback lowers structural variability of inter-digit force coordination during sustained precision pinch , 2013, Neuroscience Letters.

[8]  Anton L. Fuhrmann,et al.  Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art , 2018 .

[9]  T. Milner,et al.  HandCARE: A Cable-Actuated Rehabilitation System to Train Hand Function After Stroke , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  K. Yuen,et al.  Effectiveness of coordination exercise in improving cognitive function in older adults: a prospective study , 2011, Clinical interventions in aging.

[11]  E. Schneider,et al.  Real-time computer-based visual feedback improves visual acuity in downbeat nystagmus – a pilot study , 2016, Journal of NeuroEngineering and Rehabilitation.

[12]  Todd Ingalls,et al.  Real-Time Sonification of Movement for an Immersive Stroke Rehabilitation Environment , 2009 .

[13]  Alejandro Baldominos Gómez,et al.  An Approach to Physical Rehabilitation Using State-of-the-art Virtual Reality and Motion Tracking Technologies , 2015, CENTERIS/ProjMAN/HCist.

[14]  Mark L Latash,et al.  The effects of strength training on finger strength and hand dexterity in healthy elderly individuals. , 2008, Journal of applied physiology.

[15]  Mark L. Latash,et al.  Finger force changes in the absence of visual feedback in patients with Parkinson’s disease , 2016, Clinical Neurophysiology.

[16]  Angela DiDomenico Astin,et al.  Finger force capability: measurement and prediction using anthropometric and myoelectric measures , 1999 .

[17]  Justin B. Rowe,et al.  Design and preliminary evaluation of the FINGER rehabilitation robot: controlling challenge and quantifying finger individuation during musical computer game play , 2014, Journal of NeuroEngineering and Rehabilitation.

[18]  K. J. Cole,et al.  Handling objects in old age: forces and moments acting on the object. , 2012, Journal of applied physiology.

[19]  M. Hackel,et al.  Changes in hand function in the aging adult as determined by the Jebsen Test of Hand Function. , 1992, Physical therapy.

[20]  Darryl Charles,et al.  Augmented Reality Games for Upper-Limb Stroke Rehabilitation , 2009, 2010 Second International Conference on Games and Virtual Worlds for Serious Applications.

[21]  Vladimir M. Zatsiorsky,et al.  Processes underlying unintentional finger-force changes in the absence of visual feedback , 2014, Experimental Brain Research.

[22]  Shweta Kapur,et al.  Age-related changes in the control of finger force vectors. , 2010, Journal of applied physiology.

[23]  Sri Hastuti Kurniawan,et al.  Project Star Catcher , 2018, ACM Trans. Access. Comput..

[24]  Andrea N. Reinkensmeyer,et al.  Retraining and assessing hand movement after stroke using the MusicGlove: comparison with conventional hand therapy and isometric grip training , 2014, Journal of NeuroEngineering and Rehabilitation.

[25]  Rod Barrett,et al.  Strength training improves the tri-digit finger-pinch force control of older adults. , 2007, Archives of physical medicine and rehabilitation.

[26]  Xun Luo,et al.  Integration of Augmented Reality and Assistive Devices for Post-Stroke Hand Opening Rehabilitation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[27]  M. Latash,et al.  Improving finger coordination in young and elderly persons , 2013, Experimental Brain Research.