Tai Chi Care: An Exergaming Software using Microsoft Kinect V2 for Blind or Low Vision Person during Confinement

Blind or low vision people need to practice activities for their mental and physical health to minimize the risk of suffering from articulation pain but they have problems due to difficulties and inaccessibility of displacement especially during the COVID-19 pandemic where everyone in this world was asked to stay at home during confinement. To solve these problems, we have developed a software tool for a care Tai Chi exergaming to encourage them to practice exercise at home using body tracking by Microsoft Kinect V2 and audio feedback. This software acts as a Tai Chi treatment, teaches four poses, and has a customized audio feedback to help person to understand each pose and generates progress graphs to evaluate the success of these exercises. We used the SDK libraries of the Kinect to obtain 3D joint position from sensors of the Kinect to calculate the angles and distances between joints to help the person to position in front of the Kinect, evaluate the different gestures of flexions and extensions of knees and elbows of each exercises, and body balance direction to avoid falling risk. These exercises have been evaluated with persons who are blind or low vision to improve feasibility and feedback.

[1]  Hossein Mousavi Hondori,et al.  A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation , 2014, Journal of medical engineering.

[2]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[3]  Luca Romeo,et al.  An instrumental approach for monitoring physical exercises in a visual markerless scenario: A proof of concept. , 2018, Journal of biomechanics.

[4]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[5]  Ge Wu,et al.  Improvement of isokinetic knee extensor strength and reduction of postural sway in the elderly from long-term Tai Chi exercise. , 2002, Archives of physical medicine and rehabilitation.

[6]  Wei Liu,et al.  Spatial, temporal and muscle action patterns of Tai Chi gait. , 2004, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  P. Wayne,et al.  The Impact of Tai Chi Exercise on Self-Efficacy, Social Support, and Empowerment in Heart Failure: Insights from a Qualitative Sub-Study from a Randomized Controlled Trial , 2016, PloS one.

[8]  Marjorie Skubic,et al.  In-home fall risk assessment and detection sensor system. , 2013, Journal of gerontological nursing.

[9]  Matteo Munaro,et al.  Performance evaluation of the 1st and 2nd generation Kinect for multimedia applications , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[10]  J. Woo,et al.  A randomised controlled trial of Tai Chi and resistance exercise on bone health, muscle strength and balance in community-living elderly people. , 2007, Age and ageing.

[11]  Amee L. Seitz,et al.  Validity and reliability of Kinect skeleton for measuring shoulder joint angles: a feasibility study. , 2015, Physiotherapy.

[12]  Hee Chan Kim,et al.  Measurement of Shoulder Range of Motion in Patients with Adhesive Capsulitis Using a Kinect , 2015, PloS one.

[13]  Neil Savage Playing at health , 2014, Commun. ACM.

[14]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[15]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[16]  Quantitative Motion Analysis of Tai Chi Chuan: The Upper Extremity Movement , 2018, BioMed research international.

[17]  Yao-Hsu Yang,et al.  Tai-Chi-Chuan Exercise Improves Pulmonary Function and Decreases Exhaled Nitric Oxide Level in Both Asthmatic and Nonasthmatic Children and Improves Quality of Life in Children with Asthma , 2017, Evidence-based complementary and alternative medicine : eCAM.

[18]  Mansib Rahman,et al.  Beginning Microsoft Kinect for Windows SDK 2.0 , 2017, Apress.

[19]  T. Nomura,et al.  Impact of Tai Chi Yuttari-exercise on arteriosclerosis and physical function in older people. , 2020, Archives of gerontology and geriatrics.

[20]  Guohua Zheng,et al.  Subjective perceived impact of Tai Chi training on physical and mental health among community older adults at risk for ischemic stroke: a qualitative study , 2017, BMC Complementary and Alternative Medicine.

[21]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.