Kinect-Based Virtual Game for the Elderly that Detects Incorrect Body Postures in Real Time

Poor posture can result in loss of physical function, which is necessary to preserving independence in later life. Its decline is often the determining factor for loss of independence in the elderly. To avoid this, a system to correct poor posture in the elderly, designed for Kinect-based indoor applications, is proposed in this paper. Due to the importance of maintaining a healthy life style in senior citizens, the system has been integrated into a game which focuses on their physical stimulation. The game encourages users to perform physical activities while the posture correction system helps them to adopt proper posture. The system captures limb node data received from the Kinect sensor in order to detect posture variations in real time. The DTW algorithm compares the original posture with the current one to detect any deviation from the original correct position. The system was tested and achieved a successful detection percentage of 95.20%. Experimental tests performed in a nursing home with different users show the effectiveness of the proposed solution.

[1]  Geoffrey E. Hinton,et al.  Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls , 1997, IEEE Trans. Neural Networks.

[2]  Anne Collins McLaughlin,et al.  Successful aging through digital games: Socioemotional differences between older adult gamers and Non-gamers , 2013, Comput. Hum. Behav..

[3]  Begoña García Zapirain,et al.  Elderly user experience to improve a Kinect-based game playability , 2015, Behav. Inf. Technol..

[4]  Hui Li,et al.  Kinect Based Dynamic Hand Gesture Recognition Algorithm Research , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[5]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[6]  K. McConville.  Virtual Rehabilitation and Training for Postural Balance and Neuromuscular Control , 2012 .

[7]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[8]  Stepán Obdrzálek,et al.  Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[10]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Wenbing Zhao,et al.  Rule based realtime motion assessment for rehabilitation exercises , 2014, 2014 IEEE Symposium on Computational Intelligence in Healthcare and e-health (CICARE).

[12]  Marcus Wan,et al.  The dynamics of younger and older adult's paired behavior when playing an interactive silhouette game , 2013, CHI.

[13]  Yea-Ru Yang,et al.  Virtual reality based Wii Fit training in improving muscle strength, sensory integration ability and walking abilities in patients with Parkinson’s disease: a randomized control trial , 2015 .

[14]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[15]  Fernandes Sms,et al.  Effects of educational sessions on school backpack use among elementary school students Efeitos de sessões educativas no uso das mochilas escolares em estudantes do ensino fundamental I , 2008 .

[16]  Kathrin Gerling,et al.  When Gaming is not Suitable for Everyone: Playtesting Wii Games with Frail Elderly , 2011 .

[17]  J. Cantallops,et al.  Effects of a postural education program on school backpack habits related to low back pain in children , 2013, European Spine Journal.

[18]  H. Suarez,et al.  Postural adaptation in elderly patients with instability and risk of falling after balance training using a virtual-reality system. , 2006, The international tinnitus journal.

[19]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[20]  Berry Mj,et al.  Enhancing adherence to prescribed exercise: structured behavioral interventions in clinical exercise programs. , 2001 .

[21]  Pierre Côté,et al.  Incidence and Course of Low Back Pain Episodes in the General Population , 2005, Spine.

[22]  M. Berry,et al.  Enhancing adherence to prescribed exercise: structured behavioral interventions in clinical exercise programs. , 2001, Journal of cardiopulmonary rehabilitation.

[23]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[24]  S. M. João,et al.  Efeitos de sessões educativas no uso das mochilas escolares em estudantes do ensino fundamental I , 2008 .

[25]  K Rodahl,et al.  Physical fitness as a predictor of mortality among healthy, middle-aged Norwegian men. , 1993, The New England journal of medicine.

[26]  Y. Nishiwaki,et al.  Spinal posture in the sagittal plane is associated with future dependence in activities of daily living: a community-based cohort study of older adults in Japan. , 2013, The journals of gerontology. Series A, Biological sciences and medical sciences.

[27]  Marc Herrlich,et al.  Exergames for Physiotherapy and Rehabilitation: A Medium-term Situated Study of Motivational Aspects and Impact on Functional Reach , 2015, CHI.

[28]  Wenbing Zhao,et al.  A Kinect-based rehabilitation exercise monitoring and guidance system , 2014, 2014 IEEE 5th International Conference on Software Engineering and Service Science.

[29]  Eric M. Wood,et al.  Prevalence of low back pain by anatomic location and intensity in an occupational population , 2014, BMC Musculoskeletal Disorders.

[30]  J. Manson,et al.  Physical activity and mortality: a prospective study among women. , 2001, American journal of public health.

[31]  Li Zheng.  DTW Based Pattern Matching Method for Multivariate Time Series , 2011 .

[32]  Vassilis Athitsos,et al.  Sign language recognition using dynamic time warping and hand shape distance based on histogram of oriented gradient features , 2014, PETRA.

[33]  Wei Peng,et al.  Is Playing Exergames Really Exercising? A Meta-Analysis of Energy Expenditure in Active Video Games , 2011, Cyberpsychology Behav. Soc. Netw..

[34]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[35]  Yao-Jen Chang,et al.  A Kinect-based upper limb rehabilitation system to assist people with cerebral palsy. , 2013, Research in developmental disabilities.

[36]  Xing-Dong Yang,et al.  Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises , 2015, CHI.

[37]  Regan L. Mandryk,et al.  Full-body motion-based game interaction for older adults , 2012, CHI.

[38]  R A Kronmal,et al.  Risk factors for 5-year mortality in older adults: the Cardiovascular Health Study. , 1998, JAMA.

[39]  Alex Carmichael,et al.  Investigating a DTV-based physical activity application to facilitate wellbeing in older adults , 2010, BCS HCI.

[40]  Albert A. Rizzo,et al.  Towards pervasive physical rehabilitation using Microsoft Kinect , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[41]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[42]  Amy Shirong Lu,et al.  A Scoping Review of Health Game Research: Past, Present, and Future. , 2012, Games for health journal.

[43]  Lennart Nacke,et al.  Gameplay experience testing with playability and usability surveys – An experimental pilot study , 2010 .

[44]  Stacy J. Morris Bamberg,et al.  A feasibility study of an upper limb rehabilitation system using kinect and computer games , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Francisco Javier Díaz Pernas,et al.  A Kinect-based system for cognitive rehabilitation exercises monitoring , 2014, Comput. Methods Programs Biomed..