Multimedia environment toward analyzing and visualizing live kinematic data for children with Hemiplegia

In this paper we propose a multimedia environment that can capture kinematic data from live gestures of a child having Hemiplegia disability and generate live analytical results as part of decision making system of a therapist. The kinematic data is obtained from clinically suggested therapy modules that are used to monitor quality of improvement of a disabled child, which includes exercises involving the affected joints and muscles. The methodology proposed is non-invasive as the child does not need to wear any external devices in the body. The multimedia environment incorporates Second Life serious game environment coupled with Microsoft Kinect where the live therapeutic movement of child, and therapist is synchronized between physical and virtual world. Our preliminary test results are validated by the therapists from three different disability hospitals that treat children with Hemiplegia, which is presented in this paper.

[1]  Abdulmotaleb El-Saddik,et al.  Serious Games for Rehabilitation of Stroke Patients with Vibrotactile Feedback , 2010, Int. J. Comput. Sci. Sport.

[2]  S. Hanna,et al.  Reference Curves for the Gross Motor Function Measure: Percentiles for Clinical Description and Tracking Over Time Among Children With Cerebral Palsy , 2008, Physical Therapy.

[3]  Albert A. Rizzo,et al.  Towards pervasive physical rehabilitation using Microsoft Kinect , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[4]  Veronica Teichrieb,et al.  Poster: Improving motor rehabilitation process through a natural interaction based system using Kinect sensor , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[5]  G. Riva,et al.  A Second Life for eHealth: Prospects for the Use of 3-D Virtual Worlds in Clinical Psychology , 2008, Journal of medical Internet research.

[6]  Ann Johnson,et al.  Cerebral palsies: epidemiology and causal pathways , 2000, Archives of disease in childhood.

[7]  Todd Ingalls,et al.  Design of a home-based adaptive mixed reality rehabilitation system for stroke survivors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  B. S. Hoppestad,et al.  Inadequacies in computer access using assistive technology devices in profoundly disabled individuals: An overview of the current literature , 2007, Disability and rehabilitation. Assistive technology.

[9]  Margrit Betke,et al.  Early experiences using visual tracking for computer access by people with profound physical disabilities , 2001, HCI.

[10]  Blandine Calais-Germain.  Anatomy of Movement , 1993 .

[11]  Xing Yan,et al.  Research on Skeleton Animation Motion Data Based on Kinect , 2012, 2012 Fifth International Symposium on Computational Intelligence and Design.

[12]  Jenny Ziviani,et al.  Systematic Review and Meta-analysis of Therapeutic Management of Upper-Limb Dysfunction in Children With Congenital Hemiplegia , 2009, Pediatrics.

[13]  V. Sansone,et al.  Preoperative calculation of the necessary correction in sagittal imbalance surgery: validation of three predictive methods , 2013, European Spine Journal.

[14]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[15]  Minhua Ma,et al.  Serious games for movement therapy after stroke , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[16]  Jacqui Crosbie,et al.  Adaptive Virtual Reality Games for Rehabilitation of Motor Disorders , 2007, HCI.

[17]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[18]  G. Burdea,et al.  PlayStation 3-based tele-rehabilitation for children with hemiplegia , 2008, 2008 Virtual Rehabilitation.

[19]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[20]  R. Macko,et al.  Testing a Model of Post‐Stroke Exercise Behavior , 2006, Rehabilitation nursing : the official journal of the Association of Rehabilitation Nurses.

[21]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[22]  Ralf Steinmetz,et al.  Context aware serious games framework for sport and health , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[23]  Youn Joo Kang,et al.  Effect of Proprioception Training of patient with Hemiplegia by Manipulating Visual Feedback using Virtual Reality: The Preliminary results , 2009, 2009 IEEE Virtual Reality Conference.

[24]  Eugene Fiume,et al.  Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion , 2005, SCA '05.

[25]  S. Saini,et al.  A low-cost game framework for a home-based stroke rehabilitation system , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[26]  Ran Gilad-Bachrach,et al.  Full body gait analysis with Kinect , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  W. L. Minear.  SPECIAL ARTICLE A CLASSIFICATION OF CEREBRAL PALSY , 1956 .

[28]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[29]  G. Andersson,et al.  Normal range of motion of the hip, knee and ankle joints in male subjects, 30-40 years of age. , 1982, Acta orthopaedica Scandinavica.

[30]  Heba M. Lakany,et al.  Extracting a diagnostic gait signature , 2008, Pattern Recognit..

[31]  J. Norris,et al.  The Growth and Direction of Healthcare Support Groups in Virtual Worlds , 2009 .

[32]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[33]  Grigore C. Burdea,et al.  Feasibility of Modified Remotely Monitored In-Home Gaming Technology for Improving Hand Function in Adolescents With Cerebral Palsy , 2010, IEEE Transactions on Information Technology in Biomedicine.

[34]  Jonathan W. Decker,et al.  Performance measurements for the Microsoft Kinect skeleton , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[35]  Albert A. Rizzo,et al.  FAAST: The Flexible Action and Articulated Skeleton Toolkit , 2011, 2011 IEEE Virtual Reality Conference.

[36]  Linda Harley,et al.  The Design of an Interactive Stroke Rehabilitation Gaming System , 2011, HCI.

[37]  Abdulmotaleb El-Saddik,et al.  Building Dynamic Social Network From Sensory Data Feed , 2010, IEEE Transactions on Instrumentation and Measurement.

[38]  Dinesh K. Pai,et al.  Musculotendon simulation for hand animation , 2008, ACM Trans. Graph..

[39]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[40]  Matjaz Gams,et al.  Automatic recognition of gait-related health problems in the elderly using machine learning , 2012, Multimedia Tools and Applications.

[41]  C S Green,et al.  Action-Video-Game Experience Alters the Spatial Resolution of Vision , 2007, Psychological science.

[42]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[43]  Miriam Vollenbroek-Hutten,et al.  Chronic pain rehabilitation with a serious game using multimodal input , 2011, 2011 International Conference on Virtual Rehabilitation.

[44]  Albert A. Rizzo,et al.  Interactive game-based rehabilitation using the Microsoft Kinect , 2012, 2012 IEEE Virtual Reality Workshops (VRW).