Multisensor Serious Game-Based Therapy Environment for Hemiplegic Patients

We present an e-therapy framework that collects live therapeutic context by analyzing body joint data in a noninvasive way. Using our proposed framework, a therapist can model complex gestures by mapping them to a set of primitive gesture sequences and generate high-level serious game-based therapies. As a proof of concept, we have developed scenarios to express a hemiplegic patient's behavior into a set of trackable primitive gestures. We have used Second Life and Map browsing based serious game environment for immersive experience. The initial feedback from the therapists who have tested our developed framework is encouraging. Finally, we share the implementation details and analysis of test results.

[1]  C. Karen Liu.  Dextrous manipulation from a grasping pose , 2009, SIGGRAPH 2009.

[2]  Boo-Ho Yang,et al.  Development of the ring sensor for healthcare automation , 2000, Robotics Auton. Syst..

[3]  Abdulmotaleb El-Saddik,et al.  Augmenting Context Awareness by Combining Body Sensor Networks and Social Networks , 2011, IEEE Transactions on Instrumentation and Measurement.

[4]  M. Shamim Hossain,et al.  Context-aware multimedia services modeling: an e-Health perspective , 2013, Multimedia Tools and Applications.

[5]  Jenny Ziviani,et al.  Systematic Review and Meta-analysis of Therapeutic Management of Upper-Limb Dysfunction in Children With Congenital Hemiplegia , 2009, Pediatrics.

[6]  Abdulmotaleb El-Saddik,et al.  A framework toward detecting and visualizing kinematic data for children with Hemiplegia , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[7]  Maxim A. Batalin,et al.  MEDIC: Medical embedded device for individualized care , 2008, Artif. Intell. Medicine.

[8]  Wail Gueaieb,et al.  Context-aware social networks mashup: A personalized web perspective , 2010, 2010 IEEE Instrumentation & Measurement Technology Conference Proceedings.

[9]  Marjorie Skubic,et al.  Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Mohamed Abdur Rahman,et al.  Multimedia interactive therapy environment for children having physical disabilities , 2013, ICMR.

[11]  Ludovic Hoyet,et al.  Sleight of hand: perception of finger motion from reduced marker sets , 2012, I3D '12.

[12]  Siamak Rezaei,et al.  Integrating wireless EEGs into medical sensor networks , 2006, IWCMC '06.

[13]  Cuntai Guan,et al.  A feasibility study of non-invasive motor-imagery BCI-based robotic rehabilitation for Stroke patients , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[14]  Abdulmotaleb El-Saddik,et al.  Modeling Personalized and Context-Aware Multimedia e-Health Framework , 2013, Handbook of Medical and Healthcare Technologies.

[15]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[16]  Sachin Bhardwaj,et al.  Ubiquitous healthcare data analysis and monitoring using multiple wireless sensors for elderly person , 2008 .

[17]  Srdjan Krco.  Health Care Sensor Networks - Architecture and Protocols , 2005, Ad Hoc Sens. Wirel. Networks.

[18]  Margrit Betke,et al.  Early experiences using visual tracking for computer access by people with profound physical disabilities , 2001, HCI.

[19]  Blandine Calais-Germain.  Anatomy of Movement , 1993 .

[20]  Walter Herzog,et al.  Model-based estimation of muscle forces exerted during movements. , 2007, Clinical biomechanics.

[21]  J. Norris,et al.  The Growth and Direction of Healthcare Support Groups in Virtual Worlds , 2009 .

[22]  B. S. Hoppestad,et al.  Inadequacies in computer access using assistive technology devices in profoundly disabled individuals: An overview of the current literature , 2007, Disability and rehabilitation. Assistive technology.

[23]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[24]  G. Riva,et al.  A Second Life for eHealth: Prospects for the Use of 3-D Virtual Worlds in Clinical Psychology , 2008, Journal of medical Internet research.

[25]  Abdulmotaleb El-Saddik,et al.  Serious Games for Rehabilitation of Stroke Patients with Vibrotactile Feedback , 2010, Int. J. Comput. Sci. Sport.

[26]  A. Darzi,et al.  A Pervasive Body Sensor Network for Measuring Postoperative Recovery at Home , 2007, Surgical innovation.