i-Therapy: a non-invasive multimedia authoring framework for context-aware therapy design

In this paper, we present an e-Therapy framework, named i-Therapy, which collects live therapeutic context by analyzing multi-sensory body joint data in a non-invasive way. Using our proposed framework, a therapist can model complex gestures by mapping them to a set of primitive gesture sequences and generate high-level therapies. As a proof of concept, we have developed scenarios to express a Hemiplegic patient’s behavior into a set of track-able primitive gestures. The initial feedback from the therapists who have tested our developed framework is encouraging. Finally, we share the implementation details and analysis of test results.

[1]  Antonio Corradi,et al.  Context-aware middleware solutions for anytime and anywhere emergency assistance to elderly people , 2006, IEEE Communications Magazine.

[2]  Srdjan Krco.  Health Care Sensor Networks - Architecture and Protocols , 2005, Ad Hoc Sens. Wirel. Networks.

[3]  Albert A. Rizzo,et al.  FAAST: The Flexible Action and Articulated Skeleton Toolkit , 2011, 2011 IEEE Virtual Reality Conference.

[4]  G. Burdea,et al.  PlayStation 3-based tele-rehabilitation for children with hemiplegia , 2008, 2008 Virtual Rehabilitation.

[5]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[6]  Sachin Bhardwaj,et al.  Ubiquitous healthcare data analysis and monitoring using multiple wireless sensors for elderly person , 2008 .

[7]  A. Darzi,et al.  A Pervasive Body Sensor Network for Measuring Postoperative Recovery at Home , 2007, Surgical innovation.

[8]  Marjorie Skubic,et al.  Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Abdulmotaleb El-Saddik,et al.  Augmenting Context Awareness by Combining Body Sensor Networks and Social Networks , 2011, IEEE Transactions on Instrumentation and Measurement.

[10]  Mohan Kumar,et al.  High accuracy context recovery using clustering mechanisms , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[11]  Linda Harley,et al.  The Design of an Interactive Stroke Rehabilitation Gaming System , 2011, HCI.

[12]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[13]  Siamak Rezaei,et al.  Integrating wireless EEGs into medical sensor networks , 2006, IWCMC '06.

[14]  Jonathan W. Decker,et al.  Performance measurements for the Microsoft Kinect skeleton , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[15]  G. Riva,et al.  A Second Life for eHealth: Prospects for the Use of 3-D Virtual Worlds in Clinical Psychology , 2008, Journal of medical Internet research.

[16]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[17]  Dinesh K. Pai,et al.  Musculotendon simulation for hand animation , 2008, ACM Trans. Graph..

[18]  Todd Ingalls,et al.  Design of a home-based adaptive mixed reality rehabilitation system for stroke survivors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  B. S. Hoppestad,et al.  Inadequacies in computer access using assistive technology devices in profoundly disabled individuals: An overview of the current literature , 2007, Disability and rehabilitation. Assistive technology.

[20]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[21]  Eugene Fiume,et al.  Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion , 2005, SCA '05.

[22]  S. Saini,et al.  A low-cost game framework for a home-based stroke rehabilitation system , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[23]  S. Jones.  Considerations for the Provision of E-Therapy , 2010 .

[24]  Ludovic Hoyet,et al.  Sleight of hand: perception of finger motion from reduced marker sets , 2012, I3D '12.

[25]  Sangheon Pack,et al.  A novel service architecture for personalized context aware services , 2009, 2009 11th International Conference on Advanced Communication Technology.

[26]  Ran Gilad-Bachrach,et al.  Full body gait analysis with Kinect , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  K. Hudes.  Conservative management of a case of medial epicondylosis in a recreational squash player. , 2011, The Journal of the Canadian Chiropractic Association.

[28]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[29]  Dongman Lee,et al.  A Task Decomposition Scheme for Context Aggregation in Personal Smart Space , 2007, SEUS.

[30]  Wail Gueaieb,et al.  Context-aware social networks mashup: A personalized web perspective , 2010, 2010 IEEE Instrumentation & Measurement Technology Conference Proceedings.

[31]  C S Green,et al.  Action-Video-Game Experience Alters the Spatial Resolution of Vision , 2007, Psychological science.

[32]  Cuntai Guan,et al.  A feasibility study of non-invasive motor-imagery BCI-based robotic rehabilitation for Stroke patients , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[33]  Albert A. Rizzo,et al.  Towards pervasive physical rehabilitation using Microsoft Kinect , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[34]  Miriam Vollenbroek-Hutten,et al.  Chronic pain rehabilitation with a serious game using multimodal input , 2011, 2011 International Conference on Virtual Rehabilitation.

[35]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[36]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[37]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[38]  Johan Koolwaaij,et al.  ContextKing: Virtual Kingdoms in Real Life , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[39]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[40]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[41]  Walter Herzog,et al.  Model-based estimation of muscle forces exerted during movements. , 2007, Clinical biomechanics.

[42]  Xing Yan,et al.  Research on Skeleton Animation Motion Data Based on Kinect , 2012, 2012 Fifth International Symposium on Computational Intelligence and Design.

[43]  Jun-Da Huang.  Kinerehab: a kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities , 2011, ASSETS '11.

[44]  Jenny Ziviani,et al.  Systematic Review and Meta-analysis of Therapeutic Management of Upper-Limb Dysfunction in Children With Congenital Hemiplegia , 2009, Pediatrics.

[45]  Abdulmotaleb El-Saddik,et al.  A framework toward detecting and visualizing kinematic data for children with Hemiplegia , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[46]  Maxim A. Batalin,et al.  MEDIC: Medical embedded device for individualized care , 2008, Artif. Intell. Medicine.

[47]  Minhua Ma,et al.  Serious games for movement therapy after stroke , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[48]  Jacqui Crosbie,et al.  Adaptive Virtual Reality Games for Rehabilitation of Motor Disorders , 2007, HCI.

[49]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[50]  Margrit Betke,et al.  Early experiences using visual tracking for computer access by people with profound physical disabilities , 2001, HCI.

[51]  Ralf Steinmetz,et al.  Collaborative authoring of serious games for health , 2011, MM '11.

[52]  Blandine Calais-Germain.  Anatomy of Movement , 1993 .

[53]  Julie A. Jacko,et al.  Human-Computer Interaction. Users and Applications , 2011, Lecture Notes in Computer Science.

[54]  Jakob E. Bardram,et al.  Activity-based computing: support for mobility and collaboration in ubiquitous computing , 2005, Personal and Ubiquitous Computing.

[55]  Abdulmotaleb El-Saddik,et al.  Serious Games for Rehabilitation of Stroke Patients with Vibrotactile Feedback , 2010, Int. J. Comput. Sci. Sport.

[56]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[57]  Albert A. Rizzo,et al.  Interactive game-based rehabilitation using the Microsoft Kinect , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[58]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[59]  Mohamed Abdur Rahman,et al.  Multimedia interactive therapy environment for children having physical disabilities , 2013, ICMR.

[60]  J. Norris,et al.  The Growth and Direction of Healthcare Support Groups in Virtual Worlds , 2009 .

[61]  Boo-Ho Yang,et al.  Development of the ring sensor for healthcare automation , 2000, Robotics Auton. Syst..

[62]  Veronica Teichrieb,et al.  Poster: Improving motor rehabilitation process through a natural interaction based system using Kinect sensor , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).