Real-time communication for Kinect-based telerehabilitation

Abstract As chronic diseases and demographic changes alter the trends in world population, more pressure is put on health management to deal efficiently with a new scenario of longer life expectancy and chronic disabilities. Advances in telecommunication technology and miniaturization of sensors in combination with medical information technology provide a viable solution to reduce healthcare costs and deliver remote medical services through connected devices. Although remote consultation via video-conferencing has been well established, many of the chronic or long-term musculoskeletal conditions require pro-active management and therapy. There is a need to develop more advanced interactive telerehabilitation systems that support real-time remote delivery of physical therapy sessions into patients’ homes. In this paper, we introduce KinectRTC, an innovative framework that can be used for Kinect-based telerehabilitation with efficient real-time transmission of video, audio, depth, and skeletal data. By taking advantage of the Web Real-Time Communication (WebRTC) technology, the proposed framework is able to manage video and audio streams based on the state of the network and the available bandwidth to guarantee the real-time performance of the communication.

[1]  Krste Asanovic,et al.  Energy Aware Lossless Data Compression , 2003, MobiSys.

[2]  Michael T French,et al.  Economic evaluation of telemedicine: review of the literature and research guidelines for benefit-cost analysis. , 2009, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[3]  Rahat Iqbal,et al.  Cloud enabled data analytics and visualization framework for health-shocks prediction , 2016, Future Gener. Comput. Syst..

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  Zhengyou Zhang,et al.  Low-complexity, near-lossless coding of depth maps from kinect-like depth cameras , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[6]  Arantza Illarramendi,et al.  Validation of a Kinect-based telerehabilitation system with total hip replacement patients , 2016, Journal of telemedicine and telecare.

[7]  Demetris Lamnisos,et al.  Effectiveness of heart failure management programmes with nurse-led discharge planning in reducing re-admissions: a systematic review and meta-analysis. , 2012, International journal of nursing studies.

[8]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[9]  A. J. O’Malley,et al.  Use of telemedicine can reduce hospitalizations of nursing home residents and generate savings for medicare. , 2014, Health affairs.

[10]  Qiang Chen,et al.  A Health-IoT Platform Based on the Integration of Intelligent Packaging, Unobtrusive Bio-Sensor, and Intelligent Medicine Box , 2014, IEEE Transactions on Industrial Informatics.

[11]  Greg Welch,et al.  The potential impact of 3d telepresence technology on task performance in emergency trauma care , 2007, GROUP.

[12]  Daniel C. Burnett,et al.  WebRTC: APIs and RTCWEB Protocols of the HTML5 Real-Time Web , 2012 .

[13]  Prasant Mohapatra,et al.  Securing Multimedia Content Using Joint Compression and Encryption , 2013, IEEE MultiMedia.

[14]  Christine Guillemot,et al.  Efficient depth map compression based on lossless edge coding and diffusion , 2012, 2012 Picture Coding Symposium.

[15]  Majid Sarrafzadeh,et al.  A Telehealth Architecture for Networked Embedded Systems: A Case Study in In Vivo Health Monitoring , 2009, IEEE Transactions on Information Technology in Biomedicine.

[16]  Jesús Fontecha,et al.  Mobile and ubiquitous architecture for the medical control of chronic diseases through the use of intelligent devices: Using the architecture for patients with diabetes , 2014, Future Gener. Comput. Syst..

[17]  Kelly J. Bower,et al.  Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. , 2013, Journal of biomechanics.

[18]  Yan Chen,et al.  QoS Requirements of Network Applications on the Internet , 2004, Inf. Knowl. Syst. Manag..

[19]  Ruzena Bajcsy,et al.  Tele-MFAsT: Kinect-Based Tele-Medicine Tool for Remote Motion and Function Assessment , 2014, MMVR.

[20]  C. Goldzweig,et al.  Costs and benefits of health information technology: new trends from the literature. , 2009, Health affairs.

[21]  Eric Chance,et al.  Virtual Worlds and Avatars as the New Frontier of Telehealth Care , 2012, Annual Review of Cybertherapy and Telemedicine.

[22]  Jana Cason,et al.  Telehealth Opportunities in Occupational Therapy , 2013 .

[23]  Rosann Webb Collins,et al.  Telemedicine: Technology mediated service relationship, encounter, or something else? , 2012, Int. J. Medical Informatics.

[24]  Mohamed Adel Serhani,et al.  Novel Cloud and SOA-Based Framework for E-Health Monitoring Using Wireless Biosensors , 2014, IEEE Journal of Biomedical and Health Informatics.

[25]  P. Drucker Effectiveness ∗ , 2011 .

[26]  Hossein Mousavi Hondori,et al.  A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation , 2014, Journal of medical engineering.

[27]  Petros Daras,et al.  3D tele-immersion platform for interactive immersive experiences between remote users , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[28]  Andrew Stranieri,et al.  High definition 3D telemedicine: the next frontier? , 2012, Studies in health technology and informatics.

[29]  Shipeng Li,et al.  Kinect-Like Depth Data Compression , 2013, IEEE Transactions on Multimedia.

[30]  Mark Burgess,et al.  Remote real-time collaboration through synchronous exchange of digitised human-workpiece interactions , 2017, Future Gener. Comput. Syst..

[31]  John Sidney,et al.  An ontology for major histocompatibility restriction , 2016, Journal of Biomedical Semantics.

[32]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[33]  Kazuaki Maeda,et al.  Performance evaluation of object serialization libraries in XML, JSON and binary formats , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).

[34]  Chuan-Jun Su,et al.  Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic , 2014, Appl. Soft Comput..

[35]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[36]  E. Noé,et al.  Effectiveness, usability, and cost-benefit of a virtual reality-based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. , 2015, Archives of physical medicine and rehabilitation.

[37]  A. Illarramendi,et al.  Exercise Recognition for Kinect-based Telerehabilitation , 2014, Methods of Information in Medicine.

[38]  Salvatore Loreto,et al.  Real-Time Communications in the Web: Issues, Achievements, and Ongoing Standardization Efforts , 2012, IEEE Internet Computing.

[39]  B. Prabhakaran,et al.  A 3D tele-immersion streaming approach using skeleton-based prediction , 2013, MM '13.

[40]  Yang Yang,et al.  Reliability and Validity of Kinect RGB-D Sensor for Assessing Standing Balance , 2014, IEEE Sensors Journal.

[41]  Sebastian Werner,et al.  Data channel considerations for RTCWeb , 2013, IEEE Communications Magazine.

[42]  Lyudmila Mihaylova,et al.  Video Distribution Techniques Over WiMAX Networks for m-Health Applications , 2012, IEEE Transactions on Information Technology in Biomedicine.

[43]  Alfredo De Santis,et al.  Cloud-based adaptive compression and secure management services for 3D healthcare data , 2015, Future Gener. Comput. Syst..

[44]  Louise Davies,et al.  VA Telemedicine: An Analysis of Cost and Time Savings. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[45]  J. Bailenson,et al.  The Effect of Interactivity on Learning Physical Actions in Virtual Reality , 2008 .

[46]  Arantza Illarramendi,et al.  TrhOnt: building an ontology to assist rehabilitation processes , 2016, J. Biomed. Semant..

[47]  Rahat Iqbal,et al.  A fuzzy ambient intelligent agents approach for monitoring disease progression of dementia patients , 2012, Journal of Ambient Intelligence and Humanized Computing.

[48]  Stepán Obdrzálek,et al.  Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Michael McCue,et al.  Introduction to Telerehabilitation , 2013 .