Archiving and Delivery of 3DTI Rehabilitation Sessions

In this paper we present CyPhy: a cyber-physiotherapy system that brings daily rehabilitation to patient’s home with supervision from trained therapist. With its archiving and delivery features, CyPhy is able to 1) capture and record RGB-D and physiotherapyrelated medical sensing data streams in home environment; 2) provide efficient storage for rehabilitation session recordings; 3) provide fast metadata analysis over stored sessions for review recommendation; 4) adaptively deliver rehabilitation session under different networking capabilities; 5) support smooth viewpoint changing during 3D video streaming with scene rendering schemes tailored for devices with different bandwidth and power limitations; and 6) provide platform-independent streaming client for various mobile and PC environments.

[1]  Bart Selman,et al.  Human Activity Detection from RGBD Images , 2011, Plan, Activity, and Intent Recognition.

[2]  Klara Nahrstedt,et al.  Activity-aware adaptive compression: a morphing-based frame synthesis application in 3DTI , 2013, ACM Multimedia.

[3]  Gregorij Kurillo,et al.  Cyberarchaeology: Experimenting with teleimmersive archaeology , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[4]  Mun Choon Chan,et al.  Low cost crowd counting using audio tones , 2012, SenSys '12.

[5]  Abdulsalam Yassine,et al.  A DASH-based 3D multi-view video rate control system , 2014, 2014 8th International Conference on Signal Processing and Communication Systems (ICSPCS).

[6]  Greg Welch,et al.  Smart instrumented training ranges: bringing automated system solutions to support critical domain needs , 2013 .

[7]  Indranil Gupta,et al.  3DTI Amphitheater , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[8]  Indranil Gupta,et al.  3DTI amphitheater: a manageable 3DTI environment with hierarchical stream prioritization , 2014, MMSys '14.

[9]  Henry Fuchs,et al.  Immersive 3D Telepresence , 2014, Computer.

[10]  Wei Niu,et al.  Human activity detection and recognition for video surveillance , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Ruzena Bajcsy,et al.  Tele-MFAsT: Kinect-Based Tele-Medicine Tool for Remote Motion and Function Assessment , 2014, MMVR.

[13]  Greg Welch,et al.  Illuminating collaboration in emergency health care situations: paramedic-physician collaboration and 3D telepresence technology , 2014, Inf. Res..

[14]  Alon Wolf,et al.  An Adaptive Home-Use Robotic Rehabilitation System for the Upper Body , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[15]  Klara Nahrstedt,et al.  Stevens' Power Law in 3D Tele-immersion: Towards Subjective Modeling of Multimodal Cyber Interaction , 2014, ACM Multimedia.

[16]  Ruzena Bajcsy,et al.  3D teleimmersion for collaboration and interaction of geographically distributed users , 2012, Virtual Reality.

[17]  Francoise Preteux,et al.  TFAN: A low complexity 3D mesh compression algorithm , 2009, Comput. Animat. Virtual Worlds.

[18]  Klara Nahrstedt,et al.  Impact of Morphing-Based Frame Synthesis on Bandwidth Optimization for 3DTI Video , 2013, 2013 IEEE International Symposium on Multimedia.

[19]  Titus B. Zaharia,et al.  TFAN: A low complexity 3D mesh compression algorithm , 2009, Comput. Animat. Virtual Worlds.

[20]  Andrew Priorov,et al.  Methods of complete surface reconstruction through merging of point clouds according to stereo vision data , 2014, Proceedings of 16th Conference of Open Innovations Association FRUCT.

[21]  Peter Neri,et al.  How inherently noisy is human sensory processing? , 2010, Psychonomic bulletin & review.

[22]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[23]  Mohamed Hefeeda,et al.  A DASH-based Free Viewpoint Video Streaming System , 2014, NOSSDAV 2014.

[24]  Klara Nahrstedt,et al.  Activity-based synthesized frame generation in 3DTI video , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[25]  RTP Payload Format for JPEG-compressed Video , 1996, RFC.

[26]  Henry Fuchs,et al.  Reducing interference between multiple structured light depth sensors using motion , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[27]  Klara Nahrstedt,et al.  3D teleimmersive activity classification based on application-system metadata , 2013, MM '13.

[28]  Michele Sanna,et al.  A 3D tele-immersion system based on live captured mesh geometry , 2013, MMSys.

[29]  Klara Nahrstedt,et al.  MobileTI: a portable tele-immersive system , 2009, ACM Multimedia.

[30]  Ruzena Bajcsy,et al.  Enabling multi-party 3D tele-immersive environments with ViewCast , 2010, TOMCCAP.

[31]  Philippe Fraisse,et al.  Adaptive Interface for Personalized Center of Mass Self-Identification in Home Rehabilitation , 2015, IEEE Sensors Journal.

[32]  Ruzena Bajcsy,et al.  Upper extremity 3‐dimensional reachable workspace analysis in dystrophinopathy using Kinect , 2015, Muscle & nerve.