Impact of Morphing-Based Frame Synthesis on Bandwidth Optimization for 3DTI Video

In view of the resource demanding nature of 3D Tele-immersion (3DTI), we apply Morphing-based Frame Synthesis (MBFS) on delivery of both online and offline 3DTI visual content to decrease the resource consumption without degrading the perceptual quality. We further investigate the relationship between the level-of-motion of the content and the effectiveness of MBFS. In light of the results, we propose an on-the-fly resource adaptor for 3DTI video transmission which utilizes a perceptual model built from data compiled by a series of subjective experiments. Results show that our adaptor achieves 43% to 87% compression ratio for offline compression on 3DTI videos of different baseline user activities, and a 10% on-the-fly bandwidth saving on complex user activity without perceptible degradation.

[1]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.

[2]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[3]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[4]  Yoshihiro Ito,et al.  Psychometric analysis of the mutually compensatory property of multimedia QoS , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[5]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[6]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[7]  Ruzena Bajcsy,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[8]  Klara Nahrstedt,et al.  Bundle of Streams: Concept and Evaluation in Distributed Interactive Multimedia Environments , 2010, 2010 IEEE International Symposium on Multimedia.

[9]  Ruzena Bajcsy,et al.  Enabling multiparty 3D tele-immersive environments with ViewCast , 2010, TOMCCAP.

[10]  P. Reichl,et al.  Quality-of-Experience Beyond MOS : Experiences with a Holistic User Test Methodology for Interactive Video Services , 2010 .

[11]  Klara Nahrstedt,et al.  "I'm the Jedi!" - A Case Study of User Experience in 3D Tele-immersive Gaming , 2010, 2010 IEEE International Symposium on Multimedia.

[12]  Ruzena Bajcsy,et al.  High-Quality Visualization for Geographically Distributed 3-D Teleimmersive Applications , 2011, IEEE Transactions on Multimedia.

[13]  Klara Nahrstedt,et al.  SyncCast: synchronized dissemination in multi-site interactive 3D tele-immersion , 2011, MMSys.

[14]  Wei Song,et al.  Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? , 2011, MM '11.

[15]  Ruzena Bajcsy,et al.  Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach , 2011, MM '11.

[16]  Chin-Laung Lei,et al.  Radar chart: scanning for satisfactory QoE in QoS dimensions , 2012, IEEE Network.

[17]  Klara Nahrstedt,et al.  Perception-based playout scheduling for high-quality real-time interactive multimedia , 2012, 2012 Proceedings IEEE INFOCOM.

[18]  Klara Nahrstedt.  3D teleimmersion for remote injury assessment , 2012, SAM '12.

[19]  Klara Nahrstedt,et al.  Activity-based synthesized frame generation in 3DTI video , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[20]  Klara Nahrstedt,et al.  Prioritized evolutionary optimization in open session management for 3D tele-immersion , 2013, MMSys.

[21]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .