CZLoD: A psychophysical approach for 3D tele-immersive video

This article presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Details (CZLoD) peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable Degradation and Just Unacceptable Degradation thresholds on the factor. In light of the results, we design and implement a real-time perception-based quality adaptor for 3D tele-immersive video. Our experimental results show that the adaptation scheme can reduce resource usage (e.g., CPU cycles) while considerably enhancing the overall perceived visual quality. Our analysis confirms the potential temporal and spatial performance benefits achievable with CZLoD adaptation.

[1]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[2]  Ruzena Bajcsy,et al.  High-Quality Visualization for Geographically Distributed 3-D Teleimmersive Applications , 2011, IEEE Transactions on Multimedia.

[3]  Markus H. Gross,et al.  3D video fragments: dynamic point samples for real-time free-viewpoint video , 2004, Comput. Graph..

[4]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[5]  Ruzena Bajcsy,et al.  Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach , 2011, MM '11.

[6]  Nick Holliman.  Review of "Level of detail for 3D graphics" by David Luebke, Martin Reddy, Jonathan D. Cohen, Amitabh Varshney, Benjamin Watson, and Robert Heubner. Morgan Kaufmann , 2003 .

[7]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[8]  Valentin S. Kisimov,et al.  Video Acceptability and Frame Rate , 1995, IEEE Multim..

[9]  Bernd Hamann,et al.  A methodology for remote virtual interaction in teleimmersive environments , 2010, MMSys '10.

[10]  Xin Wang,et al.  Evaluating the Usability of an Auto-stereoscopic Display , 2007, HCI.

[11]  Jonathan D. Cohen,et al.  Level of Detail for 3D Graphics , 2012 .

[12]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[13]  Avideh Zakhor,et al.  Effects of temporal jitter on video quality: assessment using psychophysical and computational modeling methods , 1998, Electronic Imaging.

[14]  Richard M. Murray,et al.  Feedback Systems An Introduction for Scientists and Engineers , 2007 .

[15]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[16]  Ketan Mayer-Patel,et al.  A Mechanism for TCP-Friendly Transport-Level Protocol Coordination , 2002, USENIX Annual Technical Conference, General Track.

[17]  Sandra Hirche,et al.  Haptic Data Compression and Communication , 2011, IEEE Signal Processing Magazine.

[18]  Ruzena Bajcsy,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[19]  Ruigang Yang,et al.  3D Tele-Collaboration Over Internet2 , 2002 .

[20]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[21]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Warnakulasuriya Anil Chandana Fernando,et al.  3D video assessment with Just Noticeable Difference in Depth evaluation , 2010, 2010 IEEE International Conference on Image Processing.

[23]  Karen A. F. Copeland.  Design and Analysis of Experiments, 5th Ed. , 2001 .

[24]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[25]  Jonathan Karl Kies,et al.  Empirical methods for evaluating video-mediated collaborative work , 1998 .

[26]  Indranil Gupta,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, ICDCS.

[27]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[28]  O. Braddick,et al.  Seeing in Depth , 2008 .

[29]  Avideh Zakhor,et al.  Effects of Temporal Jitter on Video Quality: Assessment Using Psychophysical Methods , 1998 .

[30]  Scot Hacker,et al.  MP3: The Definitive Guide , 2000 .

[31]  Nobuhiko Kitawaki,et al.  Quality requirements for multimedia communication services and terminals-interaction of speech and video delays , 1993, Proceedings of GLOBECOM '93. IEEE Global Telecommunications Conference.

[32]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .