Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach

This paper presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Detail peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable Degradation and Just Unacceptable Degradation thresholds on the factor. In light of the results, we describe the design and implementation of a real-time perception-based quality adaptor for 3D tele-immersive video. Our experimental results show that the adaptation scheme can reduce resource usage while considerably enhancing the overall perceived visual quality.

[1]  J. Navarro-Pedreño.  Numerical Methods for Least Squares Problems , 1996 .

[2]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[3]  Richard M. Murray,et al.  Feedback Systems: An Introduction for Scientists and Engineers , 2008 .

[4]  Warnakulasuriya Anil Chandana Fernando,et al.  3D video assessment with Just Noticeable Difference in Depth evaluation , 2010, 2010 IEEE International Conference on Image Processing.

[5]  William Yurcik,et al.  Real-time 3D video compression for tele-immersive environments , 2006, Electronic Imaging.

[6]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[7]  Markus H. Gross,et al.  3D video fragments: dynamic point samples for real-time free-viewpoint video , 2004, Comput. Graph..

[8]  Ruzena Bajcsy,et al.  High-Quality Visualization for Geographically Distributed 3-D Teleimmersive Applications , 2011, IEEE Transactions on Multimedia.

[9]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[10]  Bernd Hamann,et al.  A methodology for remote virtual interaction in teleimmersive environments , 2010, MMSys '10.

[11]  Xin Wang,et al.  Evaluating the Usability of an Auto-stereoscopic Display , 2007, HCI.

[12]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[13]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[14]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[15]  Nobuhiko Kitawaki,et al.  Quality requirements for multimedia communication services and terminals-interaction of speech and video delays , 1993, Proceedings of GLOBECOM '93. IEEE Global Telecommunications Conference.

[16]  Avideh Zakhor,et al.  Effects of Temporal Jitter on Video Quality: Assessment Using Psychophysical Methods , 1998 .

[17]  Scot Hacker,et al.  MP3: The Definitive Guide , 2000 .

[18]  Ruzena Bajcsy,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[19]  Ruigang Yang,et al.  3D Tele-Collaboration Over Internet2 , 2002 .

[20]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[21]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Jonathan Karl Kies,et al.  Empirical methods for evaluating video-mediated collaborative work , 1998 .

[23]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[24]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[25]  Jung Hong Chuang.  Level of Detail for 3D Graphics , 2002 .

[26]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[27]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[28]  Valentin S. Kisimov,et al.  Video Acceptability and Frame Rate , 1995, IEEE Multim..

[29]  Ketan Mayer-Patel,et al.  A Mechanism for TCP-Friendly Transport-Level Protocol Coordination , 2002, USENIX Annual Technical Conference, General Track.

[30]  Sandra Hirche,et al.  Haptic Data Compression and Communication , 2011, IEEE Signal Processing Magazine.

[31]  Sandra Hirche,et al.  Haptic Data Compression and Communication for Telepresence and Teleaction , 2010 .