XR Carousel: A Visualization Tool For Volumetric Video

Recent years have seen a new uptake in immersive media and eXtended Reality (XR). And due to a global pandemic, computer-mediated communication over video conferencing tools became a new normal of everyday remote collaboration and virtual meetings. Social XR leverages XR technologies for remote communication and collaboration. But in order for XR to facilitate a high level of (social) presence and thus high-quality mediated social contact between users, we need high-quality 3D representation of users. One approach to providing detailed 3D user representations as new immersive media is to use point clouds or meshes, but these representation formats come with complexity on compression bitrate and processing time. In the example of virtual meetings, compression has to fulfill stringent requirements such as low latency and high quality. As the compression techniques for 3D immersive media steadily advance, it is important to be able to easily compare different compression techniques on their technical and visual merits in an easy way. The proposed demonstrator in this paper is a visualization tool that helps assessing the visual quality of a 3D representation employing various coding schemes. The complete end-to-end rendering/encoding chain can be easily assessed, allowing for subjective testing by showing the differences between the selected encoding parameters. The tool presented in this demo paper offers an improved and easy visual process for the comparison of encoders of immersive media.

[1]  H. M. Stokking,et al.  VRComm , 2021, Proceedings of the 12th ACM Multimedia Systems Conference.

[2]  Filip De Turck,et al.  From Capturing to Rendering: Volumetric Media Delivery with Six Degrees of Freedom , 2020, IEEE Communications Magazine.

[3]  Petros Daras,et al.  HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Media , 2020, IEEE Access.

[4]  Pan Gao,et al.  Textured Mesh vs Coloured Point Cloud: A Subjective Study for Volumetric Video Compression , 2020, 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX).

[5]  Titus B. Zaharia,et al.  3D Point Cloud Compression: A Survey , 2019, Web3D.

[6]  Frank B. ter Haar,et al.  Multi-sensor capture and network processing for virtual reality conferencing , 2019, MMSys.

[7]  Rufael Mekuria,et al.  Emerging MPEG Standards for Point Cloud Compression , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[8]  Petros Daras,et al.  Subjective Visual Quality Assessment of Immersive 3D Media Compressed by Open-Source Static 3D Mesh Codecs , 2018, MMM.

[9]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.