Remote rendering of High Dynamic Range graphics content

A large amount of computer graphics content is now regularly rendered in High Dynamic Range (HDR). The computational requirements of this are such that this rendering is typically done remotely. As the data requirements of HDR are large, compression is required if the resultant HDR frames are to be streamed efficiently to where they are required on existing ICT infrastructure. This paper investigates augmenting video streaming of computer generated HDR graphics using metadata available from the rendering engine which is not typically accessible for real-world HDR video streaming. In particular depth, geometry and motion information is used to produce an efficient stream for transmission. This is combined with state-of-the-art techniques for encoding HDR video to produce a highly efficient means of steaming HDR video of graphics content.

[1]  Dan S. Wallach,et al.  Accelerated MPEG compression of dynamic polygonal scenes , 1994, SIGGRAPH.

[2]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[3]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[4]  Andrew B. Watson,et al.  Digital images and human vision , 1993 .

[5]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Bohn Stafleu van Loghum,et al.  Online … , 2002, LOG IN.

[8]  Marc Levoy.  Polygon-assisted JPEG and MPEG compression of synthetic images , 1995, SIGGRAPH.

[9]  Jan Kautz,et al.  Adapting Standard Video Codecs for Depth Streaming , 2011, EGVE/EuroVR.

[10]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[11]  Hans-Peter Seidel,et al.  Visible difference predicator for high dynamic range images , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[12]  Tim Borer.  Non-linear Opto-Electrical Transfer Functions for High Dynamic Range Television , 2014 .

[13]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[14]  Scott Miller,et al.  Perceptual Signal Coding for More Efficient Usage of Bit Codes , 2012 .

[15]  Patrick Le Callet,et al.  HDR-VQM: An objective quality measure for high dynamic range video , 2015, Signal Process. Image Commun..

[16]  Hans-Peter Seidel,et al.  Scalable Remote Rendering with Depth and Motion‐flow Augmented Streaming , 2011, Comput. Graph. Forum.

[17]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[18]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.