The perceived quality of light-field video services

Real-time video transmission services are unquestionably dominating the flow of data over the Internet, and their percentage of the global IP packet traffic is still continuously increasing. As novel visualization technologies are emerging, they tend to demand higher bandwidth requirements; they offer more visually, but in order to do so, they need more data to be transmitted. The research and development of the past decades in optical engineering enabled light-field displays to surface and appear in the industry and on the market, and light-field video services are already on the horizon. However, the data volumes of high-quality light-field contents can be immense, creating storing, coding and transmission challenges. If we consider the representation of light-field content as a series of 2D views, then for a single video frame, angular resolution determines the number of views within the field of view, and spatial resolution defines the 2D size of those views. In this paper, we present the results of an experiment carried out to investigate the perceptual differences between different angular and spatial resolution parametrization of a light-field video service. The study highlights how the two resolution values affect each other regarding perceived quality, and how the combined effects are detected, perceived and experienced by human observers. By achieving an understanding of the related visual phenomena, especially degradations that are unique for light-field visualization, the design and development of resource-efficient light-field video services and applications become more straightforward.

[1]  Maria G. Martini,et al.  Viva la resolution: the perceivable differences between image resolutions for light field displays , 2016 .

[2]  Robert Bregovic,et al.  Measurement of perceived spatial resolution in 3D light-field displays , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Péter Szolgay,et al.  Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller , 2015, Sensors.

[4]  Touradj Ebrahimi,et al.  Objective and subjective evaluation of light field image compression algorithms , 2016, 2016 Picture Coding Symposium (PCS).

[5]  László Bokor,et al.  The interdependence of spatial and angular resolution in the quality of experience of light field visualization , 2017, 2017 International Conference on 3D Immersion (IC3D).

[6]  Maria G. Martini,et al.  Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video , 2018, IEEE Transactions on Broadcasting.

[7]  Maria G. Martini,et al.  EXPERT EVALUATION OF A NOVEL LIGHT-FIELD VISUALIZATION FORMAT , 2018, 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[8]  Touradj Ebrahimi,et al.  A new approach to subjectively assess quality of plenoptic content , 2016, Optical Engineering + Applications.

[9]  Maria G. Martini,et al.  From a different point of view : how the field of view of light field displays affects the willingness to pay and to use , 2016 .

[10]  Maria G. Martini,et al.  Towards display-independent light-field formats , 2017, 2017 International Conference on 3D Immersion (IC3D).

[11]  Maria G. Martini,et al.  Towards adaptive light field video streaming , 2017 .

[12]  Sumohana S. Channappayya,et al.  A subjective evaluation of true 3D images , 2014, 2014 International Conference on 3D Imaging (IC3D).

[13]  Touradj Ebrahimi,et al.  Impact of interactivity on the assessment of quality of experience for light field content , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[14]  Maria G. Martini,et al.  To interpolate or not to interpolate: Subjective assessment of interpolation performance on a light field display , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[15]  Sumohana S. Channappayya,et al.  A High-angular-resolution Turntable Data-set for Experiments on Light Field Visualization Quality , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[16]  Zhan Yu,et al.  Lytro camera technology: theory, algorithms, performance analysis , 2013, Electronic Imaging.

[17]  Maria G. Martini,et al.  The Effect of Light Field Reconstruction and Angular Resolution Reduction on the Quality of Experience , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[18]  Sumohana S. Channappayya,et al.  Super-multiview content with high angular resolution: 3D quality assessment on horizontal-parallax lightfield display , 2016, Signal Process. Image Commun..

[19]  Sumohana S. Channappayya,et al.  Effect of Primitive Features of Content on Perceived Quality of Light Field Visualization , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[20]  Péter Tamás Kovács,et al.  Natural 3D content on glasses-free light-field 3D cinema , 2013, Electronic Imaging.

[21]  Maria G. Martini,et al.  On the edge of the seat: Reduced angular resolution of a light field cinema with fixed observer positions , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[22]  Maria G. Martini,et al.  Performance comparison of subjective assessment methodologies for Light Field Displays , 2016, 2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[23]  Robert Bregovic,et al.  Quantifying Spatial and Angular Resolution of Light-Field 3-D Displays , 2017, IEEE Journal of Selected Topics in Signal Processing.

[24]  Sumohana S. Channappayya,et al.  3D OBJECTIVE QUALITY ASSESSMENT OF LIGHT FIELD VIDEO FRAMES , 2018, 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[25]  Federica Battisti,et al.  Towards the Perceptual Quality Evaluation of Compressed Light Field Images , 2017, IEEE Transactions on Broadcasting.

[26]  Maria G. Martini,et al.  Perceived quality of angular resolution for light field displays and the validy of subjective assessment , 2016, 2016 International Conference on 3D Imaging (IC3D).

[27]  Sumohana S. Channappayya,et al.  Achieving high angular resolution via view synthesis: Quality assessment of 3D content on super multiview lightfield display , 2017, 2017 International Conference on 3D Immersion (IC3D).