A Transmission and Interaction Oriented Free-Viewpoint Video System

A transmission and interaction oriented free-viewpoint video system framework is presented in this paper. The proposed system framework is divided as distinctive but interconnected parts, from video encoder, adaptive-interactive disparity extractor, to virtual view rendering. Adaptive disparity algorithm and extractor is proposed and embedded to multiview video encoder, in order to fetch the desired coarse disparity map and enhance the encoder performance. The output bitstream for storage and transmission is organized as disparity layer and video layer. Virtual viewpoint images accessed in the procedure of client-system interaction will be interpolated via disparity based algorithm after the decoded disparity information is refined to single-pixel based disparity map. Experimental results show that, the bitstream volume of disparity map accounts for a little proportion when comparing with bitstream volume of video signals in transmission, while high quality of virtual viewpoint images can be provided to clients in real-time. Keywords—free-viewpoint video, disparity map, three dimensional television, view rendering.