Perceptual Video Streaming by Adaptive Spatial-temporal Scalability

To maximize user satisfaction of video streaming, there is a tradeoff between spatial quality (image clarity) and temporal quality (motion smoothness) under a limited bandwidth. How to balance the requirement for the two aspects is a subjective selection. In this paper, we firstly introduce how to efficiently measure the subjective perceived spatial and temporal quality. Then we present a visual perception model to predict viewer's satisfaction given the perceived spatial quality and temporal quality based on the result of a user study. At last, an adaptive video streaming system utilizing the perception model is proposed, which can automatically choose dropping fames or cutting the scalable bitstream according to the variable bandwidth, and obtain maximized perceptual quality.