Hybrid scalable video coding with multiple description and layered coding

We present a hybrid scalable video coding algorithm in which two types of scalabilities, i.e., layered scalability and parallel scalability, are combined to achieve higher order of flexibility for heterogeneous networks and mixed client requirements. In space domain, SNR scalable video coding is used to give layered scalability on frame quality; while in temporal domain, a multiple description approach, the Multiple State Video Coding (MSVC), provides parallel scalability to the base layer video. Two coarsely quantized sub-streams are yielded using MSVC and form the base layer. All residual signals of the video sequence are coded into a third sub-stream and form the enhancement layer. The hybrid scalable video protects the base layer using multiple description and has better performance than conventional layered scalable video when a base layer picture is damaged. It gives similar performance as SNR scalable video when the enhancement layer encounters errors. In general packet drop networks, the proposed scalable video achieves higher PSNR than the original MSVC video and single description video in high packet drop rate environments.