Edge Orientation Driven Depth Super-Resolution for View Synthesis

The limited resolution of depth images is a constraint for most of practical computer vision applications. To solve this problem, in this paper, we present a novel depth super-resolution method based on machine learning. The proposed super-resolution method incorporates an edge-orientation based depth patch clustering method, which classifies the patches into several categories based on gradient strength and directions. A linear mapping between the low resolution (LR) and high resolution (HR) patch pairs is learned for each patch category by minimizing the synthesis view distortion. Since depth maps are not viewed directly, they are used to generate the virtual views, our method takes synthesis view distortion as the optimization strategy. Experimental results show that our proposed depth super-resolution approach performs well on depth super-resolution performance and the view synthesis compared to other depth super-resolution approaches.