Super-Resolution Optical Flow

Existing approaches to super-resolution are not applicable to videos of faces because faces are non-planar, non-rigid, non-lambertian, and are subject to self occlusion. We present super-resolution optical ow as a solution to these problems. Super-resolution optical ow takes as input a conventional video stream, and simultaneously computes both optical ow and a super-resolution version of the entire video. In this paper we describe an initial implementation of super-resolution optical ow, present detailed experimental results, and describe the relationship between super-resolution optical ow and pyramid-based image representations such as the Laplacian pyramid.