Adaptive frame rate up-conversion based on motion classification

In this paper, a new technique on video frame rate up-conversion (FRUC) is presented by combining the adaptive motion classification (AMC) for image sequences and the mixed motion estimation (ME). In the proposed FRUC scheme, the AMC classifies sequences into global and local motion sequences (G/LMS) whose advantages are fully utilized. The mixture of bidirectional ME (BDME) and unidirectional ME (UDME) is proposed to avoid hole and ''background replace object'' phenomenon in interpolated frames. Moreover, the motion vectors (MVs) refinement technique is employed to smooth MVs field. For LMS, the motion detection is used to deal with static background and occlusions are located by using forward prediction of motion regions. Correctional sum of absolute difference (CSAD) which gives more precise physical MVs field than conventional SAD is applied during all of the ME process. Simulation results demonstrate the effectiveness of the proposed FRUC algorithm.