Classification based polynomial image interpolation

Due to the fast migration of high resolution displays for home and office environments there is a strong demand for high quality picture scaling. This is caused on the one hand by large picture sizes and on the other hand due to an enhanced visibility of picture artifacts on these displays [1]. There are many proposals for an enhanced spatial interpolation adaptively matched to picture contents like e.g. edges. The drawback of these approaches is the normally integer and often limited interpolation factor. In order to achieve rational factors there exist combinations of adaptive and non adaptive linear filters, but due to the non adaptive step the overall quality is notably limited. We present in this paper a content adaptive polyphase interpolation method which uses "offline" trained filter coefficients and an "online" linear filtering depending on a simple classification of the input situation. Furthermore we present a new approach to a content adaptive interpolation polynomial, which allows arbitrary polyphase interpolation factors at runtime and further improves the overall interpolation quality. The main goal of our new approach is to optimize interpolation quality by adapting higher order polynomials directly to the image content. In addition we derive filter constraints for enhanced picture quality. Furthermore we extend the classification based filtering to the temporal dimension in order to use it for an intermediate image interpolation.

[1]  Yeong Ho Ha,et al.  Adaptive scan rate up-conversion system based on human visual characteristics , 2000, IEEE Trans. Consumer Electron..

[2]  G. de Haan,et al.  Towards an Overview of Spatial Up-conversion Techniques. , 2002 .

[3]  Ortwin Franzen,et al.  Nonlinear polyphase image rate conversion , 2002, 2002 11th European Signal Processing Conference.

[4]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[5]  Chung J. Kuo,et al.  Adaptive interpolation technique for scanning rate conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[6]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[7]  Stephen E. Reichenbach,et al.  Image interpolation by two-dimensional parametric cubic convolution , 2006, IEEE Transactions on Image Processing.