Converting Ultrahigh-Definition Video Into Digital Cinema by Using Time-Expanding Bi-Directional Motion Estimation and Higher Green Frequency

Ultrahigh-definition television (UHDTV) is the next-generation ultrahigh-resolution video system with more than 4000 lines, and 7680 horizontal pixels × 4320 vertical lines at 60 f/s (frames per second) in video format. We propose a method of converting high-quality UHDTV video to digital cinema video that is 3840 horizontal pixels × 2160 vertical lines at 24 f/s. Here, it is important to detect motion vectors extremely accurately to convert the frame rate. We introduced two new algorithms to increase the accuracy of detecting motion vectors. First, we introduced a method of interpolation frames using 1/2 block-shift bi-directional motion estimation by expanding the time axis. The experimental results revealed that our new method produced higher quality video images than conventional methods of video conversion using forward-directional and overlapped block bi-directional motion estimation. Next, we focused on Bayer pattern sampling in existing UHDTV, and introduced a motion-compensated method of interpolation where the first algorithm utilizes the high-frequency components from green signals. The experimental results demonstrated that our proposed method achieves higher quality video conversions than conventional methods using only the first algorithm for motion-compensated interpolation, linear interpolation, and 5:2 frame skipping.

[1]  Tao Chen Adaptive temporal interpolation using bidirectional motion estimation and compensation , 2002, Proceedings. International Conference on Image Processing.

[2]  Jiang Li,et al.  A low complexity motion compensated frame interpolation method , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[3]  Oscar C. Au,et al.  Temporal interpolation using wavelet domain motion estimation and motion compensation , 2002, Proceedings. International Conference on Image Processing.

[4]  Victor H. S. Ha,et al.  Portable receivers for digital multimedia broadcasting , 2004, IEEE Transactions on Consumer Electronics.

[5]  K. Kawaguchi,et al.  Frame rate up-conversion considering multiple motion , 1997, Proceedings of International Conference on Image Processing.

[6]  Packwood,et al.  VARIABLE SIZE BLOCK MATCHING MOTION CODING , 2004 .

[7]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Pasi Pohjala,et al.  Evaluation of scanning rate up conversion algorithms; subjective testing of interlaced to progressive conversion , 1992 .

[9]  Takahiko Fukinuki Three-dimensional signal processing for full utilization of NTSC signals and transmission capacities , 1991, J. Vis. Commun. Image Represent..

[10]  R.K. Jurgen High-definition television update , 1988, IEEE Spectrum.

[11]  Takashi Fujio 1.Development of High-Definition Television and Its Future , 1982 .

[12]  Nagato Narita Effect of Impairment Ranges on Reliability of the Modified EBU Method , 1995 .

[13]  JongWon Kim,et al.  MCI-embedded motion-compensated prediction for quality enhancement of frame interpolation , 2001, SPIE Optics East.

[14]  Rae-Hong Park,et al.  Weighted-adaptive motion-compensated frame rate up-conversion , 2003, IEEE Trans. Consumer Electron..

[15]  Masayuki Sugawara,et al.  An 8k×4k Ultrahigh-Definition Color Video Camera with 8M-Pixel CMOS Imager , 2005 .

[16]  R. Schafer,et al.  Demosaicking: Color Filter Array Interpolation in Single-Chip Digital Cameras , 2003 .

[17]  Satoshi Kondo,et al.  Frame-rate up-conversion using reliable analysis of transmitted motion information , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  G. Schamel Pre- and postfiltering of HDTV signals for sampling rate reduction and display up-conversion , 1987 .

[19]  Fumio Okano,et al.  HDTV Standards Converter. , 1994 .

[20]  Takahiko Fukinuki,et al.  The To-and-Fro Zone Plate (TFZP) Method for Observing Frequency Characteristics in Three Dimensions , 1986 .

[21]  Mohammed E. Al-Mualla Motion field interpolation for frame rate conversion , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[22]  Roberto Castagno,et al.  A method for motion adaptive frame rate up-conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[23]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[24]  J.-L. Wu,et al.  Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Jaeseok Kim,et al.  Motion compensated frame interpolation by new block-based motion estimation algorithm , 2004, IEEE Trans. Consumer Electron..

[26]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..

[27]  Reginald L. Lagendijk,et al.  Motion compensated frame rate conversion of motion pictures , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  Masayuki Sugawara,et al.  Ultrahigh-definition video system with 4000 scanning lines , 2002 .

[29]  Yukihiro Nishida,et al.  Current status of studies on ultra high definition television , 2007 .

[30]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[31]  Patrick J. Wolfe,et al.  Spatio-Spectral Color Filter Array Design for Enhanced Image Fidelity , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Wen-Liang Hwang,et al.  Advanced motion compensation techniques for blocking artifacts reduction in 3-D video coding systems , 2005, IEEE International Conference on Image Processing 2005.