Heterogeneous multiprocessor for high definition video

This work presents the heterogeneous multiprocessor capable of processing HDTV material (1920*1080i at 60 Hz) in the domain of motion estimation based TV applications. In particular, it is targeted to the state-of-the-art format conversion and scan-rate conversion functions like de-interlacing and picture-rate up-conversion. The heterogeneous multiprocessor consists of five processors communicating through fifos and shared memories. The highest picture quality level that meets the HDTV real-time performance was enabled by: judicious choice of application task partitioning; right choice of instruction set architecture for the VLIW-based multiprocessor; exploitation of the customized two level memory hierarchy (the search area scratchpad and the region scratchpad). Furthermore, the heterogeneous multiprocessor offers high degree of flexibility: size and aspect ratio of the region and the search area scratchpads; algorithm for selection of the motion vector candidates; algorithm for post-processing of the motion vector field; plethora of interpolation schemes used in motion estimation and compensation offering trade-off between interpolation complexity and number of interpolated pixels in parallel.

[1]  Gerard de Haan,et al.  A two-dimensional generalized sampling theory and application to de-interlacing , 2004, IS&T/SPIE Electronic Imaging.

[2]  Gerard de Haan,et al.  Streaming scratchpad memory organization for video applications , 2004, Circuits, Signals, and Systems.

[3]  Gerard de Haan,et al.  Towards an efficient high quality picture-rate up-converter , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  Gerard de Haan,et al.  Sub-pixel motion estimation with 3-D recursive search block-matching , 1994, Signal Process. Image Commun..

[5]  Gerard de Haan,et al.  Algorithm/architecture co-design of the generalized sampling theorem based de-interlacer [video signal processing] , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[6]  J. Yen.  On Nonuniform Sampling of Bandwidth-Limited Signals , 1956 .

[7]  G. de Haan,et al.  Tackling occlusion in scan rate conversion systems , 2003, 2003 IEEE International Conference on Consumer Electronics, 2003. ICCE..