Reconfigurable Morphological Image Processing Accelerator for Video Object Segmentation

Video object segmentation is an important pre-processing task for many video analysis systems. To achieve the requirement of real-time video analysis, hardware acceleration is required. In this paper, after analyzing existing video object segmentation algorithms, it is found that most of the core operations can be implemented with simple morphology operations. Therefore, with the concepts of morphological image processing element array and stream processing, a reconfigurable morphological image processing accelerator is proposed, where by the proposed instruction set, the operation of each processing element can be controlled, and the interconnection between processing elements can also be reconfigured. Simulation results show that most of the core operations of video object segmentation can be supported by the accelerator by only changing the instructions. A prototype chip is designed to support real-time change-detection-and-background-registration based video object segmentation algorithm. This chip incorporates eight macro processing elements and can support a processing capacity of 6,200 9-bit morphological operations per second on a SIF image. Furthermore, with the proposed tiling and pipelined-parallel techniques, a real-time watershed transform can be achieved using 32 macro processing elements.

[1]  William J. Dally,et al.  Programmable Stream Processors , 2003, Computer.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  I. Kuroda,et al.  A 51.2 GOPS scalable video recognition processor for intelligent cruise control based on a linear array of 128 4-way VLIW processing elements , 2003, 2003 IEEE International Solid-State Circuits Conference, 2003. Digest of Technical Papers. ISSCC..

[4]  H. T. Kung,et al.  Warp architecture and implementation , 1998, ISCA '98.

[5]  Roland Mech,et al.  A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera , 1998, Signal Process..

[6]  Uri C. Weiser,et al.  MMX technology extension to the Intel architecture , 1996, IEEE Micro.

[7]  Amir Averbuch,et al.  Automatic segmentation of moving objects in video sequences: a region labeling approach , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  M. Meribout.  Video Segmentation for Content-based Coding , 2004 .

[9]  Guojun Lu,et al.  Segmentation of moving objects in image sequence: A review , 2001 .

[10]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Albert Oliveras,et al.  Motion analysis of image sequences using connected operators , 1997, Electronic Imaging.

[12]  J. C. Klein,et al.  PIMM1, an image processing ASIC based on mathematical morphology , 1989, Proceedings., Second Annual IEEE ASIC Seminar and Exhibit,.

[13]  John A. Robinson,et al.  Object-based video coding by global-to-local motion segmentation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[14]  Robert M. Lougheed,et al.  The cytocomputer: A practical pipelined image processor , 1980, ISCA '80.

[15]  Chung J. Kuo,et al.  Image segmentation with improved watershed algorithm and its FPGA implementation , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[16]  Liang-Gee Chen,et al.  Predictive watershed: a fast watershed algorithm for video segmentation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[17]  S. Srinivasan,et al.  A distributed memory architecture for morphological image processing , 2003, Proceedings ITCC 2003. International Conference on Information Technology: Coding and Computing.

[18]  Liang-Gee Chen,et al.  Fast video segmentation algorithm with shadow cancellation, global motion compensation, and adaptive threshold techniques , 2004, IEEE Transactions on Multimedia.

[19]  Yi-Ping Hung,et al.  A Bayesian approach to video object segmentation via merging 3-D watershed volumes , 2005, IEEE Trans. Circuits Syst. Video Technol..

[20]  Yi-Ping Hung,et al.  A Bayesian approach to video object segmentation via merging 3-D watershed volumes , 2005 .

[21]  Haifeng Xu,et al.  Automatic moving object extraction for content-based applications , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  D. Noguet.  A massively parallel implementation of the watershed based on cellular automata , 1997, Proceedings IEEE International Conference on Application-Specific Systems, Architectures and Processors.

[23]  Seth Copen Goldstein,et al.  PipeRench: A Reconfigurable Architecture and Compiler , 2000, Computer.

[24]  Kazimierz Wiatr.  Pipeline architecture of specialized reconfigurable processors in FPGA structures for real-time image pre-processing , 1998, Proceedings. 24th EUROMICRO Conference (Cat. No.98EX204).

[25]  T. J. Fountain,et al.  The CLIP7A Image Processor , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Kristel Michielsen,et al.  Morphological image analysis , 2000 .

[27]  Jenq-Neng Hwang,et al.  Fast and automatic video object segmentation and tracking for content-based applications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[28]  Liang-Gee Chen,et al.  Partial-result-reuse architecture and its design technique for morphological operations , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[29]  Demin Wang.  Unsupervised video segmentation based on watersheds and temporal tracking , 1998, IEEE Trans. Circuits Syst. Video Technol..

[30]  R. Peyrard,et al.  Real-time road segmentation using a morphological multi-pipeline processor , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[31]  Yo-Sung Ho,et al.  A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal information , 1999, IEEE Trans. Circuits Syst. Video Technol..

[32]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[33]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[34]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[35]  Shorin Kyo,et al.  A 51.2-GOPS scalable video recognition processor for intelligent cruise control based on a linear array of 128 four-way VLIW processing elements , 2003 .