A New Real Time Object Segmentation and Tracking Algorithm and its Parallel Hardware Architecture

Most of the emerging content-based multimedia technologies are based on efficient methods to solve machine early vision tasks. Among other tasks, object segmentation is perhaps the most important problem in single image processing. The solution of this problem is the key technology of the development of the majority of leading-edge interactive video communication technology and telepresence systems. The aim of this paper is to present a robust framework for real-time object segmentation and tracking in video sequences taken simultaneously from different perspectives. The other contribution of the paper is to present a new dedicated parallel hardware architecture. It’s composed of a mixture of Digital Signal Processing (DSP) and Field Programmable Gate Array (FPGA) technologies and uses the Content Addressable Memory (CAM) as a main processing unit. Experimental results indicate that small amount of hardware can deliver real-time performance and high accuracy. This is an improvement over previous systems, where execution time of the second-order using a greater amount of hardware has been proposed.

[1]  Harpreet S. Sawhney,et al.  Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  Noel Brady.  MPEG-4 standardized methods for the compression of arbitrarily shaped video objects , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[4]  Anil K. Jain,et al.  Contour extraction of moving objects in complex outdoor scenes , 1995, International Journal of Computer Vision.

[5]  F. Billmeyer,et al.  Principles of color technology , 1967 .

[6]  Ming-Chieh Lee,et al.  Semantic video object segmentation and tracking using mathematical morphology and perspective motion model , 1997, Proceedings of International Conference on Image Processing.

[7]  Y. Fujita,et al.  A 10 GIPS SIMD processor for PC-based real time vision applications -architecture, algorithm implementation and language support , 1997, Proceedings Fourth IEEE International Workshop on Computer Architecture for Machine Perception. CAMP'97.

[8]  E. Yao,et al.  Perception Sensor for a Mobile Robot , 1994, Real Time Imaging.

[9]  W. Eric L. Grimson,et al.  The Combinatorics Of Object Recognition In Cluttered Environments Using Constrained Search , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[10]  Fernando Pereira.  MPEG-4: Why, what, how and when? , 2000, Signal Process. Image Commun..

[11]  Patrick Bouthemy,et al.  Region-Based Tracking Using Affine Motion Models in Long Image Sequences , 1994 .

[12]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[13]  Larry S. Davis,et al.  Object recognition using oriented model points , 1986 .

[14]  Masanori Hariyama,et al.  Collision Detection VLSI Processor for Intelligent Vehicles Using a Hierarchically-Content-Addressable Memory (Special Issue on Integrated Electronics and New System Paradigms) , 1999 .

[15]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[16]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[17]  Mamoru Nakanishi,et al.  On using the CAM concept for parametric curve extraction , 2000, IEEE Trans. Image Process..

[18]  T. Ogura,et al.  A fully parallel 1-Mb CAM LSI for real-time pixel-parallel image processing , 2000, IEEE Journal of Solid-State Circuits.

[19]  Clark F. Olson.  Improving the generalized Hough transform through imperfect grouping , 1998, Image Vis. Comput..