Algorithm and Architecture Design of Human–Machine Interaction in Foreground Object Detection With Dynamic Scene

In the field of intelligent visual surveillance, the topic of tolerating background motions while detecting foreground motions in dynamic scene is widely explored by the recent foreground detection literatures. Applying the sophisticated background modeling method is a common solution for such dynamic background problem. However, the sophisticated background modeling method is computation intensive and involves huge memory bandwidth on data access. Realizing such approach on a multicamera surveillance system for real-time application can dramatically increase the hardware cost. This paper presents a hardware-oriented foreground detection that is based on human-machine interaction in object level (HMIiOL) scheme. The HMIiOL can vary the conditions for a moving object been regarded as a foreground object. The conditions are depending on background environment and are derived from the information from human-machine interaction. By the HMIiOL scheme, adopting a simple background modeling method can achieve well foreground detection with significant background motions. A processor based on system-on-chip design is presented for the HMIiOL-based foreground detection. The presented processor consists of accelerators to increase throughput of the computationally intensive tasks in the algorithm, and a reduced instruction set computing unit to handle the interaction task and the noncomputation-intensive tasks. Pipelining and parallelism techniques are used to increase the throughput. The detecting capability of the processor reaches HD720 at 30 Hz. The maximum throughput can be up to 32.707 Mpixels/s. Performance evaluation and comparison with existed foreground detection hardware show the improvement of our design.

[1]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[2]  Reinhard Klette,et al.  Robust background subtraction and maintenance , 2004, ICPR 2004.

[3]  Shao-Yi Chien,et al.  Real-Time Memory-Efficient Video Object Segmentation in Dynamic Background with Multi-Background Registration Technique , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[4]  Matti Pietikäinen,et al.  Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..

[6]  Liang-Gee Chen,et al.  Single chip video segmentation system with a programmable PE array , 2002, Proceedings. IEEE Asia-Pacific Conference on ASIC,.

[7]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[8]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[9]  Hans Jürgen Mattausch,et al.  An FPGA-Based Region-Growing Video Segmentation System with Boundary-Scan-Only LSI Architecture , 2006, APCCAS 2006 - 2006 IEEE Asia Pacific Conference on Circuits and Systems.

[10]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Viktor Öwall,et al.  A Hardware Architecture for Real-Time Video Segmentation Utilizing Memory Reduction Techniques , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Jun-Wei Hsieh,et al.  Video-Based Human Movement Analysis and Its Application to Surveillance Systems , 2008, IEEE Transactions on Multimedia.

[13]  Max Mignotte,et al.  Statistical background subtraction using spatial cues , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[15]  Til Aach,et al.  Bayesian algorithms for adaptive change detection in image sequences using Markov random fields , 1995, Signal Process. Image Commun..

[16]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[17]  Shao-Yi Chien,et al.  Efficient Content Analysis Engine for Visual Surveillance Network , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Tsung-Han Tsai,et al.  Architecture design for a low-cost and low-complexity foreground object segmentation with Multi-model Background Maintenance algorithm , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Tsung-Han Tsai,et al.  Foreground Object Detection Based on Multi-model Background Maintenance , 2008 .

[21]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Feiping Nie,et al.  Semi-Supervised Classification via Local Spline Regression , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jinsang Kim,et al.  A VLSI architecture for video-object segmentation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[24]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[25]  Tsung-Han Tsai,et al.  A scalable parallel hardware architecture for connected component labeling , 2010, 2010 IEEE International Conference on Image Processing.

[26]  Montse Pardàs,et al.  Hierarchical morphological segmentation for image sequence coding , 1994, IEEE Trans. Image Process..

[27]  Wolfgang Straßer,et al.  Smart Camera Based Monitoring System and Its Application to Assisted Living , 2008, Proceedings of the IEEE.

[28]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[30]  Florent de Dinechin,et al.  Return of the hardware floating-point elementary function , 2007, 18th IEEE Symposium on Computer Arithmetic (ARITH '07).

[31]  Bo Li,et al.  Moving object detection in dynamic scenes using nonparametric local kernel histogram estimation , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[32]  Ralph Weischedel,et al.  PERFORMANCE MEASURES FOR INFORMATION EXTRACTION , 2007 .

[33]  Larry S. Davis,et al.  View-based detection and analysis of periodic motion , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[34]  Xavier Bresson,et al.  Semi-supervised Segmentation Based on Non-local Continuous Min-Cut , 2009, SSVM.

[35]  Shengping Zhang,et al.  Dynamic background modeling and subtraction using spatio-temporal local binary patterns , 2008, 2008 15th IEEE International Conference on Image Processing.

[36]  William E. Higgins,et al.  Relaxation methods for supervised image segmentation , 1997 .

[37]  Matteo Matteucci,et al.  A revaluation of frame difference in fast and robust motion detection , 2006, VSSN '06.

[38]  Florent de Dinechin,et al.  A parameterized floating-point exponential function for FPGAs , 2005, Proceedings. 2005 IEEE International Conference on Field-Programmable Technology, 2005..

[39]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..