Parallel Computational Intelligence-Based Multi-Camera Surveillance System

In this work, we present a multi-camera surveillance system based on the use of self-organizing neural networks to represent events on video. The system processes several tasks in parallel using GPUs (graphic processor units). It addresses multiple vision tasks at various levels, such as segmentation, representation or characterization, analysis and monitoring of the movement. These features allow the construction of a robust representation of the environment and interpret the behavior of mobile agents in the scene. It is also necessary to integrate the vision module into a global system that operates in a complex environment by receiving images from multiple acquisition devices at video frequency. Offering relevant information to higher level systems, monitoring and making decisions in real time, it must accomplish a set of requirements, such as: time constraints, high availability, robustness, high processing speed and re-configurability. We have built a system able to represent and analyze the motion in video acquired by a multi-camera network and to process multi-source data in parallel on a multi-GPU architecture.

[1]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Keechul Jung,et al.  GPU implementation of neural networks , 2004, Pattern Recognit..

[3]  Hilary Buxton,et al.  Conceptual descriptions from monitoring and watching image sequences , 2000, Image Vis. Comput..

[4]  T. Martínez,et al.  Competitive Hebbian Learning Rule Forms Perfectly Topology Preserving Maps , 1993 .

[5]  Shen Jun,et al.  A Hierarchical Self-Organizing Approach for Learning the Patterns of Motion Trajectories , 2003 .

[6]  Hilary Buxton,et al.  Analogical representation of space and time , 1992, Image Vis. Comput..

[7]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[8]  Kevin Skadron,et al.  A performance study of general-purpose applications on graphics processors using CUDA , 2008, J. Parallel Distributed Comput..

[9]  Marc Stamminger,et al.  Fast GPU‐based Adaptive Tessellation with CUDA , 2009, Comput. Graph. Forum.

[10]  Keechul Jung,et al.  View-Point Insensitive Human Pose Recognition using Neural Network and CUDA , 2008 .

[11]  Tomoki Fukai,et al.  Real-time simulation of a spiking neural network model of the basal ganglia circuitry using general purpose computing on graphics processing units , 2011, Neural Networks.

[12]  Sven Behnke,et al.  Large-scale object recognition with CUDA-accelerated hierarchical neural networks , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[13]  Ying Wu,et al.  An Adaptive Self-Organizing Color Segmentation Algorithm with Application to Robust Real-time Human Hand Localization , 2000 .

[14]  José García Rodríguez,et al.  Fast Autonomous Growing Neural Gas , 2011, The 2011 International Joint Conference on Neural Networks.

[15]  Keechul Jung,et al.  Neural Network Implementation Using CUDA and OpenMP , 2008, 2008 Digital Image Computing: Techniques and Applications.

[16]  Justin P. Haldar,et al.  Accelerating advanced mri reconstructions on gpus , 2008, CF '08.

[17]  José García Rodríguez,et al.  Fast Image Representation with GPU-Based Growing Neural Gas , 2011, IWANN.

[18]  William J. Dally,et al.  The GPU Computing Era , 2010, IEEE Micro.

[19]  Václav Simek,et al.  GPU Acceleration of 2D-DWT Image Compression in MATLAB with CUDA , 2008, 2008 Second UKSIM European Symposium on Computer Modeling and Simulation.

[20]  Nikil D. Dutt,et al.  Efficient simulation of large-scale Spiking Neural Networks using CUDA graphics processors , 2009, 2009 International Joint Conference on Neural Networks.

[21]  Tian Yuan,et al.  A NOVEL ROBUST ALGORITHM FOR REAL-TIME OBJECT TRACKING , 2002 .

[22]  Wen-mei W. Hwu,et al.  GPU Computing Gems Emerald Edition , 2011 .

[23]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[24]  Matthew Brand,et al.  Discovery and Segmentation of Activities in Video , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Michael Garland,et al.  Designing efficient sorting algorithms for manycore GPUs , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[26]  Gernot A. Fink,et al.  Face Detection Using GPU-Based Convolutional Neural Networks , 2009, CAIP.

[27]  Takeo Kanade,et al.  Realtime affine-photometric KLT feature tracker on GPU in CUDA framework , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[28]  Jie Cheng,et al.  Programming Massively Parallel Processors. A Hands-on Approach , 2010, Scalable Comput. Pract. Exp..

[29]  Fatih Omruuzun,et al.  Experiences on Image and Video Processing with CUDA and OpenCL , 2011 .

[30]  David Schreiber,et al.  GPU-based non-parametric background subtraction for a practical surveillance system , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[31]  José García Rodríguez,et al.  Real time motion estimation using a neural architecture implemented on GPUs , 2016, Journal of Real-Time Image Processing.

[32]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[33]  Sergio A. Velastin,et al.  Intelligent distributed video surveillance systems , 2006 .

[34]  José García Rodríguez,et al.  Surveillance and human-computer interaction applications of self-growing models , 2011, Appl. Soft Comput..

[35]  SkadronKevin,et al.  A performance study of general-purpose applications on graphics processors using CUDA , 2008 .

[36]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.

[37]  Tien-Tsin Wong,et al.  GPU-friendly warped display for scope-maintained video surveillance , 2006, Multimedia Systems.

[38]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).