Smart Monitoring Cameras Driven Intelligent Processing to Big Surveillance Video Data

Video surveillance system has become a critical part in the security and protection system of modem cities, since smart monitoring cameras equipped with intelligent video analytics techniques can monitor and pre-alarm abnormal behaviors or events. However, with the expansion of the surveillance network, massive surveillance video data poses huge challenges to the analytics, storage and retrieval in the Big Data era. This paper presents a novel intelligent processing and utilization solution to big surveillance video data based on the event detection and alarming messages from front-end smart cameras. The method includes three parts: the intelligent pre-alarming for abnormal events, smart storage for surveillance video and rapid retrieval for evidence videos, which fully explores the temporal-spatial association analysis with respect to the abnormal events in different monitoring sites. Experimental results reveal that our proposed approach can reliably pre-alarm security risk events, substantially reduce storage space of recorded video and significantly speed up the evidence video retrieval associated with specific suspects.

[1]  Qi Wang,et al.  Online Anomaly Detection in Crowd Scenes via Structure Analysis , 2015, IEEE Transactions on Cybernetics.

[2]  Yu Chen,et al.  Exploiting global redundancy in big surveillance video data for efficient coding , 2015, Cluster Computing.

[3]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[4]  Cai Jie,et al.  Design on Intelligent Video Surveillance System Based on Target Identification Algorithm , 2015 .

[5]  Yue Gao,et al.  Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing , 2016, IEEE Transactions on Image Processing.

[6]  Xiao Liu,et al.  Random Geometric Prior Forest for Multiclass Object Segmentation , 2015, IEEE Transactions on Image Processing.

[7]  Kejun Wang,et al.  Ant-based clustering of visual-words for unsupervised human action recognition , 2010, NaBIC.

[8]  Xiao Liu,et al.  Weakly Supervised Multiclass Video Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Junsong Yuan,et al.  Abnormal event detection in crowded scenes using sparse representation , 2013, Pattern Recognit..

[10]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[11]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[12]  Yong Ma,et al.  The Approach to Detect Abnormal Access Behavior Based on Naive Bayes Algorithm , 2016, 2016 10th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS).

[13]  Tieniu Tan,et al.  Vs-star: A visual interpretation system for visual surveillance , 2010, Pattern Recognit. Lett..

[14]  David S. Ebert,et al.  Spatiotemporal social media analytics for abnormal event detection and examination using seasonal-trend decomposition , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[15]  Yang He,et al.  Method to Detect Abnormal Learning Behavior Inspired by Artificial Immune Systems , 2015, 2015 International Symposium on Educational Technology (ISET).

[16]  Bonhwa Ku,et al.  Online multi-person tracking for intelligent video surveillance systems , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[17]  Shih-Lun Chen,et al.  Fully pipelined VLSI architecture of a real-time block-based object detector for intelligent video surveillance systems , 2015, 2015 IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS).

[18]  Yong Yang,et al.  Face occlusion detection using skin color ratio and LBP features for intelligent video surveillance systems , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[19]  Gerhard P. Hancke,et al.  The Role of Advanced Sensing in Smart Cities , 2012, Sensors.

[20]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Xiaojun Bi,et al.  Detection of Anomalous Crowd Behavior Based on the Acceleration Feature , 2015, IEEE Sensors Journal.

[22]  Hamid Mcheick,et al.  CityPro; An Integrated City-protection Collaborative Platform , 2014, EUSPN/ICTH.

[23]  Hyun Myung,et al.  Weighted joint-based human behavior recognition algorithm using only depth information for low-cost intelligent video-surveillance system , 2016, Expert Syst. Appl..

[24]  Luis Miguel Bergasa,et al.  Expert video-surveillance system for real-time detection of suspicious behaviors in shopping malls , 2015, Expert Syst. Appl..

[25]  Alan L. Porter,et al.  A systematic method to create search strategies for emerging technologies based on the Web of Science: illustrated for ‘Big Data’ , 2015, Scientometrics.

[26]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, ICCV.

[27]  Yandong Tang,et al.  Video Anomaly Search in Crowded Scenes via Spatio-Temporal Motion Context , 2013, IEEE Transactions on Information Forensics and Security.

[28]  Mubarak Shah,et al.  Automated Visual Surveillance in Realistic Scenarios , 2007, IEEE MultiMedia.

[29]  Wei Zeng,et al.  Detecting abnormal behaviors in surveillance videos based on fuzzy clustering and multiple Auto-Encoders , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[30]  Prateep Misra,et al.  Smart city surveillance: Leveraging benefits of cloud data stores , 2012, 37th Annual IEEE Conference on Local Computer Networks - Workshops.

[31]  Jinjun Chen,et al.  Authorized Public Auditing of Dynamic Big Data Storage on Cloud with Efficient Verifiable Fine-Grained Updates , 2014, IEEE Transactions on Parallel and Distributed Systems.

[32]  Alberto Del Bimbo,et al.  Effective Codebooks for human action categorization , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[33]  Ruimin Hu,et al.  Noise robust position-patch based face super-resolution via Tikhonov regularized neighbor representation , 2016, Inf. Sci..

[34]  Alessandro Perina,et al.  Multiple-shot person re-identification by chromatic and epitomic analyses , 2012, Pattern Recognit. Lett..

[35]  David A. Forsyth,et al.  Video Event Detection: From Subvolume Localization to Spatiotemporal Path Search , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Jinjun Chen,et al.  MuR-DPA: Top-Down Levelled Multi-Replica Merkle Hash Tree Based Secure Public Auditing for Dynamic Big Data Storage on Cloud , 2015, IEEE Transactions on Computers.

[37]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework , 2008, Machine Vision and Applications.

[38]  Yu Cao,et al.  SVIS: Large Scale Video Data Ingestion into Big Data Platform , 2015, DASFAA Workshops.

[39]  Simone Calderara,et al.  Detection of abnormal behaviors using a mixture of Von Mises distributions , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[40]  R. K. Saranya,et al.  Improving Accessing Efficiency of Cloud Storage Using De- Duplication and Feedback Schemes , 2015 .

[41]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[42]  Francisco Alayón Hernández,et al.  An Intelligent System Proposal for Improving the Safety and Accessibility of Public Transit by Highway , 2015, Sensors.

[43]  Kejun Wang,et al.  Video-Based Abnormal Human Behavior Recognition—A Review , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).