Trajectory based database management for intelligent surveillance system with heterogeneous sensors

In this paper, we present a database management scheme for an intelligent surveillance system utilizing multiple visual sensors and RFID readers. The objects are tracked and identified by multiple visual sensors and RFID readers. We define three different types of data structure to consistently store data for effective data storage. They contain global object number and identification as the common information of the same object. The global object number is uniquely assigned for each track object. The previously stored data without the common information is back-annotated when it is available in the system. Moreover, when the global object number changes because of imperfect detection and tracking, the system maintains consistency information between global object numbers for the same object by comparing their local target information or positions. The fragmented information for an object is also stitched through map information. The simulation results demonstrate that the database information for objects is successfully recovered with consistency.

[1]  Sangjin Hong,et al.  Effective Object Identification and Association by Varying Coverage Through RFID Power Control , 2013, Journal of Computer Science and Technology.

[2]  Nammee Moon,et al.  User-selectable interactive recommendation system in mobile environment , 2011, Multimedia Tools and Applications.

[3]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[5]  Sangjin Hong,et al.  Multiple Camera Collaboration Strategies for Dynamic Object Association , 2010, KSII Trans. Internet Inf. Syst..

[6]  Weiru Liu,et al.  Event Composition with Imperfect Information for Bus Surveillance , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[7]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): a open and extensible framework for event based surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[8]  Sangjin Hong,et al.  Sector Based Scanning and Adaptive Active Tracking of Multiple Objects , 2011, KSII Trans. Internet Inf. Syst..

[9]  Hong-Hsu Yen,et al.  A Survey on Sensor Coverage and Visual Data Capturing/Processing/Transmission in Wireless Visual Sensor Networks , 2014, Sensors.

[10]  Khiat Salim,et al.  Probabilistic Models for Local Patterns Analysis , 2014 .

[11]  Tomi Räty,et al.  Survey on Contemporary Remote Surveillance Systems for Public Safety , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Zhaoquan Cai,et al.  Occluded and Low Resolution Face Detection with Hierarchical Deformable Model , 2012 .

[13]  Ramakant Nevatia,et al.  Janus - Multi Source Event Detection and Collection System for Effective Surveillance of Criminal Activity , 2014, J. Inf. Process. Syst..

[14]  Sharath Pankanti,et al.  Video surveillance: past, present, and now the future [DSP Forum] , 2013, IEEE Signal Processing Magazine.

[15]  Sangjin Hong,et al.  Association and Identification in Heterogeneous Sensors Environment with Coverage Uncertainty , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  Sangjin Hong,et al.  Locally Initiating Line-Based Object Association in Large Scale Multiple Cameras Environment , 2010, KSII Trans. Internet Inf. Syst..

[17]  Takashi Hattori,et al.  A Real-World Event Search System in Sensor Network Environments , 2006, 7th International Conference on Mobile Data Management (MDM'06).

[18]  Alberto Del Bimbo,et al.  Survey papers in multimedia - guest editorial , 2010, Multimedia Tools and Applications.

[19]  Sangjin Hong,et al.  Object Association and Identification in Heterogeneous Sensors Environment , 2010, EURASIP J. Adv. Signal Process..

[20]  Avigdor Gal,et al.  Inference of Security Hazards from Event Composition Based on Incomplete or Uncertain Information , 2008, IEEE Transactions on Knowledge and Data Engineering.

[21]  Kyung-Rog Kim,et al.  Designing a social learning content management system based on learning objects , 2012, Multimedia Tools and Applications.

[22]  Lipo Wang,et al.  Guest editorial: special issue on new trends in multimedia processing , 2010, Multimedia Tools and Applications.

[23]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..