Video Summarization for Object Tracking in the Internet of Things

Object tracking in the Internet of Things (IoT) has become a hot topic over the past ten years. Currently, the integration of video and radio-frequency identification (RFID) technology plays a crucial role in item-level activity recognition. Various techniques and applications have been proposed for visual object tracking. However, identifying semantic features of item-level objects in huge size of video content is a non-trivial task, especially in supply chain management. To alleviate this problem, this paper presents a novel method that applies IoT information to facilitate video summarization. Differing from common video summarization techniques, we use IoT information to select key frames of the video content during the background model establishment. Then we match other key frames with the background to extract important features. Finally, a compact summarization image for queried objects is generated according to a clustering analysis. We have also performed experiments to confirm the effectiveness of the proposed work.

[1]  Minyi Guo,et al.  TASA: Tag-Free Activity Sensing Using RFID Tag Arrays , 2011, IEEE Transactions on Parallel and Distributed Systems.

[2]  Hongan Wang,et al.  Interactive multi-scale structures for summarizing video content , 2013, Science China Information Sciences.

[3]  Zixue Cheng,et al.  Behavior Analysis with Combined RFID and Video Information , 2006, UIC.

[4]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[5]  Frédéric Lerasle,et al.  Vision and RFID data fusion for tracking people in crowds by a mobile robot , 2010, Comput. Vis. Image Underst..

[6]  Zhenjiang Miao,et al.  Fast Background Subtraction and Shadow Elimination Using Improved Gaussian Mixture Model , 2007, 2007 IEEE International Workshop on Haptic, Audio and Visual Environments and Games.

[7]  Ching-Sheng Wang,et al.  RFID & vision based indoor positioning and identification system , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[8]  David Salesin,et al.  Schematic storyboarding for video visualization and editing , 2006, SIGGRAPH '06.

[9]  Yuzhen Niu,et al.  Video summagator: an interface for video summarization and navigation , 2012, CHI.

[10]  Tucker R. Balch,et al.  Learning a projective mapping to locate animals in video using RFID , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Akio Nagasaka,et al.  Automatic structure visualization for video editing , 1993, INTERCHI.

[12]  Qingshan Liu,et al.  Identifying medicine bottles by incorporating RFID and video analysis , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[13]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  James M. Rehg,et al.  A Scalable Approach to Activity Recognition based on Object Use , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Rita Cucchiara,et al.  Mutual calibration of camera motes and RFIDs for people localization and identification , 2010, ICDSC '10.

[16]  Adam Finkelstein,et al.  Video tapestries with continuous temporal zoom , 2010, ACM Trans. Graph..

[17]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Katina Michael,et al.  Minimizing Product Shrinkage across the Supply Chain using Radio Frequency Identification: a Case Study on a Major Australian Retailer , 2007, International Conference on the Management of Mobile Business (ICMB 2007).

[19]  Peter H. Tu,et al.  Activity Recognition using Visual Tracking and RFID , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.