Voting-Based Motion Estimation for Real-Time Video Transmission in Networked Mobile Camera Systems

In a video-based surveillance system, a mobile camera can provide dynamical and wider monitoring range and the video data transmitted from cooperative mobile cameras can be used to actively detect the objects of interest. However, it is a difficult task to accurately detect the moving objects from the image frames captured by the mobile cameras and the data flow of surveillance video from multiple cameras could be huge. The camera motion usually causes the shifting of static background as well as the moving objects in the captured image frames. In order to correctly estimate the motion of moving objects, a voting-based motion estimation algorithm is proposed to process the image frames captured by the mobile camera. Based on the estimation, a content-based video transmission mechanism is then implemented to further effectively decrease encoding cost and bandwidth utilization. The overall approach consists of voting-based motion estimation, moving object edges detection and content-based sampling coding at temporal and spatial scales. Without knowing the prior knowledge of camera motion, the motion estimation algorithm only utilizes the shifting information of edges of static background to estimate the camera movement. The shifting information is determined based on the voting decision of several representative regions of interest and the estimated motion is then used to compensate for the visual content obtained from the captured image frames. The proposed algorithms have been experimentally tested on several practical scenarios and it is demonstrated that, under limited network bandwidth, the transmitted image quality can be progressively achieved and the transmission bandwidth utilization can be effectively decreased.

[1]  Nuno Pereira,et al.  A Scalable and Efficient Approach for Obtaining Measurements in CAN-Based Control Systems , 2008, IEEE Transactions on Industrial Informatics.

[2]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[3]  Bir Bhanu,et al.  Dynamic Bayesian Networks for Vehicle Classification in Video , 2012, IEEE Transactions on Industrial Informatics.

[4]  Peter H. N. de With,et al.  A Mixed-Reality System for Broadcasting Sports Video to Mobile Devices , 2011, IEEE MultiMedia.

[5]  Huijun Di,et al.  A Scalable Distributed Architecture for Intelligent Vision System , 2012, IEEE Transactions on Industrial Informatics.

[6]  Jong-Hann Jean,et al.  Robust Visual Servo Control of a Mobile Robot for Object Tracking Using Shape Parameters , 2012, IEEE Transactions on Control Systems Technology.

[7]  Feng-Li Lian,et al.  Network architecture and communication modules for guaranteeing acceptable control and communication performance for networked multi-agent systems , 2006, IEEE Transactions on Industrial Informatics.

[8]  Du-Ming Tsai,et al.  A Shift-Tolerant Dissimilarity Measure for Surface Defect Detection , 2012, IEEE Transactions on Industrial Informatics.

[9]  Huijun Gao,et al.  Novel Approaches to Improve Robustness, Accuracy and Rapidity of Iris Recognition Systems , 2012, IEEE Transactions on Industrial Informatics.

[10]  Takumi Miyoshi,et al.  Image compression algorithm considering energy balance on wireless sensor networks , 2010, 2010 8th IEEE International Conference on Industrial Informatics.

[11]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jong-Hann Jean,et al.  Rate and Quality Control With Embedded Coding for Mobile Robot With Visual Patrol , 2012, IEEE Systems Journal.

[13]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[14]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.

[15]  Jae Wook Jeon,et al.  Design and Implementation of a Pipelined Datapath for High-Speed Face Detection Using FPGA , 2012, IEEE Transactions on Industrial Informatics.

[16]  Xuelong Li,et al.  Selecting Key Poses on Manifold for Pairwise Action Recognition , 2012, IEEE Transactions on Industrial Informatics.

[17]  Gian Luca Foresti,et al.  Special issue on video communications, processing, and understanding for third generation surveillance systems , 2001 .

[18]  Naokazu Yokoya,et al.  Real-Time Tracking of Multiple Moving Object Contours in a Moving Camera Image Sequence , 2000 .

[19]  Martin Reisslein,et al.  A survey of multimedia streaming in wireless sensor networks , 2008, IEEE Communications Surveys & Tutorials.

[20]  Jianwei Zhang,et al.  A Hierarchical Model Incorporating Segmented Regions and Pixel Descriptors for Video Background Subtraction , 2012, IEEE Transactions on Industrial Informatics.

[21]  Pablo Basanta-Val,et al.  Adaptive real-time video transmission over DDS , 2010, 2010 8th IEEE International Conference on Industrial Informatics.

[22]  Satoshi Uemura,et al.  Analysis of control accuracy for access control method based on sample monitoring in interactive TV services , 2010, 2010 8th IEEE International Conference on Industrial Informatics.

[23]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.

[24]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[25]  Michael Nielsen,et al.  Vision-Based 3D Peach Tree Reconstruction for Automated Blossom Thinning , 2012, IEEE Transactions on Industrial Informatics.

[26]  Michal Irani,et al.  Recovery of Ego-Motion Using Region Alignment , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Xiaoli Li,et al.  Fast Covariance Matching With Fuzzy Genetic Algorithm , 2012, IEEE Transactions on Industrial Informatics.

[28]  Paulo Drews,et al.  Analyzing and exploring feature detectors in images , 2011, 2011 9th IEEE International Conference on Industrial Informatics.

[29]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[30]  Wen-Hsiang Tsai,et al.  A Space-Mapping Method for Object Location Estimation Adaptive to Camera Setup Changes for Vision-Based Automation Applications , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Taeho Kim,et al.  Segmentation of moving objects using Multiple Background Model for industrial mobile robots , 2008, 2008 6th IEEE International Conference on Industrial Informatics.

[32]  Warren E. Dixon,et al.  Single Camera Structure and Motion , 2012, IEEE Transactions on Automatic Control.

[33]  Luca Benini,et al.  Distributed Compressive Sampling for Lifetime Optimization in Dense Wireless Sensor Networks , 2012, IEEE Transactions on Industrial Informatics.