Low bit rate ROI based video coding for HDTV aerial surveillance video sequences

For aerial surveillance systems two key features are important. First they have to provide as much resolution as possible, while they secondly should make the video available at a ground station as soon as possible. Recently so called Unmanned Aerial Vehicles (UAVs) got in the focus for surveillance operations with operation targets such as environmental and disaster area monitoring as well as military surveillance. Common transmission channels for UAVs are only available with small bandwidths of a few Mbit/s. In this paper we propose a video codec which is able to provide full HDTV (1920 × 1080 pel) resolution with a bit rate of about 1–3 Mbit/s including moving objects (instead of 8–15 Mbit/s when using the standardized AVC codec). The coding system is based on an AVC video codec which is controlled by ROI detectors. Furthermore we make use of additional Global Motion Compensation (GMC). In a modular concept different Region of Interest (ROI) detectors can be added to adjust the coding system to special operation targets. This paper presents a coding system with two motion-based ROI detectors; one for new area detection (ROI-NA) and another for moving objects (ROI-MO). Our system preserves more details than an AVC coder at the same bit rate of 1.0 Mbit/s for the entire frame.

[1]  Thomas Sikora,et al.  Recent advances in video coding using static background models , 2010, 28th Picture Coding Symposium.

[2]  Bernhard Rinner,et al.  Incremental Mosaicking of Images from Autonomous, Small-Scale UAVs , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[3]  Hao Tang,et al.  Content-Based Dynamic 3D Mosaics , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Hui Cheng,et al.  Adaptive region of interest estimation for aerial surveillance video , 2005, IEEE International Conference on Image Processing 2005.

[6]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Roland Mech,et al.  A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera , 1998, Signal Process..

[8]  Michael Hötter,et al.  Objektorientierte Analyse-Synthese-Cod. basierend auf dem Modell bewegter, zweidimensionaler Objekte , 1992 .

[9]  Stefanos D. Kollias,et al.  Low bit-rate coding of image sequences using adaptive regions of interest , 1998, IEEE Trans. Circuits Syst. Video Technol..

[10]  M. Hötter,et al.  Image segmentation based on object oriented mapping parameter estimation , 1988 .

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.