Illumination change robust, codec independent lowbit rate coding of stereo from singleview aerial video

Low bit rate transmission of HD video captured from UAVs is highly interesting. Assuming a planar surface, areas contained in the current frame but not in the previous frames (New Area) can be reconstructed using Global Motion Compensation (GMC). Aiming at stereo reconstruction from monocular video by using motion parallax, a second view of each image pixel has to be additionally transmitted. Whereas the bit rate can be considerably reduced compared to standardized video coding to about 1-2 Mbit/s, artifacts at the boundaries between new areas and GMC reconstructed areas may occur, e. g. due to illumination changes. We propose a gradient correction of the new areas to adjust the luminance. Furthermore, we utilize a general ROI coding framework to become independent of any encoder modifications. We achieve a subjectively higher video quality while saving 2% BD-rate compared to a specifically adapted encoder by exploiting latest encoder optimizations of x265.

[1]  Marco Munderloh,et al.  Detection of moving objects for aerial surveillance of arbitrary terrain , 2016 .

[2]  Jörn Ostermann,et al.  Codec independent region of interest video coding using a joint pre- and postprocessing framework , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[4]  Stefanos D. Kollias,et al.  Low bit-rate coding of image sequences using adaptive regions of interest , 1998, IEEE Trans. Circuits Syst. Video Technol..

[5]  Jörn Ostermann,et al.  Stereo mosaicking and 3D-video for singleview HDTV aerial sequences using a low bit rate ROI coding framework , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[6]  Mårten Sjöström,et al.  Spatio-temporal filter for ROI video coding , 2006, 2006 14th European Signal Processing Conference.

[7]  Beatrice Pesquet-Popescu,et al.  Region-of-interest based rate control scheme for high efficiency video coding , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Ming-Chieh Chi,et al.  ROI video coding based on H.263+ with robust skin-color detection technique , 2003, IEEE Trans. Consumer Electron..

[10]  Jörn Ostermann,et al.  Low bit rate ROI based video coding for HDTV aerial surveillance video sequences , 2011, CVPR 2011 WORKSHOPS.

[11]  Joern Ostermann,et al.  Mesh-based piecewise planar motion compensation and optical flow clustering for ROI coding , 2015, APSIPA Transactions on Signal and Information Processing.

[12]  Wen Gao,et al.  Surveillance video coding with quadtree partition based ROI extraction , 2013, 2013 Picture Coding Symposium (PCS).

[13]  Ofer Hadar,et al.  Complexity-aware adaptive spatial pre-processing for ROI scalable video coding with dynamic transition region , 2011, 2011 18th IEEE International Conference on Image Processing.