Timestamp removal for panorama video surveillance

This paper presents a fast algorithm to locate and remove overlaid video timestamps for panorama video surveillance. The timestamp removal for panorama video surveillance is a challenge research problem because it allows a very short processing time and it requires to recovery the covered objects. And the existing general object localization methods cannot localize the timestamp reliably and the existing object removal methods cannot remove timestamps with high visual scene consistence. For the timestamp localization, this paper customizes the existing method of localizing digital video clocks. For timestamp removal this paper proposes a fast and novel procedure. Its fast speed is because it employs a fast image registration method mainly by fusing the PTZ camera motion estimation and global histogram-based image matching. Then it recoveries the pixels covered by timestamps by using a temporal-neighbor pixel recovery method. The extensive experimental results show that the proposed algorithm can remove a timestamp within 2 seconds and the recovered frames are visually consistent with the real scene.

[1]  Zeev Farbman,et al.  Coordinates for instant image cloning , 2009, ACM Trans. Graph..

[2]  Ming Liu,et al.  Video completion via motion guided spatial-temporal global optimization , 2009, ACM Multimedia.

[3]  Marius Tico,et al.  Robust image registration for multi-frame mobile applications , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[4]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[5]  Murat Gevrekci,et al.  On Geometric and Photometric Registration of Images , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[8]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[9]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shiqian Wu,et al.  Exposure-Robust Alignment of Differently Exposed Images , 2014, IEEE Signal Processing Letters.

[12]  Xinguo Yu,et al.  Reading Digital Video Clocks , 2015, Int. J. Pattern Recognit. Artif. Intell..