Discrete Wavelet Transform and Gradient Difference Based Approach for Text Localization in Videos

The text detection and localization is important for video analysis and understanding. The scene text in video contains semantic information and thus can contribute significantly to video retrieval and understanding. However, most of the approaches detect scene text in still images or single video frame. Videos differ from images in temporal redundancy. This paper proposes a novel hybrid method to robustly localize the texts in natural scene images and videos based on fusion of discrete wavelet transform and gradient difference. A set of rules and geometric properties have been devised to localize the actual text regions. Then, morphological operation is performed to generate the text regions and finally the connected component analysis is employed to localize the text in a video frame. The experimental results obtained on publicly available standard ICDAR 2003 and Hua dataset illustrate that the proposed method can accurately detect and localize texts of various sizes, fonts and colors. The experimentation on huge collection of video databases reveal the suitability of the proposed method to video databases.

[1]  Anil K. Jain,et al.  Text information extraction in images and video: a survey , 2004, Pattern Recognit..

[2]  Edward K. Wong,et al.  A new robust algorithm for video text extraction , 2003, Pattern Recognit..

[3]  Michael R. Lyu,et al.  A comprehensive method for multilingual video text detection, localization, and extraction , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Xian-Sheng Hua,et al.  An automatic performance evaluation protocol for video text detection algorithms , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Horst Bunke,et al.  Identification of text on colored book and journal covers , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[6]  Kebin Jia,et al.  Video Key Frame Extraction Based on Spatial-Temporal Color Distribution , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[7]  Palaiahnakote Shivakumara,et al.  An Efficient Edge Based Technique for Text Detection in Video Frames , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[8]  Jing Zhang,et al.  Extraction of Text Objects in Video Documents: Recent Progress , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[9]  Changsong Liu,et al.  A research on Video text tracking and recognition , 2013, Electronic Imaging.

[10]  Palaiahnakote Shivakumara,et al.  A Laplacian Method for Video Text Detection , 2000, 2009 10th International Conference on Document Analysis and Recognition.

[11]  Wen Gao,et al.  Fast and robust text detection in images and video frames , 2005, Image Vis. Comput..

[12]  Dong Zhang,et al.  A New Shot Boundary Detection Algorithm , 2001, IEEE Pacific Rim Conference on Multimedia.

[13]  Xiaodong Huang Automatic Video Text Detection and Localization Based on Coarseness Texture , 2012, 2012 Fifth International Conference on Intelligent Computation Technology and Automation.

[14]  Palaiahnakote Shivakumara,et al.  A Robust Wavelet Transform Based Technique for Video Text Detection , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[15]  Alan L. Yuille,et al.  Detecting and reading text in natural scenes , 2004, CVPR 2004.

[16]  Chunheng Wang,et al.  Text detection in images based on unsupervised classification of edge-based features , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[17]  Anil K. Jain,et al.  Automatic text location in images and video frames , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Wen Gao,et al.  A robust text detection algorithm in images and video frames , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[19]  Xinbo Gao,et al.  A Video Shot Boundary Detection Algorithm Based on Feature Tracking , 2006, RSKT.

[20]  Palaiahnakote Shivakumara,et al.  2009 10th International Conference on Document Analysis and Recognition A Gradient Difference based Technique for Video Text Detection , 2022 .

[21]  Rainer Lienhart,et al.  Localizing and segmenting text in images and videos , 2002, IEEE Trans. Circuits Syst. Video Technol..

[22]  Shwu-Huey Yen,et al.  Precise news video text detection/localization based on multiple frames integration , 2010 .

[23]  Jian Wang,et al.  An Unsupervised Approach for Video Text Localization , 2006, IEICE Trans. Inf. Syst..

[24]  Pablo Toharia,et al.  Shot boundary detection using Zernike moments in multi-GPU multi-CPU architectures , 2012, J. Parallel Distributed Comput..

[25]  Chang Hong Lin,et al.  A robust video text detection approach using SVM , 2012, Expert Syst. Appl..

[26]  B. H. Shekar,et al.  An Efficient and Accurate Shot Boundary Detection Technique Based on Colour Moments , 2011 .