A Novel Arbitrary-Oriented Multilingual Text Detection in Images/Video

Text in images and videos plays a vital role to understand the events. The textual information is a prominent source and semantic information of a particular content of the respective image or video. Text detection is a primary stage for text recognition and text understanding. Still, text detection process is a challenging and interesting research work in the field of computer vision due to illumination, alignments, complex background and variation size, color, fonts of the text. The multilingual text consists of different geometrical structures of languages. In this paper, a simple and yet effective approach is presented to detect the text from arbitrary oriented multilingual images/video. The proposed method is based on Laplacian of Gaussian information and full connected component analysis. The proposed method is evaluated on four datasets such as Hua’s dataset, arbitrarily oriented dataset, Multi-script Robust Reading Competition (MRRC) dataset and MSRA dataset with performance measures precision, recall and f-measure. The results show that the proposed method is promising and encouraging.

[1]  Palaiahnakote Shivakumara,et al.  New Fourier-Statistical Features in RGB Space for Video Text Detection , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Palaiahnakote Shivakumara,et al.  Script independent approach for multi-oriented text detection in scene image , 2017, Neurocomputing.

[3]  Hui Wu,et al.  Scene text detection using adaptive color reduction, adjacent character model and hybrid verification strategy , 2015, The Visual Computer.

[4]  Palaiahnakote Shivakumara,et al.  Detection of Curved Text in Video: Quad Tree Based Method , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[5]  Yi Li,et al.  Orientation Robust Text Line Detection in Natural Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yuxiao Hu,et al.  Text From Corners: A Novel Approach to Detect Text and Caption in Videos , 2011, IEEE Transactions on Image Processing.

[7]  Kaizhu Huang,et al.  Robust Text Detection in Natural Scene Images , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Palaiahnakote Shivakumara,et al.  Multi-oriented text detection for intra-frame in H.264/AVC video , 2014, 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[9]  Palaiahnakote Shivakumara,et al.  A New Method for Arbitrarily-Oriented Text Detection in Video , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[10]  Shuchang Zhou,et al.  EAST: An Efficient and Accurate Scene Text Detector , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jun Zhang,et al.  Multi-Orientation Scene Text Detection with Adaptive Clustering , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Baihua Xiao,et al.  A robust system for text extraction in video , 2007, 2007 International Conference on Machine Vision.

[13]  Shijian Lu,et al.  Multioriented Video Scene Text Detection Through Bayesian Classification and Boundary Growing , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Xian-Sheng Hua,et al.  An automatic performance evaluation protocol for video text detection algorithms , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  M. S. Pavithra,et al.  A comprehensive of transforms, Gabor filter and k-means clustering for text detection in images and video , 2016 .

[16]  Palaiahnakote Shivakumara,et al.  Multi-oriented moving text detection , 2014, 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[17]  Chunheng Wang,et al.  Text detection in images based on unsupervised classification of edge-based features , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[18]  Yao Li,et al.  Characterness: An Indicator of Text in the Wild , 2013, IEEE Transactions on Image Processing.

[19]  Kang-Hyun Jo,et al.  Multi language text detection using fast stroke width transform , 2015, 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[20]  Chew Lim Tan,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence, Manuscript Id a Laplacian Approach to Multi-oriented Text Detection in Video , 2022 .

[21]  Nizar Bouguila,et al.  Automatic Inpainting Scheme for Video Text Detection and Removal , 2013, IEEE Transactions on Image Processing.

[22]  Palaiahnakote Shivakumara,et al.  New Wavelet and Color Features for Text Detection in Video , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Yonatan Wexler,et al.  Detecting text in natural scenes with stroke width transform , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Wen-Hung Liao,et al.  An integrated approach for multilingual scene text detection , 2015, 2015 7th International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[25]  Edward K. Wong,et al.  A new robust algorithm for video text extraction , 2003, Pattern Recognit..

[26]  Zhuowen Tu,et al.  Detecting Texts of Arbitrary Orientations in 1 Natural Images , 2012 .

[27]  Weilin Huang,et al.  Text-Attentional Convolutional Neural Network for Scene Text Detection , 2015, IEEE Transactions on Image Processing.

[28]  Palaiahnakote Shivakumara,et al.  A robust arbitrary text detection system for natural scene images , 2014, Expert Syst. Appl..

[29]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[30]  Jun Sun,et al.  A novel text structure feature extractor for Chinese scene text detection and recognition , 2017, 2016 23rd International Conference on Pattern Recognition (ICPR).

[31]  Zhixin Shi,et al.  A Two Level Algorithm for Text Detection in Natural Scene Images , 2014, 2014 11th IAPR International Workshop on Document Analysis Systems.

[32]  Wenyu Liu,et al.  A Unified Framework for Multioriented Text Detection and Recognition , 2014, IEEE Transactions on Image Processing.