Title
Multi-lingual text recognition from video frames
Abstract
Text recognition from video frames is a challenging task due to low resolution, blur, complex and coloured backgrounds, noise, to mention a few. Consequently, the traditional ways of text recognition from scanned documents having simple backgrounds fails when applied to video text. Although there are various techniques available for text recognition from handwritten and printed documents with simple backgrounds, text recognition from video frames has not been comprehensively investigated, especially for multi-lingual videos. In this paper, we present a technique for multi-lingual video text recognition which involves script identification in the first stage, followed by word and character recognition, and finally the results are refined using a post-processing technique. Considering the inherent problems in videos, a Spatial Pyramid Matching (SPM) based technique, using patch-based SIFT descriptors and SVM classifier, is employed for script identification. In the next stage, a Hidden Markov Model (HMM) based approach is used for word and character recognition, which utilizes the context information. Finally, a lexicon-based post-processing technique is applied to verify and refine the word recognition results. The proposed method was tested on a dataset comprising of 4800 words from three different scripts, namely, Roman (English), Hindi and Bengali. The script identification results obtained are encouraging. The word and character recognition results are also encouraging considering the complexity and problems associated with video text processing.
Year
DOI
Venue
2015
10.1109/ICDAR.2015.7333902
International Conference on Document Analysis and Recognition
Field
DocType
ISSN
Noisy text analytics,Computer science,Speaker recognition,Artificial intelligence,Intelligent word recognition,Computer vision,3D single-object recognition,Intelligent character recognition,Pattern recognition,Document processing,Optical character recognition,Speech recognition,Sketch recognition
Conference
1520-5363
Citations 
PageRank 
References 
4
0.37
11
Authors
6
Name
Order
Citations
PageRank
Nabin Sharma113211.55
Ranju Mandal2314.28
Rabi Sharma3110.82
Partha Pratim Roy459777.02
Umapada Pal51477139.32
Michael Blumenstein634827.40