Title | ||
---|---|---|
Sequence Discriminative Training for Offline Handwriting Recognition by an Interpolated CTC and Lattice-Free MMI Objective Function |
Abstract | ||
---|---|---|
We study two sequence discriminative training criteria, i.e., Lattice-Free Maximum Mutual Information (LFMMI) and Connectionist Temporal Classification (CTC), for end-to-end training of Deep Bidirectional Long Short-Term Memory (DBLSTM) based character models of two offline English handwriting recognition systems with an input feature vector sequence extracted by Principal Component Analysis (PCA) and Convolutional Neural Network (CNN), respectively. We observe that refining CTC-trained PCA-DBLSTM model with an interpolated CTC and LFMMI objective function ("CTC+LFMMI") for several additional iterations achieves a relative Word Error Rate (WER) reduction of 24.6% and 13.9% on the public IAM test set and an in-house E2E test set, respectively. For a much better CTC-trained CNN-DBLSTM system, the proposed "CTC+LFMMI" method achieves a relative WER reduction of 19.6% and 8.3% on the above two test sets, respectively. |
Year | DOI | Venue |
---|---|---|
2017 | 10.1109/ICDAR.2017.19 | 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) |
Keywords | Field | DocType |
Lattice-Free MMI,CTC,Sequence Discriminative Training,Offline Handwriting Recognition | Feature vector,Mathematical optimization,Pattern recognition,Convolutional neural network,Computer science,Word error rate,Handwriting recognition,Feature extraction,Artificial intelligence,Mutual information,Discriminative model,Test set | Conference |
Volume | ISSN | ISBN |
01 | 1520-5363 | 978-1-5386-3587-2 |
Citations | PageRank | References |
1 | 0.37 | 14 |
Authors | ||
8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Wenping Hu | 1 | 82 | 6.77 |
Meng Cai | 2 | 68 | 8.24 |
Kai Chen | 3 | 71 | 5.38 |
Haisong Ding | 4 | 9 | 2.57 |
Lei Sun | 5 | 18 | 3.40 |
Sen Liang | 6 | 8 | 1.21 |
Xiongjian Mo | 7 | 3 | 0.77 |
Qiang Huo | 8 | 1098 | 99.69 |