Title
Measuring Human Perception to Improve Handwritten Document Transcription
Abstract
In this paper, we consider how to incorporate psychophysical measurements of human visual perception into the loss function of a deep neural network being trained for a recognition task, under the assumption that such information can reduce errors. As a case study to assess the viability of this approach, we look at the problem of handwritten document transcription. While good progress has been made towards automatically transcribing modern handwriting, significant challenges remain in transcribing historical documents. Here we describe a general enhancement strategy, underpinned by the new loss formulation, which can be applied to the training regime of any deep learning-based document transcription system. Through experimentation, reliable performance improvement is demonstrated for the standard IAM and RIMES datasets for three different network architectures. Further, we go on to show feasibility for our approach on a new dataset of digitized Latin manuscripts, originally produced by scribes in the Cloister of St. Gall in the the 9th century.
Year
DOI
Venue
2022
10.1109/TPAMI.2021.3092688
IEEE Transactions on Pattern Analysis and Machine Intelligence
Keywords
DocType
Volume
Algorithms,Handwriting,Humans,Neural Networks, Computer,Perception
Journal
44
Issue
ISSN
Citations 
10
0162-8828
0
PageRank 
References 
Authors
0.34
19
8
Name
Order
Citations
PageRank
Samuel Grieggs101.35
Bingyu Shen2193.83
Greta Rauch300.34
Pei Li400.34
Jiaqi Ma500.34
David Chiang62843144.76
Brian Price700.34
Walter J. Scheirer877352.81