Title
Enriching Word Alignment with Linguistic Tags
Abstract
Incorporating linguistic knowledge into word alignment is becoming increasingly important for current approaches in statistical machine translation research. To improve automatic word alignment and ultimately machine translation quality, an annotation framework is jointly proposed by LDC (Linguistic Data Consortium) and IBM. The framework enriches word alignment corpora to capture contextual, syntactic and language-specific features by introducing linguistic tags to the alignment annotation. Two annotation schemes constitute the framework: alignment and tagging. The alignment scheme aims to identify minimum translation units and translation relations by using minimum-match and attachment annotation approaches. A set of word tags and alignment link tags are designed in the tagging scheme to describe these translation units and relations. The framework produces a solid ground-level alignment base upon which larger translation unit alignment can be automatically induced. To test the soundness of this work, evaluation is performed on a pilot annotation, resulting in inter- and intra- annotator agreement of above 90%. To date LDC has produced manual word alignment and tagging on 32,823 Chinese-English sentences following this framework.
Year
Venue
Field
2010
LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION
IBM,Linguistic Data Consortium,Annotation,Computer science,Machine translation,Speech recognition,Artificial intelligence,Natural language processing,Soundness,Linguistics,Syntax,Translation unit (programming)
DocType
Citations 
PageRank 
Conference
11
0.91
References 
Authors
7
5
Name
Order
Citations
PageRank
Xuansong Li1729.93
Niyu Ge219521.69
Stephen Grimes3274.56
Stephanie Strassel451258.41
Kazuaki Maeda513834.69