Abstract | ||
---|---|---|
Incorporating linguistic knowledge into word alignment is becoming increasingly important for current approaches in statistical machine translation research. To improve automatic word alignment and ultimately machine translation quality, an annotation framework is jointly proposed by LDC (Linguistic Data Consortium) and IBM. The framework enriches word alignment corpora to capture contextual, syntactic and language-specific features by introducing linguistic tags to the alignment annotation. Two annotation schemes constitute the framework: alignment and tagging. The alignment scheme aims to identify minimum translation units and translation relations by using minimum-match and attachment annotation approaches. A set of word tags and alignment link tags are designed in the tagging scheme to describe these translation units and relations. The framework produces a solid ground-level alignment base upon which larger translation unit alignment can be automatically induced. To test the soundness of this work, evaluation is performed on a pilot annotation, resulting in inter- and intra- annotator agreement of above 90%. To date LDC has produced manual word alignment and tagging on 32,823 Chinese-English sentences following this framework. |
Year | Venue | Field |
---|---|---|
2010 | LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION | IBM,Linguistic Data Consortium,Annotation,Computer science,Machine translation,Speech recognition,Artificial intelligence,Natural language processing,Soundness,Linguistics,Syntax,Translation unit (programming) |
DocType | Citations | PageRank |
Conference | 11 | 0.91 |
References | Authors | |
7 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Xuansong Li | 1 | 72 | 9.93 |
Niyu Ge | 2 | 195 | 21.69 |
Stephen Grimes | 3 | 27 | 4.56 |
Stephanie Strassel | 4 | 512 | 58.41 |
Kazuaki Maeda | 5 | 138 | 34.69 |