Paper Info
Title
A Proper Approach to Japanese Morphological Analysis: Dictionary, Model, and Evaluation
Abstract
In this paper, we discuss lemma identification in Japanese morphological analysis, which is crucial for a proper formulation of morphological analysis that benefits not only NLP researchers but also corpus linguists. Since Japanese words often have variation in orthography and the vocabulary of Japanese consists of words of several different origins, it sometimes happens that more than one writing form corresponds to the same lemma and that a single writing form corresponds to two or more lemmas with different readings and/or meanings. The mapping from a writing form onto a lemma is important in linguistic analysis of corpora. The current study focuses on disambiguation of heteronyms, words with the same writing form but with different word forms. To resolve heteronym ambiguity, we make use of goshu information, the classification of words based on their origin. Founded on the fact that words of some goshu classes are more likely to combine into compound words than words of other classes, we employ a statistical model based on CRFs using goshu information. Experimental results show that the use of goshu information considerably improves the performance of heteronym disambiguation and lemma identification, suggesting that goshu information solves the lemma identification task very effectively.
Year
Venue
Keywords
2008
SIXTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, LREC 2008
statistical model,morphological analysis
Field
DocType
Citations 
Computer science,Compound,Natural language processing,Artificial intelligence,Ambiguity,CRFS,Lemma (mathematics),Heteronym,Orthography,Speech recognition,Statistical model,Linguistics,Vocabulary
Conference
13
PageRank 
References 
Authors
1.60
6
4
Name
Order
Citations
PageRank
Yasuharu Den114526.23
Junpei Nakamura2131.60
Toshinobu Ogiso3797.42
Hideki Ogura4846.97