Title
What we need is word, not morpheme; constructing word analyzer for Japanese
Abstract
This paper presents our work on building a Japanese word analyzer, SNOWMAN that is not so-called a “morphological analyzer.” Although there are some morphological analyzers still available, they all produce morphemes, not words as output. That is, they are insufficient to recognize word consisting of multiple morphemes, such as idioms. Moreover, it is quite important in Japanese processing to reduce orthographical variants, that is considered partially in the current analyzers. Our analyzer strives to solve both problems. We have produced an analyzer in which 320 thousand morphemes can be merged into 287 thousand words, and 28 thousand words with multiple morphemes can be recognized as word.
Year
DOI
Venue
2015
10.1109/IALP.2015.7451529
2015 International Conference on Asian Language Processing (IALP)
Keywords
Field
DocType
morphlogical analysis,linguistic resources
Morpheme,Computer science,Speech recognition,Natural language processing,Artificial intelligence,Merge (version control),Spectrum analyzer
Conference
ISSN
ISBN
Citations 
2159-1962
978-1-4673-9595-3
0
PageRank 
References 
Authors
0.34
5
6
Name
Order
Citations
PageRank
Kazuhide Yamamoto120739.66
Yuki Miyanishi200.34
Takahashi, K.301.69
Yoshiki Inomata400.34
Yuki Mikami500.34
Yuta Sudo600.34