Title | ||
---|---|---|
Chinese Language Processing Based on Stroke Representation and Multidimensional Representation. |
Abstract | ||
---|---|---|
With the development of deep learning and artificial intelligence, deep neural networks are increasingly being applied for natural language processing tasks. However, the majority of research on natural language processing focuses on alphabetic languages. Few studies have paid attention to the characteristics of ideographic languages, such as the Chinese language. In addition, the existing Chinese processing algorithms typically regard Chinese words or Chinese characters as the basic units while ignoring the information contained within the deeper architecture of Chinese characters. In the Chinese language, each Chinese character can be split into several components, or strokes. This means that strokes are the basic units of a Chinese character, in a manner similar to the letters of an English word. Inspired by the success of character-level neural networks, we delve deeper into Chinese writing at the stroke level for Chinese language processing. We extract the basic features of strokes by considering similar Chinese characters to learn a continuous representation of Chinese characters. Furthermore, word embeddings trained at different granularities are not exactly the same. In this paper, we propose an algorithm for combining different representations of Chinese words within a single neural network to obtain a better word representation. We develop a Chinese word representation service for several natural language processing tasks, and cloud computing is introduced to deal with preprocessing challenges and the training of basic representations from different dimensions. |
Year | DOI | Venue |
---|---|---|
2018 | 10.1109/ACCESS.2018.2860058 | IEEE ACCESS |
Keywords | Field | DocType |
Chinese word representation,stroke-based word representation,multidimensional word representation,convolutional neural networks,natural language processing,word similarity,text classification,automatic text summarization | Chinese characters,Word representation,Architecture,Task analysis,Computer science,Preprocessor,Natural language processing,Artificial intelligence,Deep learning,Artificial neural network,Distributed computing,Cloud computing | Journal |
Volume | ISSN | Citations |
6 | 2169-3536 | 0 |
PageRank | References | Authors |
0.34 | 0 | 6 |
Name | Order | Citations | PageRank |
---|---|---|---|
Hang Zhuang | 1 | 26 | 6.54 |
Chao Wang | 2 | 372 | 62.24 |
Changlong Li | 3 | 26 | 6.88 |
Yijing Li | 4 | 28 | 8.30 |
Qingfeng Wang | 5 | 18 | 7.53 |
Xuehai Zhou | 6 | 551 | 77.54 |