Title
A BERT-Based Two-Stage Model for Chinese Chengyu Recommendation
Abstract
AbstractIn Chinese, Chengyu are fixed phrases consisting of four characters. As a type of idioms, their meanings usually cannot be derived from their component characters. In this article, we study the task of recommending a Chengyu given a textual context. Observing some of the limitations with existing work, we propose a two-stage model, where during the first stage we re-train a Chinese BERT model by masking out Chengyu from a large Chinese corpus with a wide coverage of Chengyu. During the second stage, we fine-tune the re-trained, Chengyu-oriented BERT on a specific Chengyu recommendation dataset. We evaluate this method on ChID and CCT datasets and find that it can achieve the state of the art on both datasets. Ablation studies show that both stages of training are critical for the performance gain.
Year
DOI
Venue
2021
10.1145/3453185
ACM Transactions on Asian and Low-Resource Language Information Processing
Keywords
DocType
Volume
Question answering, Chengyu recommendation, idiom understanding
Journal
20
Issue
ISSN
Citations 
6
2375-4699
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Minghuan Tan102.03
Jing Jiang23843191.63
Bingtian Dai300.34