Name
Title | ||
|---|---|---|
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues Using BERT. |
Abstract | ||
|---|---|---|
This paper presents an automatic method to evaluate the naturalness of natural language generation in dialogue systems. While this task was previously rendered through expensive and time-consuming human labor, we present this novel task of automatic naturalness evaluation of generated language. By fine-tuning the BERT model, our proposed naturalness evaluation method shows robust results and outperforms the baselines: support vector machines, bi-directional LSTMs, and BLEURT. In addition, the training speed and evaluation performance of naturalness model are improved by transfer learning from quality and informativeness linguistic knowledge. |
Year | Venue | DocType |
|---|---|---|
2021 | RANLP | Conference |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ye Liu | 1 | 9 | 10.07 |
| Wolfgang Maier | 2 | 2 | 2.41 |
| Wolfgang Minker | 3 | 619 | 108.61 |
| Stefan Ultes | 4 | 175 | 28.36 |