Title
Active Learning on Pre-trained Language Model with Task-Independent Triplet Loss.
Abstract
Active learning attempts to maximize a task model’s performance gain by obtaining a set of informative samples from an unlabeled data pool. Previous active learning methods usually rely on specific network architectures or task-dependent sample acquisition algorithms. Moreover, when selecting a batch sample, previous works suffer from insufficient diversity of batch samples because they only consider the informativeness of each sample. This paper proposes a task-independent batch acquisition method using triplet loss to distinguish hard samples in an unlabeled data pool with similar features but difficult to identify labels. To assess the effectiveness of the proposed method, we compare the proposed method with state-of-the-art active learning methods on two tasks, relation extraction and sentence classification. Experimental results show that our method outperforms baselines on the benchmark datasets.
Year
Venue
Keywords
2022
AAAI Conference on Artificial Intelligence
Speech & Natural Language Processing (SNLP)
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Seungmin Seo1245.68
Donghyun Kim2289.95
Youbin Ahn300.34
Kyong-Ho Lee443947.52