Title
Dual Context-Guided Continuous Prompt Tuning for Few-Shot Learning
Abstract
Prompt-based paradigm has shown its competitive performance in many NLP tasks. However, its success heavily depends on prompt design, and the effectiveness varies upon the model and training data. In this paper, we propose a novel dual context-guided continuous prompt (DCCP) tuning method. To explore the rich contextual information in language structure and close the gap between discrete prompt tuning and continuous prompt tuning, DCCP introduces two auxiliary training objectives and constructs input in a pair-wise fashion. Experimental results demonstrate that our method is applicable to many NLP tasks, and can often outperform existing prompt tuning methods by a large margin in the few-shot setting.
Year
DOI
Venue
2022
10.18653/v1/2022.findings-acl.8
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022)
DocType
Volume
Citations 
Conference
Findings of the Association for Computational Linguistics: ACL 2022
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Jie Zhou11311.09
Le Tian200.34
Houjin Yu300.34
Zhou Xiao400.34
Hui Su500.34
Jie Zhou62103190.17