Title
Zero- and Few-Shot NLP with Pretrained Language Models.
Abstract
The ability to efficiently learn from little-to-no data is critical to applying NLP to tasks where data collection is costly or otherwise difficult. This is a challenging setting both academically and practically—particularly because training neutral models typically require large amount of labeled data. More recently, advances in pretraining on unlabelled data have brought up the potential of better zero-shot or few-shot learning (Devlin et al., 2019; Brown et al., 2020). In particular, over the past year, a great deal of research has been conducted to better learn from limited data using large-scale language models. In this tutorial, we aim at bringing interested NLP researchers up to speed about the recent and ongoing techniques for zero- and few-shot learning with pretrained language models. Additionally, our goal is to reveal new research opportunities to the audience, which will hopefully bring us closer to address existing challenges in this domain.
Year
DOI
Venue
2022
10.18653/v1/2022.acl-tutorials.6
Annual Meeting of the Association for Computational Linguistics
DocType
Volume
Citations 
Conference
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Islam Beltagy1738.90
Arman Cohan200.34
Robert L. Logan IV3123.50
Sewon Min4506.78
Sameer Singh5106071.63