Title
DialCrowd 2.0: A Quality-Focused Dialog System Crowdsourcing Toolkit.
Abstract
Dialog system developers need high-quality data to train, fine-tune and assess their systems. They often use crowdsourcing for this since it provides large quantities of data from many workers. However, the data may not be of sufficiently good quality. This can be due to the way that the requester presents a task and how they interact with the workers. This paper introduces DialCrowd 2.0 to help requesters obtain higher quality data by, for example, presenting tasks more clearly and facilitating effective communication with workers. DialCrowd 2.0 guides developers in creating improved Human Intelligence Tasks (HITs) and is directly applicable to the workflows used currently by developers and researchers.
Year
Venue
DocType
2022
International Conference on Language Resources and Evaluation (LREC)
Conference
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Jessica Huynh101.01
Ting-Rui Chiang200.34
Jeffrey Bigham300.34
Maxine Eskenazi4979127.53