Title
DialDoc 2022 Shared Task: Open-Book Document-grounded Dialogue Modeling
Abstract
The paper presents the results of the Shared Task hosted by the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering co-located at ACL 2022. The primary goal of this Shared Task is to build goal-oriented information-seeking conversation systems that are grounded in the domain documents, where each dialogue could correspond to multiple sub-goals that are based on different documents. The task is to generate agent responses in natural language given the dialogue and document contexts. There are two task settings and leader-boards based on (1) the same sets of domains (SEEN) and (2) one unseen domain (UNSEEN). There are over 20 teams participating in Dev Phase and 8 teams participating in both Dev and Test Phases. There are multiple submissions that significantly outperform the baseline. The best-performing system achieves 52.06 F1 and the total of 191.30 on the SEEN task; and 34.65 F1 and the total of 130.79 on the UNSEEN task.
Year
DOI
Venue
2022
10.18653/v1/2022.dialdoc-1.18
PROCEEDINGS OF THE SECOND DIALDOC WORKSHOP ON DOCUMENT-GROUNDED DIALOGUE AND CONVERSATIONAL QUESTION ANSWERING (DIALDOC 2022)
DocType
Volume
Citations 
Conference
Proceedings of the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Song Feng128019.55
Siva Patel200.34
Hui Wan300.34