Title
The Genia Event and Protein Coreference tasks of the BioNLP Shared Task 2011.
Abstract
The Genia task, when it was introduced in 2009, was the first community-wide effort to address a fine-grained, structural information extraction from biomedical literature. Arranged for the second time as one of the main tasks of BioNLP Shared Task 2011, it aimed to measure the progress of the community since 2009, and to evaluate generalization of the technology to full text papers. The Protein Coreference task was arranged as one of the supporting tasks, motivated from one of the lessons of the 2009 task that the abundance of coreference structures in natural language text hinders further improvement with the Genia task.The Genia task received final submissions from 15 teams. The results show that the community has made a significant progress, marking 74% of the best F-score in extracting bio-molecular events of simple structure, e.g., gene expressions, and 45% ~ 48% in extracting those of complex structure, e.g., regulations. The Protein Coreference task received 6 final submissions. The results show that the coreference resolution performance in biomedical domain is lagging behind that in newswire domain, cf. 50% vs. 66% in MUC score. Particularly, in terms of protein coreference resolution the best system achieved 34% in F-score.Detailed analysis performed on the results improves our insight into the problem and suggests the directions for further improvements.
Year
DOI
Venue
2012
10.1186/1471-2105-13-S11-S1
BMC Bioinformatics
Keywords
Field
DocType
proteins,bioinformatics,algorithms,information systems,gene expression,microarrays,natural language processing
Information system,Coreference,Information retrieval,Computer science,Information extraction,Natural language,Biomedical text mining,Artificial intelligence,Natural language processing,Bioinformatics
Journal
Volume
Issue
ISSN
13 Suppl 11
S-11
1471-2105
Citations 
PageRank 
References 
41
1.12
30
Authors
6
Name
Order
Citations
PageRank
Jin-Dong Kim1170592.21
Ngan Nguyen235423.11
Yue Wang3960143.63
Jun'ichi Tsujii43610232.96
Toshihisa Takagi5858102.84
Akinori Yonezawa61613226.97