Title
Vaccine adverse event text mining system for extracting features from vaccine safety reports.
Abstract
Objective To develop and evaluate a text mining system for extracting key clinical features from vaccine adverse event reporting system (VAERS) narratives to aid in the automated review of adverse event reports. Design Based upon clinical significance to VAERS reviewing physicians, we defined the primary (diagnosis and cause of death) and secondary features leg, symptoms) for extraction. We built a novel vaccine adverse event text mining (VaeTM) system based on a semantic text mining strategy. The performance of VaeTM was evaluated using a total of 300 VAERS reports in three sequential evaluations of 100 reports each. Moreover, we evaluated the VaeTM contribution to case classification; an information retrieval-based approach was used for the identification of anaphylaxis cases in a set of reports and was compared with two other methods: a dedicated text classifier and an online tool. Measurements The performance metrics of VaeTM were text mining metrics: recall, precision and F-measure. We also conducted a qualitative difference analysis and calculated sensitivity and specificity for classification of anaphylaxis cases based on the above three approaches. Results VaeTM performed best in extracting diagnosis, second level diagnosis, drug, vaccine, and lot number features (lenient F-measure in the third evaluation: 0.897, 0.817, 0.858, 0.874, and 0.914, respectively). In terms of case classification, high sensitivity was achieved (83.1%), this was equal and better compared to the text classifier (83.1%) and the online tool (40.7%), respectively. Conclusion Our VaeTM implementation of a semantic text mining strategy shows promise in providing accurate and efficient extraction of key features from VAERS narratives.
Year
DOI
Venue
2012
10.1136/amiajnl-2012-000881
JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION
Field
DocType
Volume
Data mining,Adverse Event Reporting System,Text mining,Adverse effect,Health informatics,Classifier (linguistics),Medicine
Journal
19
Issue
ISSN
Citations 
6
1067-5027
9
PageRank 
References 
Authors
0.79
14
6
Name
Order
Citations
PageRank
Taxiarchis Botsis19910.86
Thomas Buttolph290.79
Michael D Nguyen3362.37
Scott Winiecki490.79
Emily Jane Woo5403.55
Robert Ball6424.99