Title
'Beating the news' with EMBERS: forecasting civil unrest using open source indicators
Abstract
We describe the design, implementation, and evaluation of EMBERS, an automated, 24x7 continuous system for forecasting civil unrest across 10 countries of Latin America using open source indicators such as tweets, news sources, blogs, economic indicators, and other data sources. Unlike retrospective studies, EMBERS has been making forecasts into the future since Nov 2012 which have been (and continue to be) evaluated by an independent T&E team (MITRE). Of note, EMBERS has successfully forecast the June 2013 protests in Brazil and Feb 2014 violent protests in Venezuela. We outline the system architecture of EMBERS, individual models that leverage specific data sources, and a fusion and suppression engine that supports trading off specific evaluation criteria. EMBERS also provides an audit trail interface that enables the investigation of why specific predictions were made along with the data utilized for forecasting. Through numerous evaluations, we demonstrate the superiority of EMBERS over baserate methods and its capability to forecast significant societal happenings.
Year
DOI
Venue
2014
10.1145/2623330.2623373
KDD
Keywords
DocType
Volume
civil unrest,data mining,event forecasting,open source indicators
Journal
abs/1402.7035
Citations 
PageRank 
References 
68
2.21
9
Authors
30
Name
Order
Citations
PageRank
Naren Ramakrishnan11913176.25
Patrick Butler217311.71
Sathappan Muthiah31117.80
Nathan Self41019.65
Rupinder Khandpur5702.63
Parang Saraf615511.98
Wei Wang7913.72
Jose Cadena8987.53
Anil Kumar S. Vullikanti9113598.30
Gizem Korkmaz109811.10
Chris J. Kuhlman1121625.03
Achla Marathe1220323.77
Liang Zhao1338654.50
Ting Hua141025.59
Feng Chen1545148.47
Chang-Tien Lu161097115.77
Bert Huang1756339.09
Aravind Srinivasan183531291.42
Khoa Trinh191026.32
Lise Getoor204365320.21
Graham Katz2158941.68
Andy Doyle22682.21
Chris Ackermann231074.60
Ilya Zavorin24763.54
Jim Ford25682.21
Kristen Summers261025.98
Youssef Fayed27682.21
Jaime Arredondo281014.60
Dipak Gupta29702.63
David Mares30862.95