Title
Developing a Dark Web collection and infrastructure for computational and social sciences
Abstract
In recent years, there have been numerous studies from a variety of perspectives analyzing the Internet presence of hate and extremist groups. Yet the websites and forums of extremist and terrorist groups have long remained an underutilized resource for terrorism researchers due to their ephemeral nature and access and analysis problems. The purpose of the Dark Web archive is to provide a research infrastructure for use by social scientists, computer and information scientists, policy and security analysts, and others studying a wide range of social and organizational phenomena and computational problems. The Dark Web Forum Portal provides web enabled access to critical international jihadist and other extremist web forums. The focus of this paper is on the significant extensions to previous work including: increasing the scope of data collection, adding an incremental spidering component for regular data updates; enhancing the searching and browsing functions; enhancing multilingual machine-translation for Arabic, French, German and Russian; and advanced Social Network Analysis. A case study on identifying active participants is shown at the end.
Year
DOI
Venue
2010
10.1109/ISI.2010.5484774
ISI
Keywords
Field
DocType
dark web archive,incremental forum spidering,multilingual translation,social network visualization,internet,terrorism,behavioural sciences,information security,national security,computer security,data collection,social network,social sciences,natural languages,social network analysis,social science,language translation,information analysis,data visualization,machine translation
Data collection,Data mining,World Wide Web,Language translation,Computer science,Computer security,Social network analysis,Terrorism,Information security,Behavioural sciences,Web crawler,The Internet
Conference
ISBN
Citations 
PageRank 
978-1-4244-6444-9
15
0.88
References 
Authors
10
10
Name
Order
Citations
PageRank
Yulei Zhang135025.66
Shuo Zeng2372.94
Chun-Neng Huang31325.55
Li Fan4151.22
Ximing Yu5272.39
Yan Dang620216.06
Catherine A. Larson77710.45
Dorothy E. Denning840961286.85
Nancy Roberts9181.98
Hsinchun Chen109569813.33