Title
The Anatomy of a Search and Mining System for Digital Archives.
Abstract
Samtla (Search And Mining Tools with Linguistic Analysis) is a digital humanities system designed in collaboration with historians and linguists to assist them with their research work in quantifying the content of any textual corpora through approximate phrase search and document comparison. retrieval engine uses a character-based n-gram language model rather than the conventional word-based one so as to achieve great flexibility in language agnostic query processing. The index is implemented as a space-optimised character-based suffix tree with an accompanying database of document content and metadata. A number of text mining tools are integrated into the system to allow researchers to discover textual patterns, perform comparative analysis, and find out what is currently popular in the research community. Herein we describe the system architecture, user interface, models and algorithms, and data storage of the Samtla system. We also present several case studies of its usage in practice together with an evaluation of the systemsu0027 ranking performance through crowdsourcing.
Year
Venue
Field
2016
arXiv: Digital Libraries
Data mining,Phrase search,Crowdsourcing,Computer science,Artificial intelligence,Natural language processing,Suffix tree,Systems architecture,Language model,Metadata,Ranking,Information retrieval,User interface
DocType
Volume
Citations 
Journal
abs/1603.07150
1
PageRank 
References 
Authors
0.35
21
4
Name
Order
Citations
PageRank
Martyn Harris110.35
Mark Levene21272252.84
Dell Zhang3106157.54
Dan Levene411.02