Title
Text sparsification via local maxima
Abstract
In this paper we investigate some properties and algorithms related to a text sparsification technique based on the identification of local maxima in the given string. As the number of local maxima depends on the order assigned to the alphabet symbols, we first consider the case in which the order can be chosen in an arbitrary way. We show that looking for an order that minimizes the number of local maxima in the given text string is an NP-hard problem. Then, we consider the case in which the order is fixed a priori. Even though the order is not necessarily optimal, we can exploit the property that the average number of local maxima induced by the order in an arbitrary text is approximately one third of the text length. In particular, we describe how to iterate the process of selecting the local maxima by one or more iterations, so as to obtain a sparsified text. We show how to use this technique to filter the access to unstructured texts, which appear to have no natural division in words. Finally, we experimentally show that our approach can be successfully used in order to create a space efficient index for searching sufficiently long patterns in a DNA sequence as quickly as a full index.
Year
DOI
Venue
2003
10.1016/S0304-3975(03)00142-7
Theoretical Computer Science
Keywords
Field
DocType
Computational complexity,sparsified text,space efficient index,text sparsification technique,text string,local maximum,String algorithms,Pattern matching,Text indexing data structures,full index,arbitrary text,NP-completeness,text length,average number,unstructured text
Combinatorics,Local optimum,Computer science,Algorithm,Maxima and minima,Combinatorial optimization,Time complexity,Lossless compression,Alphabet
Journal
Volume
Issue
ISSN
304
1-3
Theoretical Computer Science
ISBN
Citations 
PageRank 
3-540-41413-4
1
0.39
References 
Authors
11
6
Name
Order
Citations
PageRank
Pierluigi Crescenzi1100295.31
Alberto Del Lungo237644.84
Roberto Grossi358157.47
Elena Lodi415416.21
Linda Pagli540147.56
Gianluca Rossi623521.60