Title
An information-theoretic approach to text searching in direct access systems
Abstract
Using direct access computer files of bibliographic information, an attempt is made to overcome one of the problems often associated with information retrieval, namely, the maintenance and use of large dictionaries, the greater part of which is used only infrequently. A novel method is presented, which maps the hyperbolic frequency distribution of text characteristics onto a rectangular distribution. This is more suited to implementation on storage devices.This method treats text as a string of characters rather than words bounded by spaces, and chooses subsets of strings such that their frequencies of occurrence are more even than those of word types. The members of this subset are then used as index keys for retrieval. The rectangular distribution of key frequencies results in a much simplified file organization and promises considerable cost advantages.
Year
DOI
Venue
1974
10.1145/355616.364034
Commun. ACM
Keywords
Field
DocType
character string,key frequencies result,bibliographic information,text searching,hyperbolic frequency distribution,direct access computer file,information theory,text characteristic,direct access,novel method,information retrieval,rectangular distribution,considerable cost advantage,file organization,direct access system,information-theoretic approach,bit vector,indexation
Information theory,Text searching,Information retrieval,Computer science,Uniform distribution (continuous),Theoretical computer science,Bit array,String (computer science),Bounded function,Computer file
Journal
Volume
Issue
ISSN
17
6
0001-0782
Citations 
PageRank 
References 
21
21.65
9
Authors
4
Name
Order
Citations
PageRank
Ian J. Barton12121.99
Susan E. Creasey22121.65
Michael F. Lynch3461114.63
Michael J. Snell43123.38