Paper Info
Title
A Space-Efficient Phrase Table Implementation Using Minimal Perfect Hash Functions.
Abstract
We describe the structure of a space-efficient phrase table for phrase-based statistical machine translation with the Moses decoder. The new phrase table can be used in-memory or be partially mapped on-disk. Compared to the standard Moses on-disk phrase table implementation a size reduction by a factor of 6 is achieved. The focus of this work lies on the source phrase index which is implemented using minimal perfect hash functions. Two methods are discussed that reduce the memory consumption of a baseline implementation. Keywords: Statistical machine translation, compact phrase table, minimal perfect hash function, Moses.
Year
DOI
Venue
2012
10.1007/978-3-642-32790-2_39
Lecture Notes in Computer Science
Keywords
Field
DocType
Statistical machine translation,compact phrase table,minimal perfect hash function,Moses
Shallow parsing,Phrase search,Computer science,Machine translation,Phrase,Size reduction,Speech recognition,Genetic programming,Artificial intelligence,Treebank,Natural language processing,Perfect hash function
Conference
Volume
ISSN
Citations 
7499
0302-9743
1
PageRank 
References 
Authors
0.39
9
1
Name
Order
Citations
PageRank
Marcin Junczys-Dowmunt131224.24