Name
Abstract | ||
|---|---|---|
We present a novel family of language model (LM) estimation techniques named Sparse Non-negative Matrix (SNM) estimation.A first set of experiments empirically evaluating these techniques on the One Billion Word Benchmark [3] shows that with skip-gram features SNMLMs are able to match the state-of-the-art recurrent neural network (RNN) LMs; combining the two modeling techniques yields the best known result on the benchmark.The computational advantages of SNM over both maximum entropy and RNNLM estimation are probably its main strength, promising an approach that has the same flexibility in combining arbitrary features effectively and yet should scale to very large amounts of data as gracefully as n-gram LMs do. |
Year | Venue | Keywords |
|---|---|---|
2015 | 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5 | sparse non-negative matrix, language modeling, skip-grams |
Field | DocType | Citations |
Computer science,Matrix (mathematics),Speech recognition,Natural language processing,Artificial intelligence,Language model | Conference | 7 |
PageRank | References | Authors |
0.51 | 3 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Noam Shazeer | 1 | 1089 | 43.70 |
| Joris Pelemans | 2 | 20 | 5.53 |
| Ciprian Chelba | 3 | 1055 | 111.19 |