Title
Deep Temporal-Recurrent-Replicated-Softmax for Topical Trends over Time.
Abstract
Dynamic topic modeling facilitates the identification of topical trends over time in temporal collections of unstructured documents. We introduce a novel unsupervised neural dynamic topic model known as Recurrent Neural Network-Replicated Softmax Model (RNNRSM), where the discovered topics at each time influence the topic discovery in the subsequent time steps. We account for the temporal ordering of documents by explicitly modeling a joint distribution of latent topical dependencies over time, using distributional estimators with temporal recurrent connections. Applying RNN-RSM to 19 years of articles on NLP research, we demonstrate that compared to state-of-the art topic models, RNN-RSM shows better generalization, topic interpretation, evolution and trends. We also propose to quantify the capability of dynamic topic model to capture word evolution in topics over time.
Year
Venue
DocType
2018
NAACL-HLT
Conference
Volume
Citations 
PageRank 
abs/1711.05626
1
0.35
References 
Authors
10
4
Name
Order
Citations
PageRank
Pankaj Gupta11479133.85
Subburam Rajaram211.03
Hinrich Schütze32113362.21
Bernt Andrassy4605.78