Title
A Two-Level Topic Model Towards Knowledge Discovery from Citation Networks
Abstract
Knowledge discovery from scientific articles has received increasing attention recently since huge repositories are made available by the development of the Internet and digital databases. In a corpus of scientific articles such as a digital library, documents are connected by citations and one document plays two different roles in the corpus: document itself and a citation of other documents. In the existing topic models, little effort is made to differentiate these two roles. We believe that the topic distributions of these two roles are different and related in a certain way. In this paper, we propose a Bernoulli process topic (BPT) model which considers the corpus at two levels: document level and citation level. In the BPT model, each document has two different representations in the latent topic space associated with its roles. Moreover, the multi-level hierarchical structure of citation network is captured by a generative process involving a Bernoulli process. The distribution parameters of the BPT model are estimated by a variational approximation approach. An efficient computation algorithm is proposed to overcome the difficulty of matrix inverse operation. In addition to conducting the experimental evaluations on the document modeling and document clustering tasks, we also apply the BPT model to well known corpora to discover the latent topics, recommend important citations, detect the trends of various research areas in computer science between 1991 and 1998, and to investigate the interactions among the research areas. The comparisons against state-of-the-art methods demonstrate a very promising performance. The implementations and the data sets are available online .
Year
DOI
Venue
2014
10.1109/TKDE.2013.56
IEEE Transactions on Knowledge and Data Engineering
Keywords
Field
DocType
multilevel hierarchical structure,database management systems,citation networks,two-level topic model,approximation theory,internet,variational approximation approach,knowledge discovery,data mining,computer science,digital databases,bpt model,scientific articles,bernoulli process topic model,unsupervised learning,citation analysis,text mining,latent models,data models,probabilistic logic,computational modeling,vectors,context modeling
Data mining,Computer science,Document clustering,Citation,Bernoulli process,Unsupervised learning,Artificial intelligence,Digital library,The Internet,Information retrieval,Knowledge extraction,Topic model,Machine learning
Journal
Volume
Issue
ISSN
26
4
1041-4347
Citations 
PageRank 
References 
9
0.57
14
Authors
5
Name
Order
Citations
PageRank
Zhen Guo190.57
Zhongfei (Mark) Zhang22451164.30
Zhu, Shenghuo32996167.68
Yun Chi4169683.96
yihong gong57300470.57