Title
Learning Document Embeddings with Crossword Prediction
Abstract
In this paper, we propose a Document Embedding Network (DEN) to learn document embeddings in an unsupervised manner. Our model uses the encoder-decoder architecture as its backbone, which tries to reconstruct the input document from an encoded document embedding. Unlike the standard decoder for text reconstruction, we randomly block some words in the input document, and use the incomplete context information and the encoded document embedding to predict the blocked words in the document, inspired by the crossword game. Thus, our decoder can keep the balance between the known and unknown information, and consider both global and partial information when decoding the missing words. We evaluate the learned document embeddings on two tasks: document classification and document retrieval. The experimental results show that our model substantially outperforms the compared methods.
Year
DOI
Venue
2019
10.1609/aaai.v33i01.33019993
AAAI
Field
DocType
Volume
Document classification,Architecture,Embedding,Computer science,Natural language processing,Artificial intelligence,Decoding methods,Document retrieval,Machine learning
Conference
33
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Junyu Luo1154.36
Min Yang27720.41
Shen Ying37323.48
Qiang Qu464.18
Haixia Chai500.34