Title
Assessing the Lexico-Semantic Relational Knowledge Captured by Word and Concept Embeddings.
Abstract
Deep learning currently dominates the benchmarks for various NLP tasks and, at the basis of such systems, words are frequently represented as embeddings --vectors in a low dimensional space-- learned from large text corpora and various algorithms have been proposed to learn both word and concept embeddings. One of the claimed benefits of such embeddings is that they capture knowledge about semantic relations. Such embeddings are most often evaluated through tasks such as predicting human-rated similarity and analogy which only test a few, often ill-defined, relations. In this paper, we propose a method for (i) reliably generating word and concept pair datasets for a wide number of relations by using a knowledge graph and (ii) evaluating to what extent pre-trained embeddings capture those relations. We evaluate the approach against a proprietary and a public knowledge graph and analyze the results, showing which lexico-semantic relational knowledge is captured by current embedding learning approaches.
Year
DOI
Venue
2019
10.1145/3360901.3364445
K-CAP
Keywords
Field
DocType
embedding evaluation, lexico-semantic relations, knowledge graphs
Information retrieval,Computer science,Lexico
Conference
ISBN
Citations 
PageRank 
978-1-4503-7008-0
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Ronald Denaux115314.39
José Manuél Gómez-Pérez296.77