Title | ||
---|---|---|
FBK: machine translation evaluation and word similarity metrics for semantic textual similarity |
Abstract | ||
---|---|---|
This paper describes the participation of FBK in the Semantic Textual Similarity (STS) task organized within Semeval 2012. Our approach explores lexical, syntactic and semantic machine translation evaluation metrics combined with distributional and knowledge-based word similarity metrics. Our best model achieves 60.77% correlation with human judgements (Mean score) and ranked 20 out of 88 submitted runs in the Mean ranking, where the average correlation across all the sub-portions of the test set is considered. |
Year | Venue | Keywords |
---|---|---|
2012 | SemEval@NAACL-HLT | best model,semantic machine translation evaluation,semantic textual similarity,mean ranking,mean score,test set,average correlation,knowledge-based word similarity metrics,human judgement |
Field | DocType | Citations |
Semantic similarity,SemEval,Ranking,Information retrieval,Computer science,Machine translation,Correlation,Natural language processing,Artificial intelligence,Syntax,Test set | Conference | 3 |
PageRank | References | Authors |
0.43 | 25 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
José G. C. de Souza | 1 | 76 | 7.41 |
Matteo Negri | 2 | 775 | 82.49 |
Yashar Mehdad | 3 | 514 | 32.04 |