Title
Evaluating similarity measures for emergent semantics of social tagging
Abstract
Social bookmarking systems are becoming increasingly important data sources for bootstrapping and maintaining Semantic Web applications. Their emergent information structures have become known as folksonomies. A key question for harvesting semantics from these systems is how to extend and adapt traditional notions of similarity to folksonomies, and which measures are best suited for applications such as community detection, navigation support, semantic search, user profiling and ontology learning. Here we build an evaluation framework to compare various general folksonomy-based similarity measures, which are derived from several established information-theoretic, statistical, and practical measures. Our framework deals generally and symmetrically with users, tags, and resources. For evaluation purposes we focus on similarity between tags and between resources and consider different methods to aggregate annotations across users. After comparing the ability of several tag similarity measures to predict user-created tag relations, we provide an external grounding by user-validated semantic proxies based on WordNet and the Open Directory Project. We also investigate the issue of scalability. We find that mutual information with distributional micro-aggregation across users yields the highest accuracy, but is not scalable; per-user projection with collaborative aggregation provides the best scalable approach via incremental computations. The results are consistent across resource and tag similarity.
Year
DOI
Venue
2009
10.1145/1526709.1526796
WWW
Keywords
Field
DocType
social tagging,user-created tag relation,tag similarity measure,emergent semantics,framework deal,mutual information,evaluation framework,evaluation purpose,various general folksonomy-based similarity,emergent information structure,users yield,tag similarity,semantic web,semantic search,web 2 0
Data mining,Semantic Web Stack,Computer science,Semantic Web,Folksonomy,Artificial intelligence,Social Semantic Web,WordNet,Semantic similarity,World Wide Web,Information retrieval,Semantic search,Machine learning,Semantics
Conference
Citations 
PageRank 
References 
160
4.83
39
Authors
6
Search Limit
100160
Name
Order
Citations
PageRank
Benjamin Markines150222.08
Ciro Cattuto2174097.27
Filippo Menczer33874268.67
Dominik Benz450021.61
Andreas Hotho53232210.84
Gerd Stumme64208301.17