Title
Pragmatic evaluation of folksonomies
Abstract
Recently, a number of algorithms have been proposed to obtain hierarchical structures - so-called folksonomies - from social tagging data. Work on these algorithms is in part driven by a belief that folksonomies are useful for tasks such as: (a) Navigating social tagging systems and (b) Acquiring semantic relationships between tags. While the promises and pitfalls of the latter have been studied to some extent, we know very little about the extent to which folksonomies are pragmatically useful for navigating social tagging systems. This paper sets out to address this gap by presenting and applying a pragmatic framework for evaluating folksonomies. We model exploratory navigation of a tagging system as decentralized search on a network of tags. Evaluation is based on the fact that the performance of a decentralized search algorithm depends on the quality of the background knowledge used. The key idea of our approach is to use hierarchical structures learned by folksonomy algorithm as background knowledge for decentralized search. Utilizing decentralized search on tag networks in combination with different folksonomies as hierarchical background knowledge allows us to evaluate navigational tasks in social tagging systems. Our experiments with four state-of-the-art folksonomy algorithms on five different social tagging datasets reveal that existing folksonomy algorithms exhibit significant, previously undiscovered, differences with regard to their utility for navigation. Our results are relevant for engineers aiming to improve navigability of social tagging systems and for scientists aiming to evaluate different folksonomy algorithms from a pragmatic perspective.
Year
DOI
Venue
2011
10.1145/1963405.1963465
WWW
Keywords
Field
DocType
so-called folksonomies,decentralized search,folksonomy algorithms exhibit,pragmatic evaluation,social tagging system,evaluation,tagging system,different folksonomies,navigation,different social tagging datasets,hierarchical structure,social tagging data,folksonomies,search algorithm
Data mining,World Wide Web,Search algorithm,Information retrieval,Computer science,Navigability,Folksonomy,Artificial intelligence,Machine learning,Tag system
Conference
Citations 
PageRank 
References 
23
1.05
21
Authors
5
Name
Order
Citations
PageRank
Denis Helic127837.16
Markus Strohmaier21210102.65
Christoph Trattner346644.79
Markus Muhr4745.53
Kristina Lerman52840217.86