Title
Twiage: a game for finding good advice on twitter
Abstract
Millions of recommendations, opinions and experiences are shared across popular microblogging platforms and services each day. Yet much of this content becomes quickly lost in the stream shortly after being posted. This paper looks at the feasibility of identifying useful content in microblog streams so that it might be archived to facilitate wider access and reference. Towards this goal, we present an experiment with a game-with-a-purpose called Twiage that we designed to determine how well the deluge of content in "raw" microblog streams could be turned into filtered and ranked collections using ratings from players. Experiments with Twiage validate the feasibility of applying human-computation to this problem, finding strong agreement about what constitutes the "most useful" content in our test dataset. Second, we compare the effectiveness of various methods of eliciting such ratings, finding that a "choose-best" interface and Elo rating ranking scheme yield the greatest agreement in the fewest rounds. External validation of resulting top-rated twitter content with a domain expert found that while the top Twiage-ranked "tweets" were among the best of the set, there was a tendency for players to also select what we term "weak spam" - e.g., promotional content disguised as articles or reviews, indicating a need for more stringent content filtering.
Year
DOI
Venue
2012
10.1145/2207676.2208530
CHI
Keywords
Field
DocType
strong agreement,twiage validate,greatest agreement,microblog stream,elo rating,promotional content,domain expert,top-rated twitter content,good advice,useful content,stringent content,microblogs,external validity,crowdsourcing
World Wide Web,Content filtering,Social media,Ranking,Crowdsourcing,Computer science,Subject-matter expert,Microblogging,Human computation
Conference
Citations 
PageRank 
References 
5
0.67
16
Authors
4
Name
Order
Citations
PageRank
Max Van Kleek154258.95
Daniel Alexander Smith2182.63
Ruben Stranders322912.28
M. C. Schraefel4116085.15