Title
Benchmarking domain-specific expert search using workshop program committees
Abstract
Traditionally, relevance assessments for expert search have been gathered through self-assessment or based on the opinions of co-workers. We introduce three benchmark datasets for expert search that use conference workshops for relevance assessment. Our data sets cover entire research domains as opposed to single institutions. In addition, they provide a larger number of topic-person associations and allow a more objective and fine-grained evaluation of expertise than existing data sets do. We present and discuss baseline results for a language modelling and a topic-centric approach to expert search. We find that the topic-centric approach achieves the best results on domain-specific datasets.
Year
DOI
Venue
2013
10.1145/2508497.2508501
CompSci@CIKM
Keywords
Field
DocType
baseline result,workshop program committee,fine-grained evaluation,expert search,benchmark datasets,best result,topic-centric approach,domain-specific expert search,entire research,relevance assessment,domain-specific datasets,benchmark
Data science,Data mining,Data set,Information retrieval,Computer science,Language modelling,Benchmarking
Conference
Citations 
PageRank 
References 
3
0.39
15
Authors
3
Name
Order
Citations
PageRank
Georgeta Bordea1788.12
Toine Bogers237035.89
Paul Buitelaar3994121.79