Paper Info
Title
Is this conference a top-tier? ConfAssist: An assistive conflict resolution framework for conference categorization.
Abstract
Classifying publication venues into top-tier or non-top-tier is quite subjective and can be debatable at times. In this paper, we propose ConfAssist, a novel assisting framework for conference categorization that aims to address the limitations in the existing systems and portals for venue classification. We start with the hypothesis that top-tier conferences are much more stable than other conferences and the inherent dynamics of these groups differs to a very large extent. We identify various features related to the stability of conferences that might help us separate a top-tier conference from the rest of the lot. While there are many clear cases where expert agreement can be almost immediately achieved as to whether a conference is a top-tier or not, there are equally many cases that can result in a conflict even among the experts. ConfAssist tries to serve as an aid in such cases by increasing the confidence of the experts in their decision. An analysis of 110 conferences from 22 sub-fields of computer science clearly favors our hypothesis as the top-tier conferences are found to exhibit much less fluctuations in the stability related features than the non-top-tier ones. We evaluate our hypothesis using systems based on conference categorization. For the evaluation, we conducted human judgment survey with 28 domain experts. The results are impressive with 85.18% classification accuracy. We also compare the dynamics of the newly started conferences with the older conferences to identify the initial signals of popularity. The system is applicable to any conference with atleast 5 years of publication history.
Year
DOI
Venue
2016
10.1016/j.joi.2016.08.001
Journal of Informetrics
Keywords
DocType
Volume
Venue classification,Feature analysis,Conflict resolution,Entropy
Journal
10
Issue
ISSN
Citations 
4
1751-1577
0
PageRank 
References 
Authors
0.34
22
4
Name
Order
Citations
PageRank
Mayank Singh1122.60
Tanmoy Chakraborty246676.71
Animesh Mukherjee339262.78
Pawan Goyal41670210.04