Title
An Axiomatic Approach to Regularizing Neural Ranking Models.
Abstract
Axiomatic information retrieval (IR) seeks a set of principle properties desirable in IR models. These properties when formally expressed provide guidance in the search for better relevance estimation functions. Neural ranking models typically contain a large number of parameters. The training of these models involve a search for appropriate parameter values based on large quantities of labeled examples. Intuitively, axioms that can guide the search for better traditional IR models should also help in better parameter estimation for machine learning based rankers. This work explores the use of IR axioms to augment the direct supervision from labeled data for training neural ranking models. We modify the documents in our dataset along the lines of well-known axioms during training and add a regularization loss based on the agreement between the ranking model and the axioms on which version of the document---the original or the perturbed---should be preferred. Our experiments show that the neural ranking model achieves faster convergence and better generalization with axiomatic regularization.
Year
DOI
Venue
2019
10.1145/3331184.3331296
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval
Keywords
Field
DocType
axiomatic information retrieval, learning to rank, neural networks
Convergence (routing),Data mining,Axiomatic system,Ranking,Computer science,Axiom,Regularization (mathematics),Artificial intelligence,Labeled data,Estimation theory,Machine learning
Journal
Volume
ISBN
Citations 
abs/1904.06808
978-1-4503-6172-9
2
PageRank 
References 
Authors
0.37
0
6
Name
Order
Citations
PageRank
Corby Rosset171.14
Bhaskar Mitra244126.26
Chen-Yan Xiong340530.82
Nick Craswell43942279.60
Xia Song5303.19
saurabh tiwary6293.86