Title
Assigning appropriate weights for the linear combination data fusion method in information retrieval
Abstract
In data fusion, the linear combination method is a very flexible method since different weights can be assigned to different systems. However, it remains an open question which weighting schema should be used. In some previous investigations and experiments, a simple weighting schema was used: for a system, its weight is assigned as its average performance over a group of training queries. However, it is not clear if this weighting schema is good or not. In some other investigations, different numerical optimisation methods were used to search for appropriate weights for the component systems. One major problem with those numerical optimisation methods is their low efficiency. It might not be feasible to use them in some situations, for example in some dynamic environments, system weights need to be updated from time to time for reasonably good performance. In this paper, we investigate the weighting issue by extensive experiments. The key point is to try to find the relation between performances of component systems and their corresponding weights which can lead to good fusion performance. We demonstrate that a series of power functions of average performance, which can be implemented as efficiently as the simple weighting schema, is more effective than the simple weighting schema for the linear data fusion method. Some other features of the power function weighting schema and the linear combination method are also investigated. The observations obtained from this study can be used directly in fusion applications of component retrieval results. The observations are also very useful for optimisation methods to choose better starting points and therefore to obtain more effective weights more quickly.
Year
DOI
Venue
2009
10.1016/j.ipm.2009.02.003
Inf. Process. Manage.
Keywords
Field
DocType
different numerical optimisation method,information retrieval,linear combination method,weight assignment,appropriate weight,flexible method,component system,data fusion,weighting schema,linear combination data fusion,average performance,simple weighting schema,the linear combination method,power function weighting schema,weighting issue,power function
Linear combination,Power function,Data mining,Weighting,Computer science,Fusion,Artificial intelligence,Schema (psychology),Component retrieval,Information retrieval,Sensor fusion,Information extraction,Machine learning
Journal
Volume
Issue
ISSN
45
4
Information Processing and Management
Citations 
PageRank 
References 
16
0.67
25
Authors
4
Name
Order
Citations
PageRank
Shengli Wu137033.55
Yaxin Bi254147.76
Xiaoqin Zeng340732.97
Lixin Han413514.47