Title | ||
---|---|---|
Assigning appropriate weights for the linear combination data fusion method in information retrieval |
Abstract | ||
---|---|---|
In data fusion, the linear combination method is a very flexible method since different weights can be assigned to different systems. However, it remains an open question which weighting schema should be used. In some previous investigations and experiments, a simple weighting schema was used: for a system, its weight is assigned as its average performance over a group of training queries. However, it is not clear if this weighting schema is good or not. In some other investigations, different numerical optimisation methods were used to search for appropriate weights for the component systems. One major problem with those numerical optimisation methods is their low efficiency. It might not be feasible to use them in some situations, for example in some dynamic environments, system weights need to be updated from time to time for reasonably good performance. In this paper, we investigate the weighting issue by extensive experiments. The key point is to try to find the relation between performances of component systems and their corresponding weights which can lead to good fusion performance. We demonstrate that a series of power functions of average performance, which can be implemented as efficiently as the simple weighting schema, is more effective than the simple weighting schema for the linear data fusion method. Some other features of the power function weighting schema and the linear combination method are also investigated. The observations obtained from this study can be used directly in fusion applications of component retrieval results. The observations are also very useful for optimisation methods to choose better starting points and therefore to obtain more effective weights more quickly. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1016/j.ipm.2009.02.003 | Inf. Process. Manage. |
Keywords | Field | DocType |
different numerical optimisation method,information retrieval,linear combination method,weight assignment,appropriate weight,flexible method,component system,data fusion,weighting schema,linear combination data fusion,average performance,simple weighting schema,the linear combination method,power function weighting schema,weighting issue,power function | Linear combination,Power function,Data mining,Weighting,Computer science,Fusion,Artificial intelligence,Schema (psychology),Component retrieval,Information retrieval,Sensor fusion,Information extraction,Machine learning | Journal |
Volume | Issue | ISSN |
45 | 4 | Information Processing and Management |
Citations | PageRank | References |
16 | 0.67 | 25 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Shengli Wu | 1 | 370 | 33.55 |
Yaxin Bi | 2 | 541 | 47.76 |
Xiaoqin Zeng | 3 | 407 | 32.97 |
Lixin Han | 4 | 135 | 14.47 |