Paper Info
Title
Extending the language modeling framework for sentence retrieval to include local context
Abstract
Employing effective methods of sentence retrieval is essential for many tasks in Information Retrieval, such as summarization, novelty detection and question answering. The best performing sentence retrieval techniques attempt to perform matching directly between the sentences and the query. However, in this paper, we posit that the local context of a sentence can provide crucial additional evidence to further improve sentence retrieval. Using a Language Modeling Framework, we propose a novel reformulation of the sentence retrieval problem that extends previous approaches so that the local context is seamlessly incorporated within the retrieval models. In a series of comprehensive experiments, we show that localized smoothing and the prior importance of a sentence can improve retrieval effectiveness. The proposed models significantly and substantially outperform the state of the art and other competitive sentence retrieval baselines on recall-oriented measures, while remaining competitive on precision-oriented measures. This research demonstrates that local context plays an important role in estimating the relevance of a sentence, and that existing sentence retrieval language models can be extended to utilize this evidence effectively.
Year
DOI
Venue
2011
10.1007/s10791-010-9146-4
Inf. Retr.
Keywords
Field
DocType
Information retrieval,Sentence retrieval,Language models,Context
Automatic summarization,Cognitive models of information retrieval,Question answering,Human–computer information retrieval,Information retrieval,Computer science,Natural language processing,Relevance (information retrieval),Artificial intelligence,Term Discrimination,Sentence,Language model
Journal
Volume
Issue
ISSN
14
4
1386-4564
Citations 
PageRank 
References 
14
0.67
28
Authors
3
Name
Order
Citations
PageRank
Ronald T. Fernández1333.78
David E. Losada232640.63
Leif Azzopardi31919133.10