Title
Designing States, Actions, and Rewards for Using POMDP in Session Search.
Abstract
Session search is an information retrieval task that involves a sequence of queries for a complex information need. It is characterized by rich user-system interactions and temporal dependency between queries and between consecutive user behaviors. Recent efforts have been made in modeling session search using the Partially Observable Markov Decision Process (POMDP). To best utilize the POMDP model, it is crucial to find suitable definitions for its fundamental elements – States, Actions and Rewards. This paper investigates the best ways to design the states, actions, and rewards within a POMDP framework. We lay out available design options of these major components based on a variety of related work and experiment on combinations of these options over the TREC 2012 u0026 2013 Session datasets. We report our findings based on two evaluation aspects, retrieval accuracy and efficiency, and recommend practical design choices for using POMDP in session search.
Year
DOI
Venue
2015
10.1007/978-3-319-16354-3_58
ECIR
Field
DocType
Citations 
Information needs,Information retrieval,Computer science,Partially observable Markov decision process,Session search
Conference
4
PageRank 
References 
Authors
0.39
14
4
Name
Order
Citations
PageRank
Jiyun Luo1374.94
Sicong Zhang253.11
Xuchu Dong3141.61
Hui Yang4474.56