Title
Understanding and Modeling Success in Email Search
Abstract
Email has been a dominant form of communication for many years, and email search is an important problem. In contrast to other search setting, such as web search, there have been few studies of user behavior and models of email search success. Research in email search is challenging for many reasons including the personal and private nature of the collection. Third party judges can not look at email search queries or email message content requiring new modeling techniques. In this study, we built an opt-in client application which monitors a user's email search activity and then pops up an in-situ survey when a search session is finished. We then merged the survey data with server-side behavioral logs. This approach allows us to study the relationship between session-level outcome and user behavior, and then build a model to predict success for email search based on behavioral interaction patterns. Our results show that generative models (MarkovChain) of success can predict the session-level success of email search better than baseline heuristics and discriminative models (RandomForest). The success model makes use of email-specific log activities such as reply, forward and move, as well as generic signals such as click with long dwell time. The learned model is highly interpretable, and reusable in that it can be applied to unlabeled interaction logs in the future.
Year
DOI
Venue
2017
10.1145/3077136.3080837
SIGIR
Field
DocType
ISBN
Data mining,Survey data collection,World Wide Web,HTML email,Email search,Information retrieval,Computer science,Third party,Heuristics,Generative grammar,Discriminative model
Conference
978-1-4503-5022-8
Citations 
PageRank 
References 
3
0.39
5
Authors
5
Name
Order
Citations
PageRank
Jinyoung Kim11085.56
Nick Craswell23942279.60
Susan Dumais3139482130.47
Filip Radlinski42644122.55
Fang Liu58720.09