Title
Sequential Advertising Agent with Interpretable User Hidden Intents
Abstract
Online advertising campaigns are typically launched for a customer across multiple touch points (scenarios) before the conversion of his final purchase. To maximize the advertisers' revenue, it requires the platform to develop its advertising strategy based on the consumers' behavioral trajectories in the previous scenarios. Meanwhile, it is also critical to maintain the interpretability of the models on the conversion rate; however, modern reinforcement learning based solutions fail to do so due to their black-box modeling on the consumer intents. In this paper, we model consumer's purchase intention as a latent variable, and formulate the advertising problem as a partially observed Markov Decision Process (POMDP). We incorporate the expectation maximization (EM) algorithms for solving the optimal POMDP. Our extensive experiments based on large-scale real-world data demonstrate that our method provides superior performance over several baselines. Apart from the improved advertising performance, our method is able to offer interpretation on the attribution of the conversion.
Year
DOI
Venue
2020
10.5555/3398761.3399043
AAMAS '19: International Conference on Autonomous Agents and Multiagent Systems Auckland New Zealand May, 2020
DocType
ISBN
Citations 
Conference
978-1-4503-7518-4
0
PageRank 
References 
Authors
0.34
0
13
Name
Order
Citations
PageRank
Zhaoqing Peng101.01
junqi jin21187.95
Lan Luo361.19
Yaodong Yang44111.92
Rui Luo5293.78
Jun Wang62514138.37
Weinan Zhang7122897.24
Xu Miao811.70
Chuan Yu975.46
Tiejian Luo1012026.96
Han Li111276.98
Jian Xu1202.03
Kun Gai1331220.61