Title
Policy-Based and QoE-Aware Content Delivery Using Q-Learning Method
Abstract
With the increasing popularity of various video services, video content is becoming a dominant traffic type in mobile networks. This poses a serious challenge to mobile network operators as well as service providers when it comes to delivering video content in a controllable and resource-efficient way to multiple users. Meeting various quality of experience and quality of service requirements is a difficult task especially in a wireless environment where several different priority based user classes can be included. This paper proposes an intelligent and context-aware application level fair scheduler, which is based on reinforcement learning and which can dynamically adjust relevant scheduling parameters in reaction to specific events or context information. The implemented Q-learning method is analyzed with reference to the delivery of progressive video streaming services employed by the likes of YouTube, Daily Motion, etc. In this regard, we study the performance observed by the end users in a scenario where the backhaul link in a mobile network infrastructure may become congested. Using the application level scheduler to intelligently orchestrate between multiple concurrent flows will minimize the number of buffer starvation events and thus enable smooth playback in cases where a pure TCP based delivery would fail. We also demonstrate the effectiveness of the Q-learning based scheduler to provide service separation between the user classes and fairness within a user class.
Year
DOI
Venue
2015
10.1007/s11277-015-2395-1
Wireless Personal Communications
Keywords
Field
DocType
Reinforcement learning,Q-learning,QoE-aware content delivery,Application level scheduling,Video content delivery
Best-effort delivery,End user,Scheduling (computing),Computer science,Computer network,Q-learning,Quality of service,Service provider,Real-time computing,Cellular network,Quality of experience,Multimedia
Journal
Volume
Issue
ISSN
83
1
0929-6212
Citations 
PageRank 
References 
2
0.38
13
Authors
4
Name
Order
Citations
PageRank
Olli Mämmelä1283.56
Faqir Zarrar Yousaf219220.10
Petteri Mannersalo323418.96
Johannes Lessmann413414.73