Title
Online learning adaptation strategy for DASH clients
Abstract
In this work, we propose an online adaptation logic for Dynamic Adaptive Streaming over HTTP (DASH) clients, where each client selects the representation that maximize the long term expected reward. The latter is defined as a combination of the decoded quality, the quality fluctuations and the rebuffering events experienced by the user during the playback. To solve this problem, we cast a Markov Decision Process (MDP) optimization for the selection of the optimal representations. System dynamics required in the MDP model are a priori unknown and are therefore learned through a Reinforcement Learning (RL) technique. The developed learning process exploits a parallel learning technique that improves the learning rate and limits sub-optimal choices, leading to a fast and yet accurate learning process that quickly converges to high and stable rewards. Therefore, the efficiency of our controller is not sacrificed for fast convergence. Simulation results show that our algorithm achieves a higher QoE than existing RL algorithms in the literature as well as heuristic solutions, as it is able to increase average QoE and reduce quality fluctuations.
Year
DOI
Venue
2016
10.1145/2910017.2910603
MMSys'16: Multimedia Systems Conference 2016 Klagenfurt Austria May, 2016
Keywords
Field
DocType
DASH, bitrate adaptation, reinforcement learning
Convergence (routing),Heuristic,Control theory,Computer science,A priori and a posteriori,Markov decision process,Dynamic Adaptive Streaming over HTTP,Artificial intelligence,System dynamics,Machine learning,Reinforcement learning
Conference
ISBN
Citations 
PageRank 
978-1-4503-4297-1
19
0.80
References 
Authors
13
4
Name
Order
Citations
PageRank
Federico Chiariotti18812.75
Stefano D'Aronco2201.50
Laura Toni3322.03
Pascal Frossard4193.50