Paper Info
Title
Video BenchLab: an open platform for realistic benchmarking of streaming media workloads
Abstract
In this paper, we present an open, flexible and realistic benchmarking platform named Video BenchLab to measure the performance of streaming media workloads. While Video BenchLab can be used with any existing media server, we provide a set of tools for researchers to experiment with their own platform and protocols. The components include a MediaDrop video server, a suite of tools to bulk insert videos and generate streaming media workloads, a dataset of freely available video and a client runtime to replay videos in the native video players of real Web browsers such as Firefox, Chrome and Internet Explorer. We define simple metrics that are able to capture the quality of video playback and identify issues that can happen during video replay. Finally, we provide a Dashboard to manage experiments, collect results and perform analytics to compare performance between experiments. We present a series of experiments with Video BenchLab to illustrate how the video specific metrics can be used to measure the user perceived experience in real browsers when streaming videos. We also show Internet scale experiments by deploying clients in data centers distributed all over the globe. All the software, datasets, workloads and results used in this paper are made freely available on SourceForge for anyone to reuse and expand.
Year
DOI
Venue
2015
10.1145/2713168.2723145
MMSys
Keywords
Field
DocType
streaming,experimentation,benchmarking,web browsers,measurement,testing tools,video,performance measures,performance
Video server,Open platform,Suite,Reuse,Computer science,Software,Analytics,Multimedia,Benchmarking,The Internet
Conference
Citations 
PageRank 
References 
2
0.44
15
Authors
3
Name
Order
Citations
PageRank
Patrick Pegus II140.83
Emmanuel Cecchet283251.56
Prashant J. Shenoy36386521.30