Title
M4: a visualization-oriented time series data aggregation
Abstract
Visual analysis of high-volume time series data is ubiquitous in many industries, including finance, banking, and discrete manufacturing. Contemporary, RDBMS-based systems for visualization of high-volume time series data have difficulty to cope with the hard latency requirements and high ingestion rates of interactive visualizations. Existing solutions for lowering the volume of time series data disregard the semantics of visualizations and result in visualization errors. In this work, we introduce M4, an aggregation-based time series dimensionality reduction technique that provides error-free visualizations at high data reduction rates. Focusing on line charts, as the predominant form of time series visualization, we explain in detail the drawbacks of existing data reduction techniques and how our approach outperforms state of the art, by respecting the process of line rasterization. We describe how to incorporate aggregation-based dimensionality reduction at the query level in a visualization-driven query rewriting system. Our approach is generic and applicable to any visualization system that uses an RDBMS as data source. Using real world data sets from high tech manufacturing, stock markets, and sports analytics domains we demonstrate that our visualization-oriented data aggregation can reduce data volumes by up to two orders of magnitude, while preserving perfect visualizations.
Year
DOI
Venue
2014
10.14778/2732951.2732953
PVLDB
Keywords
Field
DocType
Relational databases, Query rewriting, Dimensionality reduction, Line rasterization
Time series,Data mining,Data set,Dimensionality reduction,Relational database,Visualization,Computer science,Line chart,Data aggregator,Database,Discrete manufacturing
Journal
Volume
Issue
ISSN
7
10
2150-8097
Citations 
PageRank 
References 
24
1.34
16
Authors
5
Name
Order
Citations
PageRank
Uwe Jugel1847.94
Zbigniew Jerzak230822.62
Gregor Hackenbroich317816.18
Gregor Hackenbroich417816.18
Volker Markl52245182.37