Title
Sequential Prediction Over Hierarchical Structures.
Abstract
We study sequential compound decision problems in the context of sequential prediction of real valued sequences. In particular, we consider finite state (FS) predictors that are constructed based on a hierarchical structure, such as the order preserving patterns of the sequence history. We define hierarchical equivalence classes by tying certain models at a hierarchy level in a recursive manner in order to mitigate undertraining problems. These equivalence classes defined on a hierarchical structure are then used to construct a super exponential number of sequential FS predictors based on their combinations and permutations. We then introduce truly sequential algorithms with computational complexity only linear in the pattern length that $1)$ asymptotically achieve the performance of the best FS predictor or the best linear combination of all the FS predictors in an individual sequence manner without any stochastic assumptions over any data length $n$ under a wide range of loss functions; $2)$ achieve the mean square error of the best linear combination of all FS filters or predictors in the steady-state for certain nonstationary models. We illustrate the superior convergence and tracking capabilities of our algorithm with respect to several state-of-the-art methods in the literature through simulations over synthetic and real benchmark data.
Year
DOI
Venue
2016
10.1109/TSP.2016.2607141
IEEE Trans. Signal Processing
Keywords
Field
DocType
Signal processing algorithms,Prediction algorithms,Context,Data models,Market research,Predictive models,Training
Convergence (routing),Linear combination,Data modeling,Decision problem,Mathematical optimization,Permutation,Mean squared error,Equivalence class,Mathematics,Computational complexity theory
Journal
Volume
Issue
ISSN
64
23
1053-587X
Citations 
PageRank 
References 
0
0.34
31
Authors
5
Name
Order
Citations
PageRank
N. Denizcan Vanli1368.13
Kaan Gokcesu285.26
Muhammed O. Sayin33914.04
Hikmet Yildiz442.84
Suleyman Serdar Kozat512131.32