Title
Fully Bayesian tensor-based regression
Abstract
N-way (or multiway) Partial Least Squares (NPLS) regression is a successful algorithm for solving ill-conditioned and high-dimensional problems. However, the selection of the latent space dimensionality, when performed manually, becomes a critical issue in the presence of irrelevant, redundant and noisy information and can lead to overfitting, and when using cross-validation one can still not guarantee a good predictive performance. We propose a fully Bayesian N-way partial least squares regression (BNPLS) with an automatic relevance determination (ARD) prior on the factor matrices so that the number of latent components can be determined automatically without requiring specific assumptions. Using synthetic data, we compare the performance of BNPLS with conventional NPLS, standard partial least squared (PLS) and state-of-the-art higher-order PLS (HOPLS). Results show that BNPLS consistently achieves a better or comparable performance.
Year
DOI
Venue
2016
10.1109/MLSP.2016.7738860
2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP)
Keywords
Field
DocType
Bayesian learning,PLS,multilinear regression,NPLS,tensor-based regression
Convergence (routing),Square (algebra),Regression,Pattern recognition,Computer science,Partial least squares regression,Curse of dimensionality,Synthetic data,Artificial intelligence,Overfitting,Machine learning,Bayesian probability
Conference
ISSN
ISBN
Citations 
2161-0363
978-1-5090-0747-9
0
PageRank 
References 
Authors
0.34
5
2
Name
Order
Citations
PageRank
Flavio Camarrone101.01
Marc M. Van Hulle262269.75