Title
On the number of iterations for the matching pursuit algorithm.
Abstract
We address the problem of selecting, from a given dictionary, a subset of predictors whose linear combination provides the best description for the vector of measurements. To this end, we apply the well-known matching pursuit algorithm (MPA). Even if there are theoretical results on the performance of MPA, there is no widely accepted rule for stopping the algorithm. In this work, we focus on stopping rules based on information theoretic criteria (ITC). The key point is to evaluate the degrees of freedom (df) for the model produced at each iteration. This is traditionally done by computing the trace of the hat matrix which maps the data vector to its estimate. We prove some theoretical results concerning the hat matrix. One of them provides an upper bound on the increase of df from the m-th to the (m + 1)-th iteration. Based on the properties of the hat matrix, we propose novel ITC for selecting the number of iterations. All of them are obtained by modifying criteria designed for variable selection in the classical linear model. For assessing the performance of the novel criteria, we conduct a simulation study.
Year
Venue
Keywords
2017
European Signal Processing Conference
Matching pursuit algorithm,hat matrix,projector,information theoretic criteria,number of iterations
Field
DocType
ISSN
Linear combination,Signal processing,Data vector,Mathematical optimization,Feature selection,Linear model,Computer science,Upper and lower bounds,Hat matrix,Algorithm,Matching pursuit algorithms
Conference
2076-1465
Citations 
PageRank 
References 
1
0.39
2
Authors
4
Name
Order
Citations
PageRank
Fangyao Li110.72
Christopher M. Triggs231.19
Bogdan Dumitrescu310722.76
Ciprian Doru Giurcaneanu44312.44