Title
Local linear regression for function learning: an analysis based on sample discrepancy.
Abstract
Local linear regression models, a kind of nonparametric structures that locally perform a linear estimation of the target function, are analyzed in the context of empirical risk minimization (ERM) for function learning. The analysis is carried out with emphasis on geometric properties of the available data. In particular, the discrepancy of the observation points used both to build the local regression models and compute the empirical risk is considered. This allows to treat indifferently the case in which the samples come from a random external source and the one in which the input space can be freely explored. Both consistency of the ERM procedure and approximating capabilities of the estimator are analyzed, proving conditions to ensure convergence. Since the theoretical analysis shows that the estimation improves as the discrepancy of the observation points becomes smaller, low-discrepancy sequences, a family of sampling methods commonly employed for efficient numerical integration, are also analyzed. Simulation results involving two different examples of function learning are provided.
Year
DOI
Venue
2014
10.1109/TNNLS.2014.2305193
IEEE Trans. Neural Netw. Learning Syst.
Keywords
Field
DocType
empirical risk minimization,sample discrepancy,integration,target function linear estimation,learning (artificial intelligence),regression analysis,low-discrepancy sequences (lds).,discrepancy,local linear regression,risk management,numerical integration,low-discrepancy sequences (lds),random external source,geometric properties,sampling methods,local linear regression model,function learning,nonparametric structures,geometry,observation point discrepancy,erm,efficient sampling,kernel,linear regression,convergence,data models
Discrepancy function,Linear model,Computer science,Empirical risk minimization,Nonparametric regression,Local regression,Proper linear model,Artificial intelligence,Variance function,Linear predictor function,Machine learning
Journal
Volume
Issue
ISSN
25
11
2162-2388
Citations 
PageRank 
References 
3
0.40
7
Authors
2
Name
Order
Citations
PageRank
Cristiano Cervellera122623.63
Danilo Macciò26410.95