Title
Parallel multiobjective memetic RBFNNs design and feature selection for function approximation problems
Abstract
The design of radial basis function neural networks (RBFNNs) still remains as a difficult task when they are applied to classification or to regression problems. The difficulty arises when the parameters that define an RBFNN have to be set, these are: the number of RBFs, the position of their centers and the length of their radii. Another issue that has to be faced when applying these models to real world applications is to select the variables that the RBFNN will use as inputs. The literature presents several methodologies to perform these two tasks separately, however, due to the intrinsic parallelism of the genetic algorithms, a parallel implementation will allow the algorithm proposed in this paper to evolve solutions for both problems at the same time. The parallelization of the algorithm not only consists in the evolution of the two problems but in the specialization of the crossover and mutation operators in order to evolve the different elements to be optimized when designing RBFNNs. The subjacent genetic algorithm is the non-sorting dominated genetic algorithm II (NSGA-II) that helps to keep a balance between the size of the network and its approximation accuracy in order to avoid overfitted networks. Another of the novelties of the proposed algorithm is the incorporation of local search algorithms in three stages of the algorithm: initialization of the population, evolution of the individuals and final optimization of the Pareto front. The initialization of the individuals is performed hybridizing clustering techniques with the mutual information (MI) theory to select the input variables. As the experiments will show, the synergy of the different paradigms and techniques combined by the presented algorithm allow to obtain very accurate models using the most significant input variables.
Year
DOI
Venue
2009
10.1016/j.neucom.2008.12.037
Neurocomputing
Keywords
Field
DocType
feature selection,accurate model,significant input variable,different element,different paradigm,input variable,neural networks,genetic algorithm,local search algorithm,parallel multiobjective memetic rbfnns,proposed algorithm,function approximation problem,pareto front,rbfnn,mpi,function approximation,subjacent genetic algorithm,parallel genetic algorithms,rbf,mutual information
Mathematical optimization,Crossover,Feature selection,Function approximation,Computer science,Multi-objective optimization,Artificial intelligence,Local search (optimization),Initialization,Cluster analysis,Genetic algorithm,Machine learning
Journal
Volume
Issue
ISSN
72
16-18
Neurocomputing
Citations 
PageRank 
References 
21
0.78
25
Authors
6
Name
Order
Citations
PageRank
A. Guillén118220.83
H. Pomares272244.28
Jesús González360444.40
I. Rojas41750143.09
O. Valenzuela519611.42
B. Prieto6522.31