Name
Title | ||
|---|---|---|
PCA and Gaussian noise in MLP neural network training improve generalization in problems with small and unbalanced data sets |
Abstract | ||
|---|---|---|
Machine learning approaches have been successfully applied for automatic decision support in several domains. The quality of these systems, however, degrades severely in classification problems with small and unbalanced data sets for knowledge acquisition. Inherent to several real-world problems, data sets with these characteristics are the reality to be tackled by learning algorithms, but the small amount of data affects the classifiers' generalization power while the imbalance in class distribution makes the classifiers biased towards the larger classes. Previous work had addressed these data constraints with the addition of Gaussian noise to the input patterns' variables during the iterative training process of a MultiLayer perceptron (MLP) neural network (NN). This paper improves the quality of such classifier by decorrelating the input variables via a Principal Component Analysis (PCA) transformation of the original input space before applying additive Gaussian noise to each transformed variable for each input pattern. PCA transformation prevents the conflicting effect of adding decorrelated noise to correlated variables, an effect which increases with the noise level. Three public data sets from a well-known benchmark (Proben1) were used to validate the proposed approach. Experimental results indicate that the proposed methodology improves the performance of the previous approach being statistically better than the traditional training method (95% confidence) in further experimental set-ups. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/IJCNN.2011.6033567 | Neural Networks |
Keywords | Field | DocType |
Gaussian noise,knowledge acquisition,learning (artificial intelligence),multilayer perceptrons,pattern classification,principal component analysis,Gaussian noise,MLP neural network training,PCA transformation,automatic decision support,classification problem,data constraint,decorrelated noise,iterative training process,knowledge acquisition,learning algorithm,machine learning,multilayer perceptron neural network,principal component analysis,unbalanced data set | Data mining,Data set,Computer science,Multilayer perceptron,Artificial intelligence,Classifier (linguistics),Artificial neural network,Pattern recognition,Decision support system,Gaussian noise,Knowledge acquisition,Principal component analysis,Machine learning | Conference |
ISSN | ISBN | Citations |
2161-4393 | 978-1-4244-9635-8 | 5 |
PageRank | References | Authors |
0.49 | 13 | 2 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Icamaan B. Viegas da Silva | 1 | 5 | 0.49 |
| Paulo J. L. Adeodato | 2 | 9 | 1.71 |