Name
Title | ||
|---|---|---|
A new Neural Network pruning method based on the singular value decomposition and the weight initialisation |
Abstract | ||
|---|---|---|
In this paper, we present an efficient procedure to determine the optimal hidden unit number of a feed-forward multi-layer Neural Network (NN) using the singular value decomposition (SVD) taking into account the function to be approximated by the NN and the initial values of the updating weights. The SVD is used to identify and eliminate redundant hidden nodes. Minimizing redundancy gives smaller networks, producing models that generalize better and thus eliminate the need of using cross-validation to avoid overfitting. Using this procedure we obtain a final model with fewer adjustable parameters and more accurate predictions than a network model with a fixed, a priori determined, size. We show these performances by applying this procedure to several problems such as function approximation and image recognition. |
Year | Venue | Keywords |
|---|---|---|
2002 | Toulouse | multilayer perceptrons,singular value decomposition,nn,svd,feedforward multilayer neural network,function approximation,image recognition,neural network pruning method,weight initialisation,nn size,singular value decomposition (svd),multi-layer neural network (nn),redundant neuron |
Field | DocType | ISSN |
Singular value decomposition,Function approximation,Pattern recognition,A priori and a posteriori,Redundancy (engineering),Artificial intelligence,Overfitting,Artificial neural network,Mathematics,Network model,Pruning | Conference | 2219-5491 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sabeur Abid | 1 | 15 | 3.16 |
| Farhat Fnaiech | 2 | 209 | 24.97 |
| Mohamed Najim | 3 | 149 | 32.29 |