Name
Title | ||
|---|---|---|
Pseudo-inverse linear discriminants for the improvement of overall classification accuracies. |
Abstract | ||
|---|---|---|
This paper studies the learning and generalization performances of pseudo-inverse linear discriminant (PILDs) based on the processing minimum sum-of-squared error (MS 2 E) and the targeting overall classification accuracy (OCA) criterion functions. There is little practicable significance to prove the equivalency between a PILD with the desired outputs in reverse proportion to the number of class samples and an FLD with the totally projected mean thresholds. When the desired outputs of each class are assigned a fixed value, a PILD is partly equal to an FLD. With the customarily desired outputs {1, -1}, a practicable threshold is acquired, which is only related to sample sizes. If the desired outputs of each sample are changeable, a PILD has nothing in common with an FLD. The optimal threshold may thus be singled out from multiple empirical ones related to sizes and distributed regions. Depending upon the processing MS 2 E criteria and the actually algebraic distances, an iterative learning strategy of PILD is proposed, the outstanding advantages of which are with limited epoch, without learning rate and divergent risk. Enormous experimental results for the benchmark datasets have verified that the iterative PILDs with optimal thresholds have good learning and generalization performances, and even reach the top OCAs for some datasets among the existing classifiers. Relationship between a PILD and an FLD is clarified based on overall accuracy.A PILD is not certainly equivalent to an FLD if the desired outputs are fixed.A PILD has nothing in common with an FLD when the desired outputs are changeable.Accuracies of PILDs are improved by optimal thresholds related to sizes and regions.The iterative learning strategy of PILDs is proposed, realized and verified. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1016/j.neunet.2016.05.006 | Neural Networks |
Keywords | Field | DocType |
Fisher linear discriminants (FLDs),Iterative learning,Overall classification accuracies,Pseudo-inverse linear discriminants (PILDs),Threshold optimization | Algebraic number,Linear model,Moore–Penrose pseudoinverse,Artificial intelligence,Iterative learning control,Linear discriminant analysis,Machine learning,Mathematics,Sample size determination | Journal |
Volume | Issue | ISSN |
81 | C | 0893-6080 |
Citations | PageRank | References |
4 | 0.39 | 32 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Daqi Gao | 1 | 110 | 16.30 |
| Dastagir Ahmed | 2 | 4 | 0.39 |
| Lili Guo | 3 | 11 | 7.94 |
| Wang Zejian | 4 | 4 | 0.73 |
| Zhe Wang | 5 | 19 | 2.48 |