Title
Artificial Bee Colony training of neural networks: comparison with back-propagation.
Abstract
The Artificial Bee Colony (ABC) is a swarm intelligence algorithm for optimization that has previously been applied to the training of neural networks. This paper examines more carefully the performance of the ABC algorithm for optimizing the connection weights of feed-forward neural networks for classification tasks, and presents a more rigorous comparison with the traditional Back-Propagation (BP) training algorithm. The empirical results for benchmark problems demonstrate that using the standard “stopping early” approach with optimized learning parameters leads to improved BP performance over the previous comparative study, and that a simple variation of the ABC approach provides improved ABC performance too. With both improvements applied, the ABC approach does perform very well on small problems, but the generalization performances achieved are only significantly better than standard BP on one out of six datasets, and the training times increase rapidly as the size of the problem grows. If different, evolutionary optimized, BP learning rates are allowed for the two layers of the neural network, BP is significantly better than the ABC on two of the six datasets, and not significantly different on the other four.
Year
DOI
Venue
2014
10.1007/s12293-014-0137-7
Memetic Computing
Keywords
Field
DocType
Artificial Bee Colony, Neural networks, Learning, Evolution
Ping (video games),Swarm intelligence,Artificial intelligence,Artificial neural network,Backpropagation,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
6
3
1865-9292
Citations 
PageRank 
References 
5
0.45
11
Authors
2
Name
Order
Citations
PageRank
John A. Bullinaria139846.22
Khulood AlYahya2195.17