Title
Bayberry segmentation in a complex environment based on a multi-module convolutional neural network
Abstract
Automatic bayberry picking can substantially reduce labor costs and improve picking efficiency in an orchard management system. Nowadays, an automatic picking system mainly relies on machine vision to segment bayberry fruit from the background. Most existing methods are carried out in an environment where the light intensity is relatively fixed and the bayberries are unobstructed. However, due to the complexity of the growing environment, including variations in lighting and widespread occlusion, segmentation accuracy is quite limited, which affects the large-scale application of automatic picking systems. Aiming at these issues, in this study, a bayberry segmentation method based on a multi-module convolutional neural network is proposed. First, the bayberry images in a real scene were collected and preprocessed to form a dataset. Then, a convolutional neural network was constructed, with an image correction module to improve the network's robustness to natural ambient lighting. Finally, a shape completion module with a puzzle algorithm was utilized to overcome the occlusion in the natural environment. The experimental results show that the average precision of the proposed method for semantic segmentation and instance segmentation of bayberry fruit can reach 0.913 and 0.755, respectively, which outperforms the existing methods and has important significance for automatic picking in orchards. (C) 2022 Elsevier B.V. All rights reserved.
Year
DOI
Venue
2022
10.1016/j.asoc.2022.108556
APPLIED SOFT COMPUTING
Keywords
DocType
Volume
Bayberry segmentation, Complex environment, Convolutional neural network, Multi-module, Puzzle algorithm
Journal
119
ISSN
Citations 
PageRank 
1568-4946
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Huan Lei100.34
Kai Huang246845.69
Zeyu Jiao300.34
Yu Tang400.34
Zhenyu Zhong500.34
Yingjie Cai600.68