A corn silk detection method based on MF-SSD convolutional neural network

ZHU Deli; LIN Zhijian

doi:10.7671/j.issn.1001-411X.202006025

Journal of South China Agricultural University > 2020 > 41(6): 109-118. > DOI: 10.7671/j.issn.1001-411X.202006025

ZHU Deli, LIN Zhijian. A corn silk detection method based on MF-SSD convolutional neural network[J]. Journal of South China Agricultural University, 2020, 41(6): 109-118. DOI: 10.7671/j.issn.1001-411X.202006025

Citation:

PDF (1431 KB)

A corn silk detection method based on MF-SSD convolutional neural network

ZHU Deli^{1, 2,},
LIN Zhijian¹

1.
Department of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
2.
Research Center of Chongqing Digital Agricultural Service Engineering Technology, Chongqing 401331, China

More Information

Received Date: June 11, 2020
Available Online: May 17, 2023

Graphical Abstract

Abstract

Abstract

Objective
Corn silk is the pollination organ of maize, its growth state will affect the yield of corn. In order to identify the corn silk in real-time and accurately in corn growth state monitoring and yield prediction, a corn silk detection model based on multi-feature fusion SSD (MF-SSD) convolutional neural network was proposed.

Method
Corn silk detection was based on feature images. The MF-SSD network model was modified from VGG16-SSD through replacing feature extractor by MobileNet and integrating multi-layer feature fusion structure. By optimizing and adjusting the network, three kinds of MF-SSD with different network structures (MF-SSD-cut-3, MF-SSD and MF-SSD-add-3) were tested, and the structure with the best detection performance was selected for corn silk detection. Based on the image data set of corn silk, two kinds of data augmentation techniques (randomly rotating original image from 0 to 180°, horizontally rolling over or translating original image) were applied to improve the training effect of the model. Whether using secondary training strategy and Focal loss to solve sample number imbalance was investigated, and the decrease process of Loss was compared and analyzed.

Result
The improved SSD model added with multi-layer feature fusion structure could improve the detection ability and recognition speed of network. Compared with VGG16-SSD, the average accuracy of intersection over union increased by 7.2%, the average recall of small target detection of corn silk increased by 19.6%, and the detection speed increased by 18.7%. In the embedded environment having high demand for storage space and run time, MF-SSD-cut-3 obtained shorter run time with smaller storage space in the premise of satisfying detection effect. MF-SSD obtained better detection effect in the condition of taking no account of storage space and run time. The secondary training strategy improved the network convergence speed and model stability. Focal loss effectively solved number imbalance problem of positive and negative samples, and made the training of network model more convergent.

Conclusion
The detection effect of the proposed MF-SSD model for small targets can meet the needs of real-time detection of corn silk in agricultural production. It can be used for automatic monitoring of corn growth state and yield prediction.
- corn silk,
- object detection,
- convolutional neural network,
- feature fusion,
- MF-SSD

FullText(HTML)

References (22)

References

[1]	杨笛, 熊伟, 许吟隆, 等. 气候变化背景下中国玉米单产增速减缓的原因分析[J]. 农业工程学报, 2017, 33(增刊1): 231-238.
[2]	刘哲, 曲艺伟, 赵祖亮, 等. 玉米优良品种推广重心转移及扩散的时空规律[J]. 农业工程学报, 2018, 34(1): 178-185. doi: 10.11975/j.issn.1002-6819.2018.01.24
[3]	王传宇, 郭新宇, 杜建军. 基于时间序列红外图像的玉米叶面积指数连续监测[J]. 农业工程学报, 2018, 34(6): 175-181. doi: 10.11975/j.issn.1002-6819.2018.06.022
[4]	王临铭, 高晓阳, 李红岭, 等. 基于神经网络的大麦病害识别研究[J]. 甘肃农业大学学报, 2015, 50(2): 173-176. doi: 10.3969/j.issn.1003-4315.2015.02.029
[5]	王璨, 武新慧, 李志伟. 基于卷积神经网络提取多尺度分层特征识别玉米杂草[J]. 农业工程学报, 2018, 34(5): 144-151. doi: 10.11975/j.issn.1002-6819.2018.05.019
[6]	周云成, 许童羽, 郑伟, 等. 基于面向通道分组卷积网络的番茄主要器官实时识方法[J]. 农业工程学报, 2018, 33(15): 153-162.
[7]	刘永波, 雷波, 曹艳, 等. 基于深度卷积神经网络的玉米病害识别[J]. 中国农学通报, 2018, 34(36): 159-164. doi: 10.11924/j.issn.1000-6850.casb18030031
[8]	KOIRALA A, WALSH K B, WANG Z, et al. Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of ‘MangoYOLO’[J]. Precis Agric, 2019, 20(6): 1107-1135. doi: 10.1007/s11119-019-09642-0
[9]	TIAN Y, YANG G, WANG Z, et al. Apple detection during different growth stages in orchards using the improved YOLO-V3 model[J]. Comput Electron Agr, 2019, 157: 417-426. doi: 10.1016/j.compag.2019.01.012
[10]	REN S, HE K, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE T Pattern Anal, 2017, 39(6): 1137-1149. doi: 10.1109/TPAMI.2016.2577031
[11]	LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot multibox detector[C]//LEIBE B, MATAS J, SEBE N, et al. Lecture Notes in Computer Science. Cham: Springer International Publishing AG, 2016, 9905: 21-37.
[12]	SILVER D, HUANG A, MADDISON C J, et al. Mastering the game of Go with deep neural networks and tree search[J]. Nature, 2016, 529(7587): 484-489. doi: 10.1038/nature16961
[13]	YU Z, LI T, LUO G, et al. Convolutional networks with cross-layer neurons for image recognition[J]. Inform Sciences, 2018, 433: 241-254.
[14]	ALAWAD M, LIN M. Stochastic-based deep convolutional networks with reconfigurable logic fabric[J]. IEEE Transactions on Multi-Scale Computing Systems, 2016, 2(4). doi: 10.1109/TMSCS.2016.2601326.
[15]	LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//IEEE. IEEE Conference on Computer Vision and Pattern Recognition, New York: IEEE, 2017: 936-944.
[16]	马浚诚, 杜克明, 郑飞翔, 等. 基于卷积神经网络的温室黄瓜病害识别系统[J]. 农业工程学报, 2018, 34(12): 186-192. doi: 10.11975/j.issn.1002-6819.2018.12.022
[17]	LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[J]. IEEE T Pattern Anal, 2020, 42(2): 318-327. doi: 10.1109/TPAMI.2018.2858826
[18]	彭红星, 黄博, 邵园园, 等. 自然环境下多类水果采摘目标识别的通用改进SSD模型[J]. 农业工程学报, 2018, 34(16): 155-162. doi: 10.11975/j.issn.1002-6819.2018.16.020
[19]	LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft COCO: Common objects in context[C]//FLEET D, PAJDLA T, SCHIELE B, et al. Lecture Notes in Computer Science. Cham: Springer International Publishing AG, 2014, 8693: 740-755.
[20]	REDMON J, FARHADI A. YOLO9000: Better, faster, stronger[C]//IEEE. IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2017: 6517-6525.
[21]	REDMON J, FARHADI A. YOLOv3: An Incremental Improvement[C]//IEEE. IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2018.
[22]	李善军, 胡定一, 高淑敏, 等. 基于改进SSD的柑橘实时分类检测[J]. 农业工程学报, 2019, 35(24): 307-313. doi: 10.11975/j.issn.1002-6819.2019.24.036

Cited By

Cited by

Periodical cited type(0)

Other cited types(1)

Get Citation

PDF

XML

Article views (1156) PDF downloads (1110) Cited by(1)

Turn off MathJax

Article Contents

Abstract

References

A corn silk detection method based on MF-SSD convolutional neural network

Abstract

References

Cited by

Periodical cited type(0)

Other cited types(1)

Catalog

Export File

Citation

Format

Content