关键词:
deep learning
depth image
LabVIEW
oat
plant height
摘要:
【Objective】Oat plant height affects the productivity per plant and the yield per unit area together with planting density. This study explores automatic, real-time, and precise methods for acquiring oat plant height in a field environment, aiming to provide technical references for the automated field management of oat. 【Method】 Firstly, an oat depth image acquisition system was built based on Intel RealSense D435 depth camera and LabVIEW software development platform. Taking Oat ‘Pinyan No. 4’ as the research object, 26 376 modeling data and 2 205 test data were obtained during the whole oat growth process. The average and highest plant height of oats in each depth image were measured with a scale. The quantity of modeling data and test data in each height range of oat plant was relatively balanced. The images were preprocessed by high restoration, grayscale and scaling. Each image was tagged with two labels, one for the average and one for the highest plant height of the oats in the image. Then, based on 8 classical convolutional neural network models, the last layer (classification layer) of each network model was removed, and two fully connected layers with single nodes and no activation function were added to construct the double output regression convolutional neural network estimation model. Mean square error (MSE) was used to evaluate the accuracy of each model in estimating oat plant height. Finally, based on the TensorFlow deep learning platform, Modified EfficientNet V2L was selected as the estimation model by 5-fold cross-validation using the modeling data. 【Result】The generalization performance of Modified EfficientNet V2L model to estimate oat plant height was investigated using test data not involved in model training. The mean absolute error (MAE), root mean square error (RMSE) and mean relative error (MRE) to estimate oat average plant height were 2.30 cm, 2.90 cm and 4.4%, respectively. Meanwhile, the MAE, RMSE and MRE to estimate highest plant hei