An automated, high-performance approach for detecting and characterizing broccoli based on UAV remote-sensing and transformers: A case study from Haining, China
文献类型: 外文期刊
作者: Zhou, Chengquan 1 ; Ye, Hongbao 1 ; Sun, Dawei 1 ; Yue, Jibo 2 ; Yang, Guijun 3 ; Hu, Jun 4 ;
作者机构: 1.Zhejiang Acad Agr Sci, Inst Agr Equipment, Hangzhou 310000, Peoples R China
2.Henan Agr Univ, Coll Informat & Management Sci, Zhengzhou 450002, Peoples R China
3.Beijing Res Ctr Informat Technol Agr, Key Lab Quantitat Remote Sensing Agr, Minist Agr PR China, Beijing 100097, Peoples R China
4.Zhejiang Acad Agr Sci, Food Sci Inst, Hangzhou 310000, Peoples R China
5.Minist Agr & Rural Affairs, Key Lab Postharvest Preservat & Proc Vegetables Co, Hangzhou 310000, Peoples R China
关键词: Transformers; Multi-sensor; Broccoli detection and characterization; Canopy mapping; Volume estimation
期刊名称:INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION ( 影响因子:7.672; 五年影响因子:7.332 )
ISSN: 1569-8432
年卷期: 2022 年 114 卷
页码:
收录情况: SCI
摘要: Accurate canopy mapping and head-volume estimation of large areas of broccoli is an important prerequisite for precision farming since it provides important phenotypic traits associated with field management, environmental control, and yield prediction. Currently, the detection and characterization of broccoli mostly rely on ground surveys and human interpretation, which is often time-and labor-intensive. Recent developments based on unmanned aerial vehicle (UAV) remote sensing offer low cost, timely, and flexible data acquisition, thereby providing a potential alternative technique to enhance in situ field surveys. The combination of UAV data and deep learning has led to a series of breakthroughs in rapid and automated collection of simultaneous multisensor and multimodal plant phenotyping data. However, their application for monitoring broccoli remains problematic when faced with the significant spatial scale involved and the variety of vegetation species. To address this problem, we propose herein a fast and reliable semi-automatic workflow based on deep learning to process UAV RGB imagery and LiDAR point clouds and thereby remotely detect and characterize broccoli canopy and heads. First, we explore the use of TransUNet to differentiate canopy and non-canopy regions in RGB images at the individual-plant scale. The results demonstrate that TransUNet consistently achieves the highest accuracy (average returned Precision, Recall, F1 score, and IoU of 0.917, 0.864, 0.901, and 0.895, respectively) compared with three CNN-based and two shallow learning-based approaches. In addition, TransUNet performs best in terms of robustness against variations in training samples. Subsequently, to estimate the volume of broccoli heads, a point cloud transformer (PCT) network is developed for point cloud segmentation. Improving upon the results of three existing methods PointNet, PointNet++, and K-means that were applied to the same datasets, the best-performing PCT produced a precision of 0.914, an overall recall of 0.899, an overall F1 score of 0.901, and an overall IoU of 0.879. A regression analysis indicates that the PCT estimates had R2 = 0.875, RMSE = 18.62, and rRMSE = 3.64 %, which is also superior to the results from other comparison approaches. Collectively, the wide application of such technology would facilitate applied research in plant phenotyping and precision agro-ecological applications and field management.
- 相关文献
作者其他论文 更多>>
-
Recognition of wheat rusts in a field environment based on improved DenseNet
作者:Chang, Shenglong;Cheng, Jinpeng;Fan, Zehua;Ma, Xinming;Li, Yong;Zhao, Chunjiang;Chang, Shenglong;Yang, Guijun;Cheng, Jinpeng;Fan, Zehua;Yang, Xiaodong;Zhao, Chunjiang
关键词:Plant disease; Wheat rust; Image processing; Deep learning; Computer vision (CV); DenseNet
-
Automatic Rice Early-Season Mapping Based on Simple Non-Iterative Clustering and Multi-Source Remote Sensing Images
作者:Wang, Gengze;Chen, Riqiang;Yang, Guijun;Feng, Haikuan;Wang, Gengze;Chen, Riqiang;Yang, Guijun;Feng, Haikuan;Meng, Di;Jin, Hailiang;Ge, Xiaosan;Wang, Laigang;Feng, Haikuan
关键词:early-season rice mapping; spectral index (SI); synthetic aperture radar (SAR); Simple Non-Iterative Clustering (SNIC); time series filtering; K-Means; Jeffries-Matusita (JM) distance
-
A Two-Stage Leaf-Stem Separation Model for Maize With High Planting Density With Terrestrial, Backpack, and UAV-Based Laser Scanning
作者:Lei, Lei;Lei, Lei;Li, Zhenhong;Li, Zhenhong;Yang, Hao;Xu, Bo;Yang, Guijun;Hoey, Trevor B.;Wu, Jintao;Yang, Xiaodong;Feng, Haikuan;Yang, Guijun;Yang, Guijun
关键词:Vegetation mapping; Laser radar; Point cloud compression; Feature extraction; Agriculture; Data models; Data mining; Different cultivars; different growth stages; different planting densities; different platforms; light detection and ranging (LiDAR) data; simulated datasets; two-stage leaf-stem separation model
-
Remote sensing of quality traits in cereal and arable production systems: A review
作者:Li, Zhenhai;Fan, Chengzhi;Li, Zhenhai;Zhao, Yu;Song, Xiaoyu;Yang, Guijun;Jin, Xiuliang;Casa, Raffaele;Huang, Wenjiang;Blasch, Gerald;Taylor, James;Li, Zhenhong
关键词:Remote sensing; Quality traits; Grain protein; Cereal
-
Estimation of Peanut Southern Blight Severity in Hyperspectral Data Using the Synthetic Minority Oversampling Technique and Fractional-Order Differentiation
作者:Sun, Heguang;Shu, Meiyan;Yue, Jibo;Guo, Wei;Sun, Heguang;Zhang, Jie;Feng, Ziheng;Feng, Haikuan;Song, Xiaoyu;Zhou, Lin
关键词:peanut southern blight; SMOTE; hyperspectral reflectance; machine learning; FOD
-
A method to rapidly construct 3D canopy scenes for maize and their spectral response evaluation
作者:Zhao, Dan;Xu, Tongyu;Yang, Hao;Zhang, Chengjian;Cheng, Jinpeng;Yang, Guijun;Henke, Michael
关键词:3D maize canopy scene; Functional-structural model; Canopy structure; 3D radiative transfer; Spectral response
-
Analyzing winter-wheat biochemical traits using hyperspectral remote sensing and deep learning
作者:Yue, Jibo;Wang, Jian;Guo, Wei;Ma, Xinming;Qiao, Hongbo;Yang, Guijun;Liu, Yang;Feng, Haikuan;Yue, Jibo;Yang, Guijun;Li, Changchun;Niu, Qinglin;Feng, Haikuan
关键词:Unmanned aerial vehicle; Transfer learning; Deep learning; Hyperspectral