Monocular positioning of sweet peppers: An instance segmentation approach for harvest robots
文献类型: 外文期刊
作者: Chen, Cheng 1 ; Li, Bo 2 ; Liu, Jiaxiang 1 ; Bao, Tong 1 ; Ren, Ni 1 ;
作者机构: 1.Jiangsu Acad Agr Sci, Inst Informat, Nanjing 210031, Jiangsu, Peoples R China
2.Nanjing Agr Univ, Coll Engn, Nanjing 210031, Jiangsu, Peoples R China
关键词: Harvesting robots; Positioning; Instance segmentation; Multi-task network; Convolutional neural network
期刊名称:BIOSYSTEMS ENGINEERING ( 影响因子:4.123; 五年影响因子:4.508 )
ISSN: 1537-5110
年卷期: 2020 年 196 卷
页码:
收录情况: SCI
摘要: Accurate positioning of fruit is a key issue that has attracted much attention in the field of harvest robots. The complex environment and close proximity make the perception of dense crops in greenhouses a challenging problem. Different from various solutions proposed involving special equipment or other auxiliary information, we propose a novel positioning approach based on instance segmentation using a monocular RGB camera. To achieve high position accuracy, we first design a deep convolutional neural network (CNN) in a multi-task framework to export a binary segmentation map and an embedded feature map. To solve the problem of performance degradation in the intersection-over-union (IoU) for the binary segmentation task caused by multi-task optimisation, the encoder part of our network is redesigned on the basis of a Visual Geometry Group network with 16 convolutional layers (VGG-16). Then, mean-shift clustering is used to achieve instance segmentation. Finally, a contour-finding algorithm is presented for outlining fruit without the help of any contextual information. Based on these contours, the five fruits with the largest contour areas are selected as the targets for positioning. We verify our method on a public sweet pepper dataset and achieve competitive results. Divided by the radius of the fruit, the average position error for the first target in the harvesting order is 0.18, which shows that our method outperforms the semantic segmentation method. For the first five targets in the harvesting order, this index is less than 0.3 on average, similar to that of the semantic segmentation method with only one target output. (C) 2020 IAgrE. Published by Elsevier Ltd. All rights reserved.
- 相关文献
作者其他论文 更多>>
-
A temperature-responsive regulator that enhances virulence in the kiwifruit canker pathogen Pseudomonas syringae pv. actinidiae
作者:He, Xueting;Zhang, Yifei;Xu, Chenbei;Fu, Kaidi;Zhang, Tiantian;Chen, Tingtao;Murero, Aprodisia;Shao, Xiaolong;Qian, Guoliang;Ding, Yiqing;Ding, Yiqing;Ding, Yiqing;Xu, Yuan;Chen, Cheng;Li, Li;Zhong, Caihong;Huang, Lili;Deng, Xin;Deng, Xin
关键词:Kiwifruit canker disease; Pseudomonas syringae pv. actinidae; Low temperature; Heat shock protein; HrpL; Type III secretion system
-
A variable weight combination prediction model for climate in a greenhouse based on BiGRU-Attention and LightGBM
作者:Mao, Xiaojuan;Ren, Ni;Dai, Peiyu;Jin, Jing;Wang, Baojia;Kang, Rui;Li, Decui;Ren, Ni
关键词:Greenhouse; Climate; Bi-directional Gated Recurrent Unit; Attention; LightGBM
-
Toward Real Scenery: A Lightweight Tomato Growth Inspection Algorithm for Leaf Disease Detection and Fruit Counting
作者:Kang, Rui;Huang, Jiaxin;Ren, Ni;Kang, Rui;Zhou, Xuehai;Sun, Shangpeng
关键词:
-
Mapping rapeseed (Brassica napus L.) aboveground biomass in different periods using optical and phenotypic metrics derived from UAV hyperspectral and RGB imagery
作者:Sun, Chuanliang;Zhang, Weixin;Wu, Qian;Liang, Wanjie;Ren, Ni;Cao, Hongxin;Sun, Chuanliang;Zhao, Genping;Zou, Lidong;Zou, Lidong
关键词:rapeseed (
Brassica napus L. ); aboveground biomass (AGB); phenotypic metrics; hyperspectral images (HSI); machine learning approach -
Genome-Wide Identification and Characterization of MYB Transcription Factors in Sudan Grass under Drought Stress
作者:Liu, Qiuxu;Xu, Yalin;Li, Xiangyan;Qi, Tiangang;Li, Bo;Wang, Hong;Zhu, Yongqun
关键词:Sudan grass; drought stress; genome-wide analysis; MYB transcription factors
-
An Improved 2D Pose Estimation Algorithm for Extracting Phenotypic Parameters of Tomato Plants in Complex Backgrounds
作者:Cheng, Yawen;Ren, Ni;Hu, Anqi;Zhou, Lingli;Qi, Chao;Wu, Qian;Cheng, Yawen;Ren, Ni;Hu, Anqi;Zhou, Lingli;Qi, Chao;Wu, Qian;Zhang, Shuo
关键词:plant height; internode length; 2D pose estimation; YOLOv8-pose; CBAM; CARAFE; plant phenotyping; tomato
-
Barrier-free tomato fruit selection and location based on optimized semantic segmentation and obstacle perception algorithm
作者:Zhou, Lingli;Hu, Anqi;Cheng, Yawen;Zhang, Wenxiang;Zhang, Bingyuan;Lu, Xinyu;Wu, Qian;Ren, Ni;Zhou, Lingli;Hu, Anqi;Cheng, Yawen;Zhang, Wenxiang;Zhang, Bingyuan;Lu, Xinyu;Wu, Qian;Ren, Ni
关键词:harvesting robot; image semantic segmentation; obstacle perception; deep learning; fruit selection; positioning; tomato



