Monocular positioning of sweet peppers: An instance segmentation approach for harvest robots
文献类型: 外文期刊
作者: Chen, Cheng 1 ; Li, Bo 2 ; Liu, Jiaxiang 1 ; Bao, Tong 1 ; Ren, Ni 1 ;
作者机构: 1.Jiangsu Acad Agr Sci, Inst Informat, Nanjing 210031, Jiangsu, Peoples R China
2.Nanjing Agr Univ, Coll Engn, Nanjing 210031, Jiangsu, Peoples R China
关键词: Harvesting robots; Positioning; Instance segmentation; Multi-task network; Convolutional neural network
期刊名称:BIOSYSTEMS ENGINEERING ( 影响因子:4.123; 五年影响因子:4.508 )
ISSN: 1537-5110
年卷期: 2020 年 196 卷
页码:
收录情况: SCI
摘要: Accurate positioning of fruit is a key issue that has attracted much attention in the field of harvest robots. The complex environment and close proximity make the perception of dense crops in greenhouses a challenging problem. Different from various solutions proposed involving special equipment or other auxiliary information, we propose a novel positioning approach based on instance segmentation using a monocular RGB camera. To achieve high position accuracy, we first design a deep convolutional neural network (CNN) in a multi-task framework to export a binary segmentation map and an embedded feature map. To solve the problem of performance degradation in the intersection-over-union (IoU) for the binary segmentation task caused by multi-task optimisation, the encoder part of our network is redesigned on the basis of a Visual Geometry Group network with 16 convolutional layers (VGG-16). Then, mean-shift clustering is used to achieve instance segmentation. Finally, a contour-finding algorithm is presented for outlining fruit without the help of any contextual information. Based on these contours, the five fruits with the largest contour areas are selected as the targets for positioning. We verify our method on a public sweet pepper dataset and achieve competitive results. Divided by the radius of the fruit, the average position error for the first target in the harvesting order is 0.18, which shows that our method outperforms the semantic segmentation method. For the first five targets in the harvesting order, this index is less than 0.3 on average, similar to that of the semantic segmentation method with only one target output. (C) 2020 IAgrE. Published by Elsevier Ltd. All rights reserved.
- 相关文献
作者其他论文 更多>>
-
A variable weight combination prediction model for climate in a greenhouse based on BiGRU-Attention and LightGBM
作者:Mao, Xiaojuan;Ren, Ni;Dai, Peiyu;Jin, Jing;Wang, Baojia;Kang, Rui;Li, Decui;Ren, Ni
关键词:Greenhouse; Climate; Bi-directional Gated Recurrent Unit; Attention; LightGBM
-
Toward Real Scenery: A Lightweight Tomato Growth Inspection Algorithm for Leaf Disease Detection and Fruit Counting
作者:Kang, Rui;Huang, Jiaxin;Ren, Ni;Kang, Rui;Zhou, Xuehai;Sun, Shangpeng
关键词:
-
miR-27a-3p targets NR5A2 to regulate CYP19A1 expression and 17-beta estradiol synthesis in ovine granulosa cells
作者:Gui, Hongbing;Li, Fan;Chen, Cheng;Zhu, Qiuyi;Zhang, Chenjian;Zhang, Jun;Meng, Chunhua;Qian, Yong;Cao, Shaoxian;Li, Yinxia;Gui, Hongbing;Li, Fan;Zhang, Jun;Meng, Chunhua;Qian, Yong;Cao, Shaoxian;Li, Yinxia;Gui, Hongbing;Li, Fan;Zhang, Jun;Meng, Chunhua;Qian, Yong;Cao, Shaoxian;Li, Yinxia
关键词:MiR-27a-3p; Granulosa cells; Estradiol synthesis; Hu sheep
-
Response of Flavor Substances in Tomato Fruit to Light Spectrum and Daily Light Integral
作者:Fan, Xiaoxue;Jin, Jing;Mao, Xiaojuan;Ren, Ni;Lu, Na;Xu, Wenshuo;Zhuang, Yunfei
关键词:PFALs; light quality; DLI; fruit quality; flavor substances
-
Recognition of fine-grained sow nursing behavior based on the SlowFast and hidden Markov models
作者:Li, Bo;Xu, Weijie;Chen, Tianming;Shen, Mingxia;Li, Bo;Xu, Weijie;Chen, Tianming;Shen, Mingxia;Cheng, Jinhua
关键词:Pig behavior monitoring; Nursing behavior recognition; Deep neural networks; Spatiotemporal features; Precision livestock farming
-
In situ deletions reveal regulatory components for expression of an intracellular immune receptor gene and its co-expressed genes in Arabidopsis
作者:Yu, Huiyun;Sun, Feng;Zhou, Tong;Yu, Huiyun;Yang, Leiyun;Li, Zhan;Guo, Shengsong;Hua, Jian;Li, Bo;Wang, Yong-Fei;Zhou, Tong
关键词:Arabidopsis thaliana; cis-acting elements; co-expression; CRISPR; expression; NLR; SNC1
-
Sensor Location Optimisation Design Based on IoT and Geostatistics in Greenhouse
作者:Liu, Yang;Dai, Xiu;Xun, Guanglian;Ren, Ni;Kang, Rui;Mao, Xiaojuan;Liu, Xiaoyu;Liu, Yang;Liu, Xiaoyu;Kang, Rui
关键词:Vegetable greenhouse; environmental monitoring; internet of things; sensor location design; ordinary kriging



