An improved cascade R-CNN and RGB-D camera-based method for dynamic cotton top bud recognition and localization in the field
文献类型: 外文期刊
作者: Song, Peng 1 ; Chen, Keyi 1 ; Zhu, Longfu 1 ; Yang, Meng 1 ; Ji, Chao 2 ; Xiao, Ailing 3 ; Jia, Haoyang 1 ; Zhang, Jian 4 ; Yang, Wanneng 1 ;
作者机构: 1.Huazhong Agr Univ, Natl Ctr Plant Gene Res Wuhan, Natl Key Lab Crop Genet Improvement, Wuhan 430070, Peoples R China
2.Xinjiang Acad Agr & Reclamat Sci, Inst Mech Equipment, Shihezi 832003, Peoples R China
3.Tarim Univ, Coll Mech & Elect Engn, Alaer 843300, Xinjiang, Peoples R China
4.Huazhong Agr Univ, Coll Resources & Environm, Wuhan 430070, Peoples R China
关键词: RGB-D camera; Dynamic 3D localization; Cotton terminal bud recognition; Cascade
期刊名称:COMPUTERS AND ELECTRONICS IN AGRICULTURE ( 影响因子:6.757; 五年影响因子:6.817 )
ISSN: 0168-1699
年卷期: 2022 年 202 卷
页码:
收录情况: SCI
摘要: Cotton top cutting is an indispensable part of cotton planting. Cotton top bud detection and localization are highly challenging tasks because of tiny targets, dense growth and varying illumination. To achieve the auto-matic cutting of cotton buds in the field, a cotton top bud recognition and location algorithm adapted to a moving platform in the field based on images acquired by a red, green, blue and depth (RGB-D) camera was developed. In this study, an improved Cascade R-CNN network was proposed to detect cotton top bud regions on RGB images, and three-dimensional (3D) coordinates of targets were obtained by combining color images and depth images from RGB-D cameras. The 3D spatial position of the target in the world coordinate system was affected by the time of the cotton top bud recognition algorithm, the forward speed of the mobile platform and the time con-sumption of the manipulator moving to the target position. A dynamic compensation method of target co-ordinates in the moving direction was proposed to ensure the identification and positioning accuracy of cotton top buds in the moving process. To verify the effectiveness of the proposed algorithm, cotton top bud recognition and localization experiments were conducted in the field. The average precision with the proposed improved Cascade R-CNN model was 97.5 %, and the FPS was 13.3 frames per second, which was suitable for different period of a day. The average error of the positioning accuracy in the platform forwarding direction was 4.2 mm, 6.6 mm and 9.6 mm at speeds of 0.1 m/s, 0.2 m/s and 0.3 m/s, respectively. All the results demonstrate that the proposed method could be used for robotic cotton top cutting.
- 相关文献
作者其他论文 更多>>
-
GNSS and LiDAR Integrated Navigation Method in Orchards with Intermittent GNSS Dropout
作者:Li, Yilong;Feng, Qingchun;Sun, Yu;Feng, Qingchun;Sun, Jiahui;Feng, Qingchun;Ji, Chao
关键词:autonomous navigation; orchard; GNSS/INS integration; LiDAR; agricultural robot
-
A Precise Simultaneous Sowed Control System for Maize Seed and Fertilizer
作者:Liang, Jinxin;Pan, Feng;Chen, Jincheng;Zhang, Hui;Ji, Chao;Liang, Jinxin;Liang, Jinxin;Pan, Feng;Chen, Jincheng;Zhang, Hui;Ji, Chao
关键词:accurate simultaneous sowing; seed fertilizer location; real-time control; motor drive
-
A method for multi-target segmentation of bud-stage apple trees based on improved YOLOv8
作者:Chen, Jincheng;Li, Yujie;Ma, Benxue;Chen, Jincheng;Ji, Chao;Zhang, Jing;Chen, Jincheng;Ji, Chao;Zhang, Jing;Li, Yujie;Ma, Benxue;Feng, Qingchun;Li, Yujie;Ma, Benxue
关键词:YOLOv8; Bud stage; Apple tree; Multi-target segmentation; Complex background
-
Design and Experiment of Plate Taking Control System of Edible Sunflower (Edulis helianthus catino L.) Harvester
作者:Pan, Feng;Chen, Jincheng;Zhang, Hui;Han, Lin;Dong, Yuncheng;Li, Bin;Ji, Chao;Pan, Feng;Chen, Jincheng;Zhang, Hui;Han, Lin;Dong, Yuncheng;Li, Bin;Ji, Chao;Han, Lin
关键词:edible sunflower; harvester; plate taking control system; trapezoidal acceleration and deceleration control algorithm; field experiment
-
Design and Test of a Crawler-Type On-Film Precision Cotton Seeding Device on DEM-CFD
作者:Zhang, Hui;Pan, Feng;Han, Dalong;Liu, Jinbao;Ji, Chao;Zhang, Hui;Pan, Feng;Han, Dalong;Liu, Jinbao;Ji, Chao
关键词:agricultural machinery; tests; hole-forming mechanism; EDEM-CFD; cotton; precision seeding
-
Numerical Simulation and Bench Test of Crawler-Type Cotton Time-Delay Hole-Forming Device Based on RecurDyn-EDEM Coupling
作者:Pan, Feng;Chen, Jincheng;Zhang, Hualin;Wang, Baiwei;Jiang, Xizhen;Ji, Chao;Pan, Feng;Chen, Jincheng;Zhang, Hualin;Wang, Baiwei;Jiang, Xizhen;Ji, Chao;Zhang, Hualin;Jiang, Xizhen
关键词:cotton; crawler-type; delayed hole-forming device; coupling simulation; field experiment; soil bin test
-
Apple inflorescence recognition of phenology stage in complex background based on improved YOLOv7
作者:Chen, Jincheng;Ma, Benxue;Liu, Xin;Li, Yujie;Chen, Jincheng;Ji, Chao;Zhang, Jing;Ma, Benxue;Feng, Qingchun;Ma, Benxue
关键词:Phenology; Apple inflorescence; Deep learning; YOLOv7; Target recognition