A multi-arm robot system for efficient apple harvesting: Perception, task plan and control
文献类型: 外文期刊
作者: Li, Tao 1 ; Xie, Feng 1 ; Zhao, Zhuoqun 3 ; Zhao, Hui 5 ; Guo, Xin 1 ; Feng, Qingchun 1 ;
作者机构: 1.Beijing Acad Agr & Forestry Sci, Intelligent Equipment Res Ctr, Beijing 100097, Peoples R China
2.Jiangsu Univ, Sch Agr Engn, Zhenjiang 212000, Peoples R China
3.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
4.Tianjin Sino German Univ Appl Sci, Sch Mech Engn, Tianjin 300350, Peoples R China
5.Tianjin Univ Technol, Sch Elect Engn & Automation, Tianjin 300382, Peoples R China
6.Beijing Acad Agr & Forestry Sci, 11 Shuguang Garden Middle Rd, Beijing 100097, Peoples R China
关键词: Harvesting robot; Multiple robotic arms; Depth camera; Robotics; Object detection; Task planning
期刊名称:COMPUTERS AND ELECTRONICS IN AGRICULTURE ( 影响因子:8.3; 五年影响因子:8.3 )
ISSN: 0168-1699
年卷期: 2023 年 211 卷
页码:
收录情况: SCI
摘要: Robot harvesting has emerged as an urgent need for apple industry due to a sharp decline in agricultural labor. In the field of harvesting robots, the use of multiple robotic arms to improve operational efficiency and promote industrial applications has gained significant attention. Despite the significant progress made in multi-arm harvesting robots in recent years, their widespread application in orchard production is hindered by insufficient efficiency of operation and the accuracy of fruit positioning. This paper focuses on the precise perception and multi-arm collaborative control issues of harvesting robots, and proposes a multi-arm apple harvesting robot system. Firstly, the paper introduces the hardware and software integration method and kinematic configuration of the robot, and presents its workspace division and asynchronous sequential operation mode. Secondly, the paper proposes a stereo vision fruit recognition and localization algorithm based on multi-task deep learning to enhance the accuracy of apple fruit positioning and a method of combining multiple perspectives to acquire a global fruit map is introduced. Finally, the paper presents a multi-arm task planning method based on the Markov game framework to optimize the target harvesting order of each arm and improve the collaboration efficiency. The effectiveness of the robot and its perception and control methods are verified through multiple field experiments in orchards. The field trials showed that the proposed vision system reduces the median locating error of the robot system by up to 44.43%; the proposed task planning algorithm can reduce the average cycle time by 33.3% compared to the heuristic-based algorithm, and time taken for optimizing task planning ranged from 1.14 s to 1.21 s; and the robot's harvest success rate varied from 71.28% to 80.45%, and the average cycle time ranged from 5.8 s to 6.7 s.
- 相关文献
作者其他论文 更多>>
-
Dynamic Compressive Stress Relaxation Model of Tomato Fruit Based on Long Short-Term Memory Model
作者:Ru, Mengfei;Zhao, Chunjiang;Feng, Qingchun;Sun, Na;Li, Yajun;Sun, Jiahui;Li, Jianxun;Ru, Mengfei;Feng, Qingchun;Zhao, Chunjiang
关键词:tomato; stress relaxation; machine learning; LSTM
-
GNSS and LiDAR Integrated Navigation Method in Orchards with Intermittent GNSS Dropout
作者:Li, Yilong;Feng, Qingchun;Sun, Yu;Feng, Qingchun;Sun, Jiahui;Feng, Qingchun;Ji, Chao
关键词:autonomous navigation; orchard; GNSS/INS integration; LiDAR; agricultural robot
-
Optimized Design of Robotic Arm for Tomato Branch Pruning in Greenhouses
作者:Ma, Yuhang;Chen, Liping;Feng, Qingchun;Sun, Yuhuan;Guo, Xin;Zhang, Wanhao;Wang, Bowen;Chen, Liping;Feng, Qingchun;Guo, Xin;Chen, Liping
关键词:agricultural robot; tomato pruning; manipulator; structural optimization
-
A method for multi-target segmentation of bud-stage apple trees based on improved YOLOv8
作者:Chen, Jincheng;Li, Yujie;Ma, Benxue;Chen, Jincheng;Ji, Chao;Zhang, Jing;Chen, Jincheng;Ji, Chao;Zhang, Jing;Li, Yujie;Ma, Benxue;Feng, Qingchun;Li, Yujie;Ma, Benxue
关键词:YOLOv8; Bud stage; Apple tree; Multi-target segmentation; Complex background
-
An Original UV Adhesive Watermelon Grafting Method, the Grafting Device, and Experimental Verification
作者:Zhang, Xin;Kong, Linghao;Lu, Hanwei;Zhang, Xin;Feng, Qingchun;Li, Tao;Jiang, Kai;Zhang, Qian
关键词:watermelon grafting; UV adhesive; fluent; VOF-DPM numerical simulation; grafting device; test
-
Fruit flexible collecting trajectory planning based on manual skill imitation for grape harvesting robot
作者:Sun, Jiahui;Zhao, Chunjiang;Sun, Jiahui;Feng, Qingchun;Zhang, Yifan;Ru, Mengfei;Li, Yajun;Li, Tao;Zhao, Chunjiang;Sun, Jiahui;Feng, Qingchun;Zhang, Yifan;Ru, Mengfei;Li, Yajun;Li, Tao;Zhao, Chunjiang
关键词:Trajectory planning; Manual skill imitation; Harvesting robot; Kernelized movement primitives; Optimization algorithm
-
Design of Shiitake Mushroom Robotic Picking Grasper: Considering Stipe Compressive Stress Relaxation
作者:Li, Jianxun;Li, Jianxun;Feng, Qingchun;Ru, Mengfei;Sun, Jiahui;Guo, Xin;Zheng, Wengang;Feng, Qingchun;Ru, Mengfei;Sun, Jiahui;Guo, Xin
关键词:mushroom picking; picking grasper; stress relaxation; finite element analysis