您好,欢迎访问中国热带农业科学院 机构知识库!

Towards mechanized harvesting of pineapples: A masked self-attention instance segmentation network and pineapple detection dataset

文献类型: 外文期刊

作者: Shan, Zhe 1 ; Ye, Songtao 3 ; Lin, Cong 4 ; Xue, Zhong 1 ;

作者机构: 1.Chinese Acad Trop Agr Sci, South Subtrop Crop Res Inst, Zhanjiang 524088, Peoples R China

2.Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Peoples R China

3.Jiaotong Univ, Fac Elect & Informat Engn, Xian 710049, Peoples R China

4.Guangdong Ocean Univ, Sch Elect & Informat Engn, Zhanjiang 524088, Peoples R China

5.Minist Agr, Lab Trop Fruit Biol, Zhanjiang 524088, Peoples R China

关键词: Smart agriculture; Deep learning; Mechanized pineapple harvesting; Grasp detection; Instance segmentation

期刊名称:ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE ( 影响因子:8.0; 五年影响因子:7.7 )

ISSN: 0952-1976

年卷期: 2025 年 156 卷

页码:

收录情况: SCI

摘要: Automated pineapple harvesting using robotic and computer systems has been a pressing issue that researchers need to tackle urgently. However, varying light conditions in orchards, complex environments, and leaf shading present significant challenges for accurate, real-time pineapple identification and localization. Furthermore, the damage to fruits caused by robotic harvesting further limits the development of automated pineapple harvesting. In this study, we propose a real-time instance segmentation scheme to address the above two issues simultaneously. Correspondingly, we design a masked self-attention instance segmentation network based on mixed supervised learning (MAISNet) to quickly extract pineapples' positional and geometric information and reduce the damage rate during robotic arm grasping. First, to meet the real-time needs of the robotic arm, a one-stage detection neural network is employed as the baseline model, achieving fast instance segmentation. Second, we incorporate a masked self-attention module to efficiently identify pineapple regions, reducing interference from irrelevant information. Third, we design a mixed supervised learning approach that allows the model to have some degree of uncertainty, enhancing the model's ability to recognize occluded regions while reducing the over-reliance on labels. At the same time, to promote the pineapple detection field's development and train the above algorithm, we present a public pineapple dataset. It is collected from real orchards, involves diverse complex scenarios, and is carefully labeled by hand. Many ablation experiments and comparison experiments demonstrate the validity and superiority of the method proposed in this study. Notably, experiments on edge devices verified the practical applicability of our approach in mechanized pineapple harvesting. This research changes the original paradigm of detecting only the location by accurately delineating fruit contours for direct robotic grasping. Consequently, it significantly reduces fruit damage during mechanical harvesting and advances the feasibility of large-scale automation in agriculture.

  • 相关文献
作者其他论文 更多>>