Method for the real-time detection of tomato ripeness using a phenotype robot and RP-YolactEdge
文献类型: 外文期刊
作者: Wang, Yuanqiao 1 ; Gou, Wenbo 2 ; Wang, Chuanyu 2 ; Fan, Jiangchuan 2 ; Wen, Weiliang 2 ; Lu, Xianju 2 ; Guo, Xinyu 3 ; Zhao, Chunjiang 1 ;
作者机构: 1.Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Shaanxi, Peoples R China
2.China Natl Engn Res Ctr Informat Technol Agr NERCI, Beijing 100097, Peoples R China
3.Beijing Res Ctr Informat Technol Agr, Beijing Key Lab Digital Plant, Beijing 100097, Peoples R China
4.Beijing PAIDE Sci & Technol Dev Co Ltd, Beijing 100097, Peoples R China
关键词: instance segmentation; phenotype robot; tomato; greenhouse-based plant phenotyping; ripeness detection
期刊名称:INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING ( 影响因子:2.2; 五年影响因子:2.5 )
ISSN: 1934-6344
年卷期: 2024 年 17 卷 2 期
页码:
收录情况: SCI
摘要: In order to address the challenge of non-destructive detection of tomato fruit ripeness in controlled environments, this study proposed a real-time instance segmentation method based on the edge device. This method combined the principles of phenotype robots and machine vision based on deep learning. A compact and remotely controllable phenotype detection robot was employed to acquire precise data on tomato ripeness. The video data were then processed by using an efficient backbone and the FeatFlowNet structure for feature extraction and analysis of key-frame to non-key-frame mapping from video data. To enhance the diversity of training datasets and the generalization of the model, an innovative approach was chosen by using random enhancement techniques. Besides, the PolyLoss optimization technique was applied to further improve the accuracy of the ripeness multi-class detection tasks. Through validation, the method of this study achieved real-time processing speeds of 90.1 fps (RTX 3070Ti) and 65.5 fps (RTX 2060 S), with an average detection accuracy of 97% compared to manually measured results. This is more accurate and efficient than other instance segmentation models according to actual testing in a greenhouse. Therefore, the results of this research can be deployed in edge devices and provide technical support for unmanned greenhouse monitoring devices or fruit-picking robots in facility environments.
- 相关文献
作者其他论文 更多>>
-
LettuceP3D: A tool for analysing 3D phenotypes of individual lettuce plants
作者:Ge, Xiaofen;Guo, Xinyu;Ge, Xiaofen;Wu, Sheng;Wen, Weiliang;Xiao, Pengliang;Lu, Xianju;Liu, Haishen;Zhang, Minggang;Guo, Xinyu;Ge, Xiaofen;Wu, Sheng;Wen, Weiliang;Xiao, Pengliang;Lu, Xianju;Liu, Haishen;Zhang, Minggang;Guo, Xinyu;Wu, Sheng;Wen, Weiliang;Shen, Fei
关键词:Lettuce; Point cloud segmentation; Deep learning; Phenotypic analysis algorithm
-
3D time-series phenotyping of lettuce in greenhouses
作者:Ma, Hanyu;Wen, Weiliang;Gou, Wenbo;Fan, Jiangchuan;Gu, Shenghao;Guo, Xinyu;Ma, Hanyu;Wen, Weiliang;Gou, Wenbo;Lu, Xianju;Fan, Jiangchuan;Zhang, Minggang;Liang, Yuqiang;Gu, Shenghao;Guo, Xinyu
关键词:Time-series; 3D phenotyping; Rail-driven phenotyping platform; Lettuce; Greenhouse
-
Recognition of maize seedling under weed disturbance using improved YOLOv5 algorithm
作者:Tang, Boyi;Zhao, Chunjiang;Tang, Boyi;Zhou, Jingping;Pan, Yuchun;Qu, Xuzhou;Cui, Yanglin;Liu, Chang;Li, Xuguang;Zhao, Chunjiang;Gu, Xiaohe;Li, Xuguang
关键词:Object detection; Maize seedlings; UAV RGB images; YOLOv5; Attention mechanism
-
Boosting Cost-Efficiency in Robotics: A Distributed Computing Approach for Harvesting Robots
作者:Xie, Feng;Xie, Feng;Li, Tao;Feng, Qingchun;Li, Tao;Feng, Qingchun;Chen, Liping;Zhao, Chunjiang;Zhao, Hui
关键词:5G network; computation allocation; edge computing; harvesting robot; visual system
-
Genotyping Identification of Maize Based on Three-Dimensional Structural Phenotyping and Gaussian Fuzzy Clustering
作者:Xu, Bo;Zhao, Chunjiang;Xu, Bo;Zhao, Chunjiang;Yang, Guijun;Zhang, Yuan;Liu, Changbin;Feng, Haikuan;Yang, Xiaodong;Yang, Hao;Xu, Bo;Zhao, Chunjiang;Yang, Guijun;Zhang, Yuan;Liu, Changbin;Feng, Haikuan;Yang, Xiaodong;Yang, Hao
关键词:tassel; 3D phenotyping; TreeQSM; genotyping; clustering
-
High-throughput phenotyping techniques for forage: Status, bottleneck, and challenges
作者:Cheng, Tao;Zhang, Dongyan;Cheng, Tao;Wang, Zhaoming;Zhang, Dongyan;Zhang, Gan;Yuan, Feng;Liu, Yaling;Wang, Tianyi;Ren, Weibo;Zhao, Chunjiang
关键词:Forage; High-throughput phenotyping; Precision identification; Sensors; Artificial intelligence; Efficient breeding
-
Comprehensive review on 3D point cloud segmentation in plants
作者:Song, Hongli;Wen, Weiliang;Wu, Sheng;Guo, Xinyu;Song, Hongli;Wen, Weiliang;Wu, Sheng;Guo, Xinyu;Song, Hongli
关键词:Plant; Three-dimensional; Point cloud; Segmentation; Multi-scale; Deep learning



