Detection and Positioning of Camellia oleifera Fruit Based on LBP Image Texture Matching and Binocular Stereo Vision
文献类型: 外文期刊
作者: Lei, Xiangming 1 ; Wu, Mingliang 1 ; Li, Yajun 1 ; Liu, Anwen 1 ; Tang, Zhenhui 1 ; Chen, Shang 1 ; Xiang, Yang 1 ;
作者机构: 1.Hunan Agr Univ, Coll Mech & Elect Engn, Changsha 410128, Peoples R China
2.Beijing Acad Agr & Forestry Sci, Intelligent Equipment Res Ctr, Beijing 100097, Peoples R China
关键词: binocular stereo vision; LBP map; 3D positioning; image matching; Camellia oleifera fruit
期刊名称:AGRONOMY-BASEL ( 影响因子:3.7; 五年影响因子:4.0 )
ISSN:
年卷期: 2023 年 13 卷 8 期
页码:
收录情况: SCI
摘要: To achieve the rapid recognition and accurate picking of Camellia oleifera fruits, a binocular vision system composed of two industrial cameras was used to collect images of Camellia oleifera fruits in natural environments. The YOLOv7 convolutional neural network model was used for iterative training, and the optimal weight model was selected to recognize the images and obtain the anchor frame region of the Camellia oleifera fruits. The local binary pattern (LBP) maps of the anchor frame region were extracted and matched by using the normalized correlation coefficient template matching algorithm to obtain the positions of the center point in the left and right images. The recognition experimental results showed that the accuracy rate, recall rate, mAP and F1 of the model were 97.3%, 97.6%, 97.7% and 97.4%. The recognition rate of the Camellia oleifera fruit with slight shading was 93.13%, and the recognition rate with severe shading was 75.21%. The recognition rate of the Camellia oleifera fruit was 90.64% under sunlight condition, and the recognition rate was 91.34% under shading condition. The orchard experiment results showed that, in the depth range of 400-600 mm, the maximum error value of the binocular stereo vision system in the depth direction was 4.279 mm, and the standard deviation was 1.142 mm. The detection and three-dimensional positioning accuracy of the binocular stereo vision system for Camellia oleifera fruits could basically meet the working requirements of the Camellia oleifera fruit-picking robot.
- 相关文献
作者其他论文 更多>>
-
Compliant Motion Planning Integrating Human Skill for Robotic Arm Collecting Tomato Bunch Based on Improved DDPG
作者:Zhang, Yifan;Zhang, Yifan;Li, Yajun;Feng, Qingchun;Sun, Jiahui;Peng, Chuanlang;Gao, Liangzheng;Chen, Liping;Feng, Qingchun;Chen, Liping
关键词:deep reinforcement learning; demonstration learning; path planning; tomato bunch collection; robotics
-
Advance on Agricultural Robot Hand-Eye Coordination for Agronomic Task: A Review
作者:He, Liang;Sun, Yuhuan;Chen, Liping;Feng, Qingchun;Li, Yajun;Lin, Jiewen;Qiao, Yicheng;Chen, Liping;Feng, Qingchun;Zhao, Chunjiang
关键词:Agricultural robot; Hand-eye coordination; Agronomic task; Target perception; Collision-free operation
-
Fruit flexible collecting trajectory planning based on manual skill imitation for grape harvesting robot
作者:Sun, Jiahui;Zhao, Chunjiang;Sun, Jiahui;Feng, Qingchun;Zhang, Yifan;Ru, Mengfei;Li, Yajun;Li, Tao;Zhao, Chunjiang;Sun, Jiahui;Feng, Qingchun;Zhang, Yifan;Ru, Mengfei;Li, Yajun;Li, Tao;Zhao, Chunjiang
关键词:Trajectory planning; Manual skill imitation; Harvesting robot; Kernelized movement primitives; Optimization algorithm
-
Intermittent Stop-Move Motion Planning for Dual-Arm Tomato Harvesting Robot in Greenhouse Based on Deep Reinforcement Learning
作者:Li, Yajun;Zhao, Chunjiang;Li, Yajun;Feng, Qingchun;Zhang, Yifan;Peng, Chuanlang;Feng, Qingchun;Zhao, Chunjiang
关键词:motion planning; task allocation; deep reinforcement learning; dual-arm harvesting robot
-
Peduncle collision-free grasping based on deep reinforcement learning for tomato harvesting robot
作者:Li, Yajun;Feng, Qingchun;Zhang, Yifan;Peng, Chuanlang;Ma, Yuhang;Liu, Cheng;Ru, Mengfei;Sun, Jiahui;Zhao, Chunjiang;Li, Yajun;Feng, Qingchun;Zhao, Chunjiang;Feng, Qingchun
关键词:Collision-free; Deep reinforcement learning; Opimal operating posture; Tomato-harvesting robot
-
Dynamic Compressive Stress Relaxation Model of Tomato Fruit Based on Long Short-Term Memory Model
作者:Ru, Mengfei;Zhao, Chunjiang;Feng, Qingchun;Sun, Na;Li, Yajun;Sun, Jiahui;Li, Jianxun;Ru, Mengfei;Feng, Qingchun;Zhao, Chunjiang
关键词:tomato; stress relaxation; machine learning; LSTM
-
Structural Parameter Optimization of a Tomato Robotic Harvesting Arm: Considering Collision-Free Operation Requirements
作者:Peng, Chuanlang;Feng, Qingchun;Peng, Chuanlang;Feng, Qingchun;Guo, Zhengwei;Ma, Yuhang;Li, Yajun;Zhang, Yifan;Gao, Liangzheng;Peng, Chuanlang;Feng, Qingchun;Guo, Zhengwei;Ma, Yuhang;Li, Yajun;Zhang, Yifan;Gao, Liangzheng
关键词:tomato; harvesting robot; robotic arm; structural parameter optimization; collision-free



