A Zero-Shot Deep Learning-Supported Sensing System for Crop Seeds and Berries Phenotyping
文献类型: 外文期刊
作者: Zhou, Lei 1 ; Zhang, Huichun 1 ; Bian, Liming 2 ; Zhao, Yiying 3 ; Xiao, Qinlin 4 ;
作者机构: 1.Nanjing Forestry Univ, Coll Mech & Elect Engn, Jiangsu Co Innovat Ctr Efficient Proc & Utilizat, Nanjing 210037, Peoples R China
2.Nanjing Forestry Univ, Co Innovat Ctr Sustainable Forestry Southern Chin, State Key Lab Tree Genet & Breeding, Key Lab Forest Genet & Biotechnol Minist Educ, Nanjing 210037, Peoples R China
3.Zhejiang Acad Agr Sci, Inst Digital Agr, Hangzhou 310021, Peoples R China
4.China Tobacco Sichuan Ind Co Ltd, Technol Ctr, Chengdu 610066, Peoples R China
关键词: Image segmentation; Training; Hyperspectral imaging; Annotations; Sensors; Manuals; Seeds (agriculture); Instance segmentation; Imaging; Databases; Berry; computer vision; grain; hyperspectral imaging; image synthesis; instance segmentation
期刊名称:IEEE SENSORS JOURNAL ( 影响因子:4.5; 五年影响因子:4.7 )
ISSN: 1530-437X
年卷期: 2024 年 24 卷 24 期
页码:
收录情况: SCI
摘要: Hyperspectral imaging, the fusion of vibrational spectral sensing and computer vision, could simultaneously detect the light absorption caused by the molecular vibration transition of chemical bonds as well as the appearance of the target sample. Coupled with artificial intelligence (AI), it is widely used for quality inspection of agricultural products. Sufficient samples with true quality indicators are required for AI model training. An efficient and low-cost approach for single-object extraction in the image is urgently needed. In this study, a zero-shot learning instance segmentation method was proposed for seeds and berries extraction in images of densely arranged samples. The image-annotation pairs for model training were synthesized by combining the objects in a sample pool. Typical segmentation methods including YoloV8-segment, MaskRCNN, and UNet were studied and compared. All these models were trained and optimized using the synthetic datasets and evaluated using real images. Another popular zero-shot learning method segment anything model (SAM) was also studied for comparison. Satisfactory performances were observed on wheat seed extraction in the processing of VIS/NIR hyperspectral images, NIR hyperspectral images, and regular color images. The zero-shot learning-based YoloV8-segment model reached the highest performance on wheat seed segmentation, with mAP50 values from 0.96 to 0.98. Further experiments on image segmentation of lotus seeds, grape berries, and cherry tomatoes also proved its effectiveness. The presented methods could achieve ultrahigh-speed image or spectral database construction of approximate ellipsoid seeds and berries, further promoting the improvement of the efficiency of high-throughput agricultural products phenotyping system.
- 相关文献
作者其他论文 更多>>
-
Characteristics of compound heat and drought events during the spring maize growing season in Northeast China Based on a novel daily-scale analysis framework
作者:Yang, Jianhua;Wu, Jianjun;Zhang, Zhenqing;Yang, Jianhua;Wu, Jianjun;Zhang, Zhenqing;Zhang, Ruilin;Wu, Jianjun;Zhou, Lei;Zhou, Hongkui
关键词:CHDEs; Daily-scale Analysis Method; Effective Precipitation; Spring Maize; Northeast China
-
Bismuth oxyhalides (BiOX (X = Cl, Br, I)) based composites for photocatalytic antibacterial: Modification strategies, antibacterial mechanisms and prospects
作者:Xiang, Zhuomin;Wang, Xiaoqing;Jiang, Xiaojia;Li, Chunjuan;Wang, Qi;Wu, Yanling;Yang, Guoxiang;He, Lingjun;Ding, Yang;Zheng, Qi;Zhou, Lei;Zhu, Huayue
关键词:BiOX; Antimicrobial capabilities; Mechanisms; ROS; Heterojunctions
-
Developing fluorescence hyperspectral imaging methods for non-invasive detection of herbicide safeners action mechanism and effectiveness
作者:Chu, Hangjian;Zhao, Yiying;Zhang, Xiaobin;Chu, Hangjian;Gouda, Mostafa;He, Yong;Li, Xiaoli;Liu, Yufei;Gouda, Mostafa;Li, Yu
关键词:Visible/near-infrared hyperspectral imaging; Chlorophyll a fluorescence; Chemometric analysis; Machine learning models
-
Application of deep learning for high-throughput phenotyping of seed: a review
作者:Jin, Chen;Zhang, Chu;Qi, Hengnian;Zhou, Lei;Pu, Yuanyuan;Zhao, Yiying
关键词:Seed phenotypes; Computer vision; Hyperspectral imaging; Convolutional neural networks; Transfer learning; Multi-dimensional data
-
Decontamination of Cr(VI) and tetracycline hydrochloride by Bi@NH2-MIL-88B-enhanced photocatalytic electron-rich microenvironment and its internal mechanism
作者:Yang, Guoxiang;Wang, Longyang;Gao, Mengyang;Liu, Aoxiang;Shen, Bo;Xiang, Zhuomin;Wang, Qi;Tang, Xiujuan;Zheng, Qi;Zhou, Lei;Ding, Yang;Hao, Derek
关键词:Bi@NM-88; SPR effect; Electron-rich; Compound pollution; Toxicity assessment
-
Deep learning-based regression of food quality attributes using near-infrared spectroscopy and hyperspectral imaging: A review
作者:Xiao, Yuxin;Qi, Hengnian;Zhang, Chu;Zhou, Lei;Zhao, Yiying;Pu, Yuanyuan
关键词:Deep learning for spectral data analysis; Non-destructive food quality prediction; Near-infrared spectroscopy and hyperspectral imaging regression models; Spectral feature extraction; Transfer learning; Data augmentation
-
Harnessing fungal bio-electricity: a promising path to a cleaner environment
作者:Umar, Aisha;Zhou, Lei;Umar, Aisha;Mubeen, Mustansar;Iftikhar, Yasir;Sajid, Ashara;Ali, Iftikhar;Sohail, Muhammad Aamir;Kumar, Ajay;Solanki, Manoj Kumar;Solanki, Manoj Kumar;Kumar Divvela, Praveen
关键词:catalyst; electricity; environment; fungi; fuel; heavy metals; soil



