A Zero-Shot Deep Learning-Supported Sensing System for Crop Seeds and Berries Phenotyping

文献类型： 外文期刊

第一作者： Zhou, Lei

作者： Zhou, Lei;Zhang, Huichun;Bian, Liming;Zhao, Yiying;Xiao, Qinlin

作者机构：

关键词： Image segmentation; Training; Hyperspectral imaging; Annotations; Sensors; Manuals; Seeds (agriculture); Instance segmentation; Imaging; Databases; Berry; computer vision; grain; hyperspectral imaging; image synthesis; instance segmentation

期刊名称：IEEE SENSORS JOURNAL （ 影响因子：4.5； 五年影响因子：4.7 ）

ISSN： 1530-437X

年卷期： 2024 年 24 卷 24 期

页码：

收录情况： SCI

摘要： Hyperspectral imaging, the fusion of vibrational spectral sensing and computer vision, could simultaneously detect the light absorption caused by the molecular vibration transition of chemical bonds as well as the appearance of the target sample. Coupled with artificial intelligence (AI), it is widely used for quality inspection of agricultural products. Sufficient samples with true quality indicators are required for AI model training. An efficient and low-cost approach for single-object extraction in the image is urgently needed. In this study, a zero-shot learning instance segmentation method was proposed for seeds and berries extraction in images of densely arranged samples. The image-annotation pairs for model training were synthesized by combining the objects in a sample pool. Typical segmentation methods including YoloV8-segment, MaskRCNN, and UNet were studied and compared. All these models were trained and optimized using the synthetic datasets and evaluated using real images. Another popular zero-shot learning method segment anything model (SAM) was also studied for comparison. Satisfactory performances were observed on wheat seed extraction in the processing of VIS/NIR hyperspectral images, NIR hyperspectral images, and regular color images. The zero-shot learning-based YoloV8-segment model reached the highest performance on wheat seed segmentation, with mAP50 values from 0.96 to 0.98. Further experiments on image segmentation of lotus seeds, grape berries, and cherry tomatoes also proved its effectiveness. The presented methods could achieve ultrahigh-speed image or spectral database construction of approximate ellipsoid seeds and berries, further promoting the improvement of the efficiency of high-throughput agricultural products phenotyping system.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序