Lightweight CNN combined with knowledge distillation for the accurate determination of black tea fermentation degree

文献类型： 外文期刊

第一作者： Ding, Zezhong

作者： Ding, Zezhong;Yang, Chongshan;Guo, Mengqi;Wang, Mengjie;Tian, Zhengrui;Chen, Zhiwei;Dong, Chunwang;Ding, Zezhong;Hu, Bin;Li, Jinggang;Wang, Mengjie;Tian, Zhengrui;Dong, Chunwang

作者机构：

关键词： Black tea; Fermentation discrimination; Lightweight; CNN; Focal Loss; Knowledge distillation

期刊名称：FOOD RESEARCH INTERNATIONAL （ 影响因子：8.0； 五年影响因子：8.5 ）

ISSN： 0963-9969

年卷期： 2024 年 194 卷

页码：

收录情况： SCI

摘要： Black tea is the second most common type of tea in China. Fermentation is one of the most critical processes in its production, and it affects the quality of the finished product, whether it is insufficient or excessive. At present, the determination of black tea fermentation degree completely relies on artificial experience. It leads to inconsistent quality of black tea. To solve this problem, we use machine vision technology to distinguish the degree of fermentation of black tea based on images, this paper proposes a lightweight convolutional neural network (CNN) combined with knowledge distillation to discriminate the degree of fermentation of black tea. After comparing 12 kinds of CNN models, taking into account the size of the model and the performance of discrimination, as well as the selection principle of teacher models, Shufflenet_v2_x1.0 is selected as the student model, and Efficientnet_v2 is selected as the teacher model. Then, CrossEntropy Loss is replaced by Focal Loss. Finally, for Distillation Loss ratios of 0.6, 0.7, 0.8, 0.9, Soft Target Knowledge Distillation (ST), Masked Generative Distillation (MGD), Similarity-Preserving Knowledge Distillation (SPKD), and Attention Transfer (AT) four knowledge distillation methods are tested for their performance in distilling knowledge from the Shufflenet_v2_x1.0 model. The results show that the model discrimination performance after distillation is the best when the Distillation Loss ratio is 0.8 and the MGD method is used. This setup effectively improves the discrimination performance without increasing the number of parameters and computation volume. The model's P, R and F1 values reach 0.9208, 0.9190 and 0.9192, respectively. It achieves precise discrimination of the fermentation degree of black tea. This meets the requirements of objective black tea fermentation judgment and provides technical support for the intelligent processing of black tea.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序