Joint optimization of AI large and small models for surface temperature and emissivity retrieval using knowledge distillation

文献类型： 外文期刊

第一作者： Dai, Wang

作者： Dai, Wang;Guo, Zhonghua;Xiao, Liurui;Dai, Wang;Mao, Kebiao;Qin, Zhihao;Shi, Jiancheng;Bateni, Sayed M.

作者机构：

关键词： Artificial intelligence; Large models; Knowledge distillation; Automated machine learning; Remote sensing parameter retrieval

期刊名称：ARTIFICIAL INTELLIGENCE IN AGRICULTURE （ 影响因子：12.4； 五年影响因子：12.7 ）

ISSN： 2097-2113

年卷期： 2025 年 15 卷 3 期

页码：

收录情况： SCI

摘要： The rapid advancement of artificial intelligence in domains such as natural language processing has catalyzed AI research across various fields. This study introduces a novel strategy, the AutoKeras-Knowledge Distillation (AKKD), which integrates knowledge distillation technology for joint optimization of large and small models in the retrieval of surface temperature and emissivity using thermal infrared remote sensing. The approach addresses the challenges of limited accuracy in surface temperature retrieval by employing a high-performance large model developed through AutoKeras as the teacher model, which subsequently enhances a less accurate small model through knowledge distillation. The resultant student model is interactively integrated with the large model to further improve specificity and generalization capabilities. Theoretical derivations and practical applications validate that the AK-KD strategy significantly enhances the accuracy of temperature and emissivity retrieval. For instance, a large model trained with simulated ASTER data achieved a Pearson Correlation Coefficient (PCC) of 0.999 and a Mean Absolute Error (MAE) of 0.348 K in surface temperature retrieval. In practical applications, this model demonstrated a PCC of 0.967 and an MAE of 0.685 K. Although the large model exhibits high average accuracy, its precision in complex terrains is comparatively lower. To ameliorate this, the large model, serving as a teacher, enhances the small model's local accuracy. Specifically, in surface temperature retrieval, the small model's PCC improved from an average of 0.978 to 0.979, and the MAE decreased from 1.065 K to 0.724 K. In emissivity retrieval, the PCC rose from an average of 0.827 to 0.898, and the MAE reduced from 0.0076 to 0.0054. This research not only provides robust technological support for further development of thermal infrared remote sensing in temperature and emissivity retrieval but also offers important references and key technological insights for the universal model construction of other geophysical parameter retrievals. (c) 2025 The Authors. Publishing services by Elsevier B.V. on behalf of KeAi Communications Co., Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序