您好，欢迎访问北京市农林科学院 机构知识库！
北京市农林科学院机构知识库

全部

  • 全部
  • 标题
  • 学者
  • 机构
  • 关键词

A Hybrid Approach for Soil Total Nitrogen Anomaly Detection Integrating Machine Learning and Spatial Statistics

文献类型： 外文期刊

作者： Zheng, Wengang 1 ; Lan, Renping 1 ; Zhangzhong, Lili 3 ; Yang, Linnan 4 ; Gao, Lutao 4 ; Yu, Jingxin 3 ;

作者机构： 1.Jiangsu Univ, Sch Agr Engn, Zhenjiang 212013, Peoples R China

2.Natl Engn Res Ctr Informat Technol Agr, Beijing 100097, Peoples R China

3.Natl Engn Res Ctr Intelligent Equipment Agr, Beijing 100097, Peoples R China

4.Yunnan Agr Univ, Sch Big Data, Kunming 650201, Peoples R China

关键词： soil total nitrogen; outlier identification; Isolation Forest; local spatial autocorrelation; hybrid modelling

期刊名称：AGRONOMY-BASEL （ 影响因子：3.7； 五年影响因子：4.0 ）

ISSN：

年卷期： 2023 年 13 卷 11 期

页码：

收录情况： SCI

摘要： Soil total nitrogen is one of the most important basic indicators for fertiliser decision making, but tens of millions of soil total nitrogen sampling data have been accumulated, forming a huge database. In this large database, there is a large amount of anomalous data, which can interfere with data analysis, affect the construction of spatial interpolation and prediction models, and then affect the accuracy of nutrient management decisions. The traditional method of identifying soil total nitrogen anomalies based on boxplots suffers from the problems of not being able to identify local anomalies, which can easily lead to misclassification of soil total nitrogen data anomalies, and the detection efficiency is not high. We propose a method to identify soil total nitrogen outliers by combining the Isolation Forest algorithm and local spatial autocorrelation analysis, which can simultaneously detect global and local outliers from large amounts of data and combine organic matter as an auxiliary indicator in the spatial analysis to help judge local outliers. Finally, the results of global and local anomalies were combined to provide a comprehensive assessment of the soil nitrogen data, avoiding the misjudgement or omission of judgement that can occur when using a single method. Using 25,930 soil test data from Yunnan Province in 2009 as an example, we compared and analysed the typical boxplot method and the unsupervised OneClassSVM method and evaluated the performance of each method in terms of correct detection rate, false positive rate and false negative rate. The results show that the proposed method has a correct detection rate (TR) of 99.97%, a false positive rate (FPR) of 8.06% and a false negative rate (FNR) of 0.01% on the data, which shows high validity and accuracy; it is also comparable to the independent isolated forests (FNR = 4.76%), boxplot (FNR = 3.90%) and OneClassSVM (FNR = 4.77%), and the false negative rate is reduced by 4.75%, 3.89% and 4.76%, respectively.

  • 相关文献
作者其他论文 更多>>
置顶
购物车
反馈

© 京ICP备09089781号-29 主办单位：北京市农林科学院

学术资源： 中国农业科学院 农业专业知识服务系统 农科联盟资源共建共享平台 中国农业科技文献与信息服务平台 中国农业期刊集成服务平台