Veg-DenseCap: Dense Captioning Model for Vegetable Leaf Disease Images

文献类型： 外文期刊

第一作者： Sun, Wei

作者： Sun, Wei;Wang, Chunshan;Gu, Jingqiu;Sun, Xiang;Sun, Wei;Wang, Chunshan;Gu, Jingqiu;Sun, Xiang;Sun, Wei;Wang, Chunshan;Gu, Jingqiu;Sun, Xiang;Sun, Wei;Wang, Chunshan;Li, Jiuxi;Liang, Fangfang

作者机构：

关键词： image captioning; disease detection; text generation; Faster R-CNN; attention mechanism

期刊名称：AGRONOMY-BASEL （ 影响因子：3.7； 五年影响因子：4.0 ）

ISSN：

年卷期： 2023 年 13 卷 7 期

页码：

收录情况： SCI

摘要： The plant disease recognition model based on deep learning has shown good performance potential. However, high complexity and nonlinearity lead to the low transparency and poor interpretability of such models. These limitations greatly limit the deployment and application of such models in field scenarios. To solve the above problems, we propose a dense caption generative model, Veg DenseCap. This model takes vegetable leaf images as input and uses object detection technology to locate abnormal parts of the leaf and identify the disease results. More importantly, it can describe the disease features it sees in natural language, and users can judge whether the relevant features are semantically consistent with human cognition based on these descriptions. First of all, a dataset containing Chinese feature description statements for images of 10 leaf diseases involving two vegetables (cucumber and tomato) was established. Secondly, Faster R-CNN was used as a disease detector to extract visual features of diseases, and LSTM was used as a language generator to generate description statements for disease features. Finally, the Convolutional Block Attention Module (CBAM) and the Focal Loss function were employed to overcome the imbalance between positive and negative samples and the weak performance of Faster R-CNN in obtaining key features. According to the test results, the Intersection-over-Union (IoU) and Meteor joint evaluation index of Veg-DenseCap achieved a mean Average Precision (mAP) of 88.0% on the dense captioning dataset of vegetable leaf disease images, which is 9.1% higher than that of the classical FCLN model. The automatically generated description statements are characterized by advantages of accurate feature description, correct grammar, and high diversity.

分类号：

  • 相关文献
作者其他论文 更多>>
  • Impact of residual antibiotics on microbial decomposition of livestock manures in Eutric Regosol: Implications for sustainable nutrient recycling and soil carbon sequestration

    作者：Fang, Linfa;Lakshmanan, Prakash;Su, Xiaoxuan;Shi, Yujia;Chen, Zheng;Zhang, Yu;Xiao, Ran;Chen, Xinping;Lakshmanan, Prakash;Wu, Junxi;Lakshmanan, Prakash;Lakshmanan, Prakash;Sun, Wei

    关键词：Residual antibiotics; Livestock manure decomposition; Microbial community; Co -occurrence network; Enzyme activities

  • Extreme drought impacts have been underestimated in grasslands and shrublands globally

    作者：Smith, Melinda D.;Knapp, Alan K.;Ohlert, Timothy;Smith, Melinda D.;Knapp, Alan K.;Wilkins, Kate D.;Holdrege, Martin C.;Beard, Karen H.;Kulmatiski, Andrew;Holdrege, Martin C.;Beard, Karen H.;Kulmatiski, Andrew;Wilfahrt, Peter;Anderson, Maggie;Borer, Elizabeth T.;Isbell, Forest;Seabloom, Eric W.;Collins, Scott L.;Sala, Osvaldo E.;Jordan, Samuel;Dukes, Jeffrey S.;Phillips, Richard P.;Beier, Claus;Yahdjian, Laura;Biancari, Lucio;Bondaruk, Viviana Florencia;Onatibia, Gaston R.;Pineiro-Guerra, Juan Manuel;Gherardi, Laureano A.;Larsen, Klaus Steenberg;Fraser, Lauchlan H.;Jentsch, Anke;Niu, Yujie;Loik, Michael E.;Maestre, Fernando T.;Valdecantos, Alejandro;Maestre, Fernando T.;Gozalo, Beatriz;Maturano-Ruiz, Adrian;Valdecantos, Alejandro;Power, Sally A.;Chieppa, Jeff;Nielsen, Uffe N.;Yu, Qiang;Felton, Andrew J.;Munson, Seth M.;Luo, Yiqi;Bauerle, Taryn;Abdoli, Hamed;Abedi, Mehdi;Bahalkeh, Khadijeh;Alados, Concepcion L.;Castillo-Garcia, Miguel;Pueyo, Yolanda;Alberti, Juan;Bruschetti, Carlos Martin;Cardoni, Augusto;Daleo, Pedro;Iribarne, Oscar;Alon, Moshe;Cohen, Ofer;Sternberg, Marcelo;An, Hui;Anacker, Brian;Auge, Harald;Auge, Harald;Eisenhauer, Nico;Hoss, Daniela;Roscher, Christiane;Sunnemann, Marie;Bachle, Seton;Bachle, Seton;Bahn, Michael;Ingrisch, Johannes;Batbaatar, Amgaa;Cahill, James F., Jr.;Batbaatar, Amgaa;Bork, Edward W.;Carlyle, Cameron N.;Behn, Kai;Beil, Ilka;Kreyling, Juergen;Malyshev, Andrey V.;Blindow, Irmgard;Dahlke, Sven;Byrne, Kerry M.;Calvo, Dianela A.;Leder, Cintia V.;Peter, Guadalupe;Carbognani, Michele;Forte, T'ai G. W.;Petraglia, Alessandro;Chang, Scott X.;Cianciaruso, Marcus V.;Guidoni-Martins, Karlo G.;Nobre, Paola;Cordeiro, Amanda L.;Cusack, Daniela F.;Dietterich, Lee H.;D'Antonio, Carla M.;Dietterich, Lee H.;Doherty, Tim S.;Greenville, Aaron C.;Wardle, Glenda M.;Dubbert, Maren;Ebeling, Anne;Eisenhauer, Nico;Fischer, Felicia M.;Hoss, Daniela;Sunnemann, Marie;Hoss, Daniela;Pillar, Valerio D.;Fischer, Felicia M.;Gebauer, Tobias;Anacker, Brian;Haugum, Siri Vatso;Vandvik, Vigdis;Hautier, Yann;Hefting, Mariet;Henry, Hugh A. L.;Johnson, Yari;Kelly, Eugene F.;Kimmel, Kaitlin;Kroel-Dulay, Gyorgy;Orban, Ildiko;Kroel-Dulay, Gyorgy;Orban, Ildiko;Kubert, Angelika;Werner, Christiane;Lamb, Eric G.;Larson, Julie;O'Connor, Rory C.;Lawson, Jason;Plowes, Robert M.;Linstadter, Anja;Orban, Ildiko;Liu, Jielin;Liu, Shirong;Longo, Grisel;Loydi, Alejandro;Rodriguez, Dana Aylen;Scarfo, Maria Cecilia;Luan, Junwei;Wang, Yi;Luan, Junwei;Wang, Yi;Lubbe, Frederick Curtis;Wiehl, Georg;Mackie-Haas, Kathleen;Stampfi, Andreas;Merchant, Thomas;Metcalfe, Daniel B.;Mori, Akira S.;Mori, Akira S.;Mudongo, Edwin;Newman, Gregory S.;Souza, Lara;Nimmo, Dale;Ogaya, Roma;Penuelas, Josep;Osborne, Brooke;Otfinowski, Rafael;Partel, Meelis;Pineiro-Guerra, Juan Manuel;Peri, Pablo L.;Picon-Cochard, Catherine;Pineiro-Guerra, Juan Manuel;Ploughe, Laura W.;Portales-Reyes, Cristy;Reed, Sasha C.;Ritchie, Euan G.;Roscher, Christiane;Sanchez, Ana M.;Santo, Braulio A.;Shi, Baoku;Sun, Wei;Souza, Lara;Standish, Rachel J.;Zeiter, Michaela;Stampfi, Andreas;Zeiter, Michaela;Standish, Rachel J.;Tedder, Michelle;Thorvaldsen, Pal;Tian, Dashuan;Zhu, Juntao;Zong, Ning;Tielborger, Katja;van den Brink, Liesbeth;Vankoughnett, Mathew R.;Velle, Liv Guri;Wang, Changhui;Wei, Cunzheng;Williams, Jennifer L.;Wolf, Amelia A.;Zhang, Fawei;Zuo, Xiaoan;Zuo, Xiaoan;Gebauer, Tobias;Ploughe, Laura W.

    关键词：climate extreme; Drought-Net; International Drought Experiment; productivity

  • miR-329b-5p Affects Sheep Intestinal Epithelial Cells against Escherichia coli F17 Infection

    作者：Xu, Yeling;Chen, Weihao;Sun, Wei;Yang, Huiguo;Song, Zhenghai;Wang, Yeqing;Su, Rui;Mwacharo, Joram M.;Lv, Xiaoyang;Sun, Wei;Lv, Xiaoyang;Sun, Wei

    关键词：Escherichia coli F17; micro RNA; sheep diarrhea; intestinal epithelial cells

  • A Cucumber Leaf Disease Severity Grading Method in Natural Environment Based on the Fusion of TRNet and U-Net

    作者：Yao, Hui;Wang, Chunshan;Liu, Bo;Liang, Fangfang;Yao, Hui;Wang, Chunshan;Liu, Bo;Liang, Fangfang;Wang, Chunshan;Zhang, Lijie;Li, Jiuxi

    关键词：cucumber disease; disease spot; fusion of TRNet and U-Net; two-stage segmentation framework; disease severity grading

  • Variations in antibiotic resistomes associated with archaeal, bacterial, and viral communities affected by integrated rice-fish farming in the paddy field ecosystem

    作者：Hou, Yiran;Jia, Rui;Sun, Wei;Feng, Wenrong;Li, Bing;Zhu, Jian;Hou, Yiran;Diao, Weixu;Jia, Rui;Feng, Wenrong;Li, Bing;Zhu, Jian

    关键词：Antibiotic resistomes; Antibiotic resistance genes (ARGs); Agricultural production patterns; Clean and sustainable agricultural production; Integrated rice-fish farming; Paddy field; Archaeal; Bacterial; And viral communities

  • Bifidobacterium mediate gut microbiota-remedied intestinal barrier damage caused by cyproconazole in zebrafish (Danio rerio)

    作者：Sun, Xiaoxuan;Sun, Wei;Miao, Jiyan;Yue, Yifan;Han, Shihang;Huang, Shiran;Diao, Jinling;Zhou, Zhiqiang;Zhu, Wentao;Tian, Sinuo;Yan, Sen;Xu, Ning

    关键词：Acetate; Bifidobacterium; Cyproconazole; Gut microbiota; Metabolomics analysis

  • The Role of BMP7 in the Proliferation of Hu Sheep Dermal Papilla Cells Is Influenced by DNA Methylation

    作者：Lv, Xiaoyang;Sun, Wei;Lv, Xiaoyang;He, Mingliang;Wang, Shanhe;Sun, Wei;Lv, Xiaoyang;Wang, Shanhe;Sun, Wei;Zheng, Wenxin;Zhou, Hanlin;Mwacharo, Joram M.

    关键词：Hu sheep; lamb skin; BMP7 gene; methylation; dermal papilla cell

微信小程序