Expertise or Hallucination? A Comprehensive Evaluation of ChatGPT's Aptitude in Clinical Genetics
文献类型: 外文期刊
作者: Zhang, Yingbo 1 ; Ren, Shumin 1 ; Wang, Jiao 1 ; Zhan, Chaoying 1 ; He, Mengqiao 1 ; Liu, Xingyun 1 ; Wu, Rongrong 1 ; Zhao, Jing 1 ; Wu, Cong 1 ; Fan, Chuanzhu 5 ; Shen, Bairong 1 ;
作者机构: 1.Sichuan Univ, West China Hosp, Frontiers Sci Ctr Dis Related Mol Network, Dept Urol, Chengdu 610017, Peoples R China
2.Sichuan Univ, West China Hosp, Inst Syst Genet, Frontiers Sci Ctr Dis Related Mol Network, Chengdu 610017, Peoples R China
3.Chinese Acad Trop Agr Sci CATAS, Trop Crops Genet Resources Inst, Haikou 571101, Peoples R China
4.Univ A Coruna, Dept Comp Sci & Informat Technol, La Coruna 15008, Spain
5.Wayne State Univ, Dept Biol Sci, Detroit, MI 48202 USA
关键词: Genetics; Diseases; Chatbots; Market research; Biological cells; Databases; Testing; Accuracy; Medical diagnostic imaging; Big Data; Clinical genetics; ChatGPT (chat generative pre-trained transformer); genetic diseases; pathogenic gene; chromosomal abnormalities; knowledge hallucination
期刊名称:IEEE TRANSACTIONS ON BIG DATA ( 影响因子:5.7; 五年影响因子:5.7 )
ISSN: 2332-7790
年卷期: 2025 年 11 卷 3 期
页码:
收录情况: SCI
摘要: Whether viewed as an expert or as a source of 'knowledge hallucination', the use of ChatGPT in medical practice has stirred ongoing debate. This study sought to evaluate ChatGPT's capabilities in the field of clinical genetics, focusing on tasks such as 'Clinical genetics exams', 'Associations between genetic diseases and pathogenic genes', and 'Limitations and trends in clinical genetics'. Results indicated that ChatGPT performed exceptionally well in question-answering tasks, particularly in clinical genetics exams and diagnosing single-gene diseases. It also effectively outlined the current limitations and prospective trends in clinical genetics. However, ChatGPT struggled to provide comprehensive answers regarding multi-gene or epigenetic diseases, particularly with respect to genetic variations or chromosomal abnormalities. In terms of systematic summarization and inference, some randomness was evident in ChatGPT's responses. In summary, while ChatGPT possesses a foundational understanding of general knowledge in clinical genetics due to hyperparameter learning, it encounters significant challenges when delving into specialized knowledge and navigating the complexities of clinical genetics, particularly in mitigating 'Knowledge Hallucination'. To optimize its performance and depth of expertise in clinical genetics, integration with specialized knowledge databases and knowledge graphs is imperative.
- 相关文献
作者其他论文 更多>>
-
Aligning Large Language Models with Humans: A Comprehensive Survey of ChatGPT's Aptitude in Pharmacology
作者:Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Lu, Junyu;Wu, Cong;He, Mengqiao;Liu, Xingyun;Wu, Rongrong;Zhao, Jing;Zhan, Chaoying;Singla, Rajeev K.;Shen, Bairong;Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Lu, Junyu;Wu, Cong;He, Mengqiao;Liu, Xingyun;Wu, Rongrong;Zhao, Jing;Zhan, Chaoying;Singla, Rajeev K.;Shen, Bairong;Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Liu, Xingyun;Du, Dan;Zhan, Zhajun;Singla, Rajeev K.
关键词:
-
EgSnRK2-EgARF18-EgFAD2 regulatory axis fine-tunes unsaturated fatty acid metabolism in oil palm (Elaeis guineensis)
作者:Zheng, Yusheng;Liu, Xingxin;Li, Xiangning;Zhao, Jing;Li, Dongdong;Zheng, Yusheng;Xu, Fangzhou;Zou, Jixin
关键词:Oil palm; Oeic acid; Linoleic acid; EgSnRK2; EgARF18; EgFAD2
-
Improving large language models for miRNA information extraction via prompt engineering
作者:Wu, Rongrong;Zong, Hui;Wu, Erman;Li, Jiakun;Zhou, Yi;Zhang, Chi;Zhang, Yingbo;Wang, Jiao;Tang, Tong;Shen, Bairong;Wu, Rongrong;Zong, Hui;Wu, Erman;Li, Jiakun;Zhou, Yi;Zhang, Chi;Zhang, Yingbo;Wang, Jiao;Tang, Tong;Shen, Bairong;Wu, Rongrong;Wu, Erman;Zhang, Chi;Zhang, Yingbo;Shen, Bairong
关键词:MicroRNA; Cancer; Large language models; Information extraction; Datasets; Prompt engineering
-
The comprehensive clinical benefits of digital phenotyping: from broad adoption to full impact
作者:Zhang, Yingbo;Wang, Jiao;Zong, Hui;Liu, Xingyun;Wu, Rongrong;Ren, Shumin;Shen, Bairong;Zhang, Yingbo;Wang, Jiao;Zong, Hui;Singla, Rajeev K.;Ullah, Amin;Liu, Xingyun;Wu, Rongrong;Ren, Shumin;Shen, Bairong;Zhang, Yingbo;Wang, Jiao;Liu, Xingyun;Singla, Rajeev K.;Ullah, Amin;Singla, Rajeev K.;Shen, Bairong
关键词:
-
Combination of the Parasitoid Spalangia endius Walker and Chemical Pesticides for the Control of Zeugodacus cucurbitae (Coquillett)
作者:Li, Lei;Han, Dongyin;Zhao, Jing;Qiu, Haiyan;Zhang, Fangping;Ye, Zhengpei;Fu, Yueguan;Fu, Yueguan
关键词:melon fly; pupal parasitoid; abamectin; toxicity
-
OligoM-Cancer: A multidimensional information platform for deep phenotyping of heterogenous oligometastatic cancer
作者:Wu, Rongrong;Zong, Hui;Feng, Weizhe;Zhang, Ke;Li, Jiakun;Wu, Erman;Tang, Tong;Zhan, Chaoying;Liu, Xingyun;Zhou, Yi;Zhang, Chi;Zhang, Yingbo;He, Mengqiao;Ren, Shumin;Shen, Bairong;Wu, Rongrong;Zong, Hui;Feng, Weizhe;Zhang, Ke;Li, Jiakun;Wu, Erman;Tang, Tong;Zhan, Chaoying;Liu, Xingyun;Zhou, Yi;Zhang, Chi;Zhang, Yingbo;He, Mengqiao;Ren, Shumin;Shen, Bairong;Tang, Tong;Liu, Xingyun;Zhang, Chi;Zhang, Yingbo
关键词:Oligometastatic cancer; Metastasis; Knowledge platform; Disease heterogeneity; Personalized treatment
-
Environmental exposure to cadmium induces olfactory neurotoxicity in fire ants and the molecular basis
作者:Xiao, Xiaohui;Zhao, Wenzhen;Shao, Yikang;Hu, Changyuan;Liu, Jinlong;Zhang, Guoqing;Wang, Man-Qun;Zhou, Aiming;Yang, Fuxiang;Zhao, Jing;Fu, Yueguan;Li, Lei;Fu, Yueguan
关键词:Cd contamination; Odor binding proteins; Electroantennography; Single sensillum recording; Olfactory signal transduction; Active bait odorants



