Expertise or Hallucination? A Comprehensive Evaluation of ChatGPT's Aptitude in Clinical Genetics

文献类型： 外文期刊

第一作者： Zhang, Yingbo

作者： Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Zhan, Chaoying;He, Mengqiao;Liu, Xingyun;Wu, Rongrong;Zhao, Jing;Wu, Cong;Shen, Bairong;Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Zhan, Chaoying;He, Mengqiao;Liu, Xingyun;Wu, Rongrong;Zhao, Jing;Wu, Cong;Shen, Bairong;Zhang, Yingbo;Ren, Shumin;Wang, Jiao;Liu, Xingyun;Fan, Chuanzhu

作者机构：

关键词： Genetics; Diseases; Chatbots; Market research; Biological cells; Databases; Testing; Accuracy; Medical diagnostic imaging; Big Data; Clinical genetics; ChatGPT (chat generative pre-trained transformer); genetic diseases; pathogenic gene; chromosomal abnormalities; knowledge hallucination

期刊名称：IEEE TRANSACTIONS ON BIG DATA （ 影响因子：5.7； 五年影响因子：5.7 ）

ISSN： 2332-7790

年卷期： 2025 年 11 卷 3 期

页码：

收录情况： SCI

摘要： Whether viewed as an expert or as a source of 'knowledge hallucination', the use of ChatGPT in medical practice has stirred ongoing debate. This study sought to evaluate ChatGPT's capabilities in the field of clinical genetics, focusing on tasks such as 'Clinical genetics exams', 'Associations between genetic diseases and pathogenic genes', and 'Limitations and trends in clinical genetics'. Results indicated that ChatGPT performed exceptionally well in question-answering tasks, particularly in clinical genetics exams and diagnosing single-gene diseases. It also effectively outlined the current limitations and prospective trends in clinical genetics. However, ChatGPT struggled to provide comprehensive answers regarding multi-gene or epigenetic diseases, particularly with respect to genetic variations or chromosomal abnormalities. In terms of systematic summarization and inference, some randomness was evident in ChatGPT's responses. In summary, while ChatGPT possesses a foundational understanding of general knowledge in clinical genetics due to hyperparameter learning, it encounters significant challenges when delving into specialized knowledge and navigating the complexities of clinical genetics, particularly in mitigating 'Knowledge Hallucination'. To optimize its performance and depth of expertise in clinical genetics, integration with specialized knowledge databases and knowledge graphs is imperative.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序