评价ChatGPT对幽门螺杆菌感染问题回答的适当性  

To evaluate the appropriateness of ChatGPT in answering questions about Helicobacter pylori infection

作　　者：朱戈淇 刘浩[1] 齐翠花[1] 陈卫刚[1] 田书信[1] 尚国臣[1] Zhu Geqi;Liu Hao;Qi Cuihua;Chen Weigang;Tian Shuxin;Shang Guochen(Department of Gastroenterology,First Affiliated Hospital of Shihezi University,Shihezi,Xinjiang 832000,China)

机构地区：[1]石河子大学第一附属医院消化内科,新疆石河子832000

出　　处：《新疆医学》2025年第3期265-269,共5页Xinjiang Medical Journal

基　　金：石河子大学校级科研项目(项目编号:ZZZC202193);兵团重点领域科技攻关项目(项目编号:2023AB056)。

摘　　要：目的评价Chat GPT对幽门螺杆菌感染治疗及预防相关问题回答的适当性。方法本研究是通过创建20个关于幽门螺杆菌感染治疗及预防的问题,将每个问题向Chat GPT-4o人工智能聊天机器人页面提问3次,并将全部回答进行汇总后制作成word文档,由3名消化内科专家对全部回答进行适当性评价(包括评级和评分)。结果在向Chat GPT-4o提问的20个问题中,有19个问题(95%)的回答被评级为“适当”,有1个问题(5%)的回答被评级为“不适当”。而在被评级为“不适当”的1个问题中,其提问的3次回答均被认为“不准确”。在被评级为“适当”的所有问题中,有18个问题(94.7%)的平均分≥4.0分,有1个问题(5.3%)的平均分在3.5-4.0分之间,其中有15个问题(78.9%)的平均分为5.0分。结论本研究所涉及的有关幽门螺杆菌感染治疗及预防的问题,Chat GPT的回答具有一定的临床指导意义,但仍有部分问题的回答存在一定的不准确性,仍需要进一步的训练和完善来弥补其局限性。Objective To evaluate the appropriateness of Chat GPT in answering questions related to the treatment and prevention of Helicobacter pylori infection.Methods This study created 20 questions about the treatment and prevention of Helicobacter pylori infection.Each question was asked three times to Chat GPT-4o AI chat robot page,and all the answers were summarized and made into word documents.Three gastroenterologists evaluated the appropriateness of all the answers(including rating and scoring).Results Among the 20 questions asked to Chat GPT-4o,19 questions(95%)were rated as"appropriate"and 1 question(5%)was rated as"inappropriate".In the one question rated as"inappropriate",the three answers to the question were considered"inaccurate".Among all the questions rated as"appropriate",18 questions(94.7%)had an average score of≥4.0,1 question(5.3%)had an average score of 3.5-4.0,and 15 questions(78.9%)had an average score of 5.0.Conclusion The answers of Chat GPT to the questions related to the treatment and prevention of Helicobacter pylori infection involved in this study have certain clinical guiding significance,but there are still some inaccuracies in the answers to some questions,which still need further training and improvement to make up for its limitations.

关 键 词：Chat GPT 幽门螺杆菌感染 治疗 预防 人工智能 

分 类 号：R573.9[医药卫生—消化系统]