ChatGPT作为医学教育工具的思考——以心血管内科主治医师资格考试为例  

Reflections on Using ChatGPT as A Medical Education Tool:A Case Study of the Board Certification Examination for Cardiovascular Medicine

作　　者：商鲁翔 薛茗月 孙华鑫 汤宝鹏[3] 侯应龙[1] SHANG Luxiang;XUE Mingyue;SUN Huaxin;TANG Baopeng;HOU Yinglong(Department of Cardiology,The First Affiliated Hospital of Shandong First Medical University&Shandong Provincial Qianfoshan Hospital/Shandong Medicine and Health Key Laboratory of Cardiac Electrophysiology and Arrhythmia,Jinan 250014,China;Zane Cohen Centre for Digestive Diseases,Mount Sinai Hospital,Toronto M5T3L9,Canada;Department of Pacing and Electrophysiology,The First Affiliated Hospital of Xinjiang Medical University,Urumqi 830054,China)

机构地区：[1]山东第一医科大学第一附属医院(山东省千佛山医院)心血管病学/山东省医药卫生心律失常重点实验室,山东济南250014 [2]西奈山医院Zane Cohen消化疾病中心,加拿大多伦多M5T3L9 [3]新疆医科大学第一附属医院起搏电生理科,新疆乌鲁木齐830054

出　　处：《医学与哲学》2024年第14期10-13,共4页Medicine and Philosophy

基　　金：2021年国家自然科学基金项目(82100343);2022年首都医科大学代谢紊乱相关心血管疾病北京市重点实验室开放课题(DXWL2022-04);2023年首都医科大学临床流行病学北京市重点实验室开放课题。

摘　　要：为评估人工智能语言模型ChatGPT在医学考试中的表现,采用横断面研究方法,将Chat-GPT回答的心血管主治医师资格考试的模拟试题结果与标准答案进行比对。在排除2道图片题后,ChatGPT正确回答了333道问题中的189道,准确率为56.8%,其在四个单元的回答正确率分别为67.0%、61.0%、58.2%及11.4%。逻辑错误是最常见的回答错误原因。题目属于第四单元、案例分析题是回答错误的影响因素。研究显示ChatGPT未通过心内科主治医师资格模拟考试,尚不推荐将其用于心血管内科医师的日常教育。In order to evaluate the performance of the artificial intelligence language model ChatGPT in medical examinations,a cross-sectional study was conducted comparing ChatGPT's answers to a set of simulated tests of Board Certification Examination for Cardiovascular Medicine with the standard answers.After excluding 2 picture questions,ChatGPT correctly answered 189 out of 333 questions,with an accuracy rate of 56.8%.The correct response rates across four sections were 67.0%,61.0%,58.2%and 11.4%respectively.Logical errors were the most common cause of incorrect answers.Factors influencing incorrect responses included questions from the fourth section and case analysis questions.Research shows that ChatGPT failed to pass the simulation examination of Board Certification Examination for Cardiovascular Medicine,and it is not recommended to be used in the routine education of cardiovascular physicians.

关 键 词：人工智能 医学教育 医学考试 临床医生 

分 类 号：R-05[医药卫生]