基于人工智能的自动内镜下病灶尺寸测量系统(含视频)  

An artificial intelligence-based system for measuring the size of gastrointestinal lesions under endoscopy(with video)

作　　者：王静[1] 陈茜[1] 吴练练 周巍[1] 张晨霞 罗任权 于红刚[1] Wang Jing;Chen Xi;Wu Lianlian;Zhou Wei;Zhang Chenxia;Luo Renquan;Yu Honggang(Department of Gastroenterology,Renmin Hospital of Wuhan University Hubei Key Laboratory of Digestive Diseases Hubei Clinical Research Center for Minimally Invasive Diagnosis and Treatment of Digestive Diseases,Wuhan 430060,China)

机构地区：[1]武汉大学人民医院消化内科消化系统疾病湖北省重点实验室、湖北省消化疾病微创诊治医学临床研究中心,武汉430060

出　　处：《中华消化内镜杂志》2022年第12期965-971,共7页Chinese Journal of Digestive Endoscopy

基　　金：国家自然科学基金(81672387);湖北省消化疾病微创诊治医学临床研究中心项目(2018BCC337);湖北省重大科技创新项目(2018-916-000-008)。

摘　　要：目的开发一个基于人工智能的自动内镜下病灶尺寸测量系统,并测试其实时测量白光内镜下病灶尺寸的能力。方法测量系统由3个模型组成:首先由模型1识别视频的连续图片中有无活检钳,有钳者标记钳叶轮廓;随后由模型2对有钳图片进行分类,分为张钳图片和未张钳图片;与此同时,模型3识别视频的连续图片中有无病灶,有病灶者标记边界;最后系统根据活检钳钳叶轮廓与病灶边界的像素对比,实时计算出病灶尺寸。数据集1由回顾性收集的武汉大学人民医院2017年1月1日—2019年11月30日4835张图片组成,用于模型的训练和验证;数据集2由前瞻性收集的武汉大学人民医院内镜中心2019年12月1日—2020年6月4日检查拍摄的图片组成,用于测试模型分割活检钳边界和病灶边界的能力;数据集3由151个模拟病灶的302张图片组成,每个模拟病灶包括活检钳倾斜角度较大(与病灶垂直线夹角45°)和倾斜角度较小(与病灶垂直线夹角10°)情况下的图片各1张,用于测试模型在活检钳不同状态下测量病灶尺寸的能力;数据集4为视频测试集,由前瞻性收集的武汉大学人民医院内镜中心2019年8月5日—2020年9月4日检查拍摄的视频组成。以内镜医师复核后结果或内镜手术病理作为金标准,观察模型1识别有无活检钳的准确率、模型2分类活检钳状态(张钳或未张钳)的准确率和模型3识别有无病灶的准确率,用交并比(intersection over union,IoU)评价模型1的活检钳钳叶分割效果和模型3的病灶分割效果,用绝对误差和相对误差评价系统的病灶尺寸测量能力。结果(1)数据集2共纳入1252张图片,有钳图片821张(其中张钳图片401张、未张钳图片420张)、无钳图片431张;包含病灶图片640张、不包含病灶图片612张。模型1判断无钳图片433张(430张准确)、有钳图片819张(818张准确),识别有无活检钳的准确率为99.68%(1248/1252),以818张模�Objective To develop an artificial intelligence-based system for measuring the size of gastrointestinal lesions under white light endoscopy in real time.Methods The system consisted of 3 models.Model 1 was used to identify the biopsy forceps and mark the contour of the forceps in continuous pictures of the video.The results of model 1 were submitted to model 2 and classified into open and closed forceps.And model 3 was used to identify the lesions and mark the boundary of lesions in real time.Then the length of the lesions was compared with the contour of the forceps to calculate the size of lesions.Dataset 1 consisted of 4835 images collected retrospectively from January 1,2017 to November 30,2019 in Renmin Hospital of Wuhan University,which were used for model training and validation.Dataset 2 consisted of images collected prospectively from December 1,2019 to June 4,2020 at the Endoscopy Center of Renmin Hospital of Wuhan University,which were used to test the ability of the model to segment the boundary of the biopsy forceps and lesions.Dataset 3 consisted of 302 images of 151 simulated lesions,each of which included one image of a larger tilt angle(45°from the vertical line of the lesion)and one image of a smaller tilt angle(10°from the vertical line of the lesion)to test the ability of the model to measure the lesion size with the biopsy forceps in different states.Dataset 4 was a video test set,which consisted of prospectively collected videos taken from the Endoscopy Center of Renmin Hospital of Wuhan University from August 5,2019 to September 4,2020.The accuracy of model 1 in identifying the presence or absence of biopsy forceps,model 2 in classifying the status of biopsy forceps(open or closed)and model 3 in identifying the presence or absence of lesions were observed with the results of endoscopist review or endoscopic surgery pathology as the gold standard.Intersection over union(IoU)was used to evaluate the segmentation effect of biopsy forceps in model 1 and lesion segmentation effect in model 3,a

关 键 词：人工智能 内窥镜检查 消化系统 病灶尺寸 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程] TP391.41[自动化与计算机技术—控制科学与工程] R318[医药卫生—生物医学工程]