基于深度学习的恒牙牙菌斑智能判读系统的建立及其相关影响因素分析  

Deep learning-based dental plaque detection on permanent teeth and the influenced factors

作　　者：游文喆 郝爱民[2] 李帅[2] 张子一 李若竹 孙瑞青 王勇[3] 夏斌[1] You Wenzhe;Hao Aimin;Li Shuai;Zhang Ziyi;Li Ruozhu;Sun Ruiqing;Wang Yong;Xia Bin(Department of Pediatric Dentistry,Peking University School and Hospital of Stomatology&National Center of Stomatology&National Clinical Research Center for Oral Diseases&National Engineering Laboratory for Digital and Material Technology of Stomatology&Beijing Key Laboratory of Digital Stomatology,Beijing 100081,China;State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Beijing 100191,China;Center for Digital Dentistry,Peking University School and Hospital of Stomatology&National Center of Stomatology&National Clinical Research Center for Oral Diseases&National Engineering Laboratory for Digital and Material Technology of Stomatology&Research Center of Engineering and Technology for Computerized Dentistry Ministry of Health&Beijing Key Laboratory of Digital Stomatology,Beijing 100081,China)

机构地区：[1]北京大学口腔医学院·口腔医院儿童口腔科,国家口腔医学中心,国家口腔疾病临床医学研究中心,口腔数字化医疗技术和材料国家工程实验室,口腔数字医学北京市重点实验室,100081 [2]北京航空航天大学,虚拟现实技术与系统国家重点实验室,100191 [3]北京大学口腔医学院·口腔医院口腔医学数字化研究中心,国家口腔医学中心,国家口腔疾病临床医学研究中心,口腔数字化医疗技术和材料国家工程实验室,国家卫生健康委口腔医学计算机应用工程技术研究中心,口腔数字医学北京市重点实验室,100081

出　　处：《中华口腔医学杂志》2021年第7期665-671,共7页Chinese Journal of Stomatology

基　　金：首都卫生发展科研专项(首发2020-2-4105)。

摘　　要：目的建立基于人工智能技术的牙菌斑智能判读系统,分析影响其判读结果的相关因素。方法2018年10月至2019年6月用家用口腔内镜(1280×960像素,东莞立港医疗器材有限公司)拍摄北京大学口腔医学院的25名研究生志愿者[男性12名,女性13名,年龄(23±3)岁]口内牙齿唇颊侧照片,使用菌斑染色剂(Cimedical,日本)进行菌斑染色后,用同样拍摄方法再次拍摄照片,共收集符合纳入标准的549组恒牙牙菌斑染色前后的牙齿照片。将549组图像采用随机数字表法分为440组训练数据集和109组测试数据集。设计并实现基于DeepLab的深度学习模型,采用LabelMe软件(Windows版3.2.1,MIT,美国)进行标注,对标注后的440组训练数据集进行训练,并据此建立恒牙牙菌斑智能判读系统,使用平均交并比(mean intersection over union,MIoU)作为评估该算法识别准确性的量化指标,用建立的恒牙牙菌斑智能判读系统对109组测试照片进行判读。使用Matlab软件(Windows版R2017a,MathWorks,美国)提取109组照片的牙菌斑边缘线,计算菌斑边缘线像素点个数,以此衡量牙菌斑边缘的复杂性,并计算牙菌斑面积百分比。基于多元线性回归分析牙位、牙菌斑面积百分比、牙菌斑边缘线像素点个数、镜头光源光斑是否位于菌斑区域对于恒牙牙菌斑判读准确性的影响,通过方差检验比较模型调整后的决定系数R2选择拟合效果更优的模型。结果恒牙牙菌斑智能判读系统对测试组判读的MIoU值为0.700±0.191。当牙菌斑面积百分比、牙菌斑边缘线像素点个数进入回归模型时,R2值为0.491,高于只有牙菌斑百分比进入模型时的R2,牙菌斑面积百分比、牙菌斑边缘线像素点个数对恒牙牙菌斑判读准确性有显著影响(P<0.05)。牙菌斑边缘线像素点个数的标准化系数为-0.289,菌斑面积百分比的标准化系数为-0.551。结论本研究通过家用口腔内镜采集的恒牙牙面图像构建�Objective To develop an artificial intelligence system for detecting dental plaque on permanent teeth and find the influenced factors.Methods Photos of the labial or buccal surfaces of the permanent teeth were taken by using an intraoral camera(1280×960 pixels;TPC Ligang,Shenzhen,China)before and after applying the plaque-disclosing agent(Cimedical,Japan)in 25 volunteers[12 males,13 femals,aged(23±3)years]recruided in accordance with the inclusion criteria from the students of Peking University School of Stomatology from October 2018 to June 2019.A total of 549 groups of photos were captured and then divided into a training dataset containing 440 groups of photos and a test dataset including 109 groups of photos.The scopes of teeth and dental plaque on photos were labeled using LabelMe(Windows 3.2.1,MIT,U S A).A DeepLab based deep learning system was designed for the intelligent detection of dental plaque on permanent teeth.The mean intersection over union(MIoU)was employed to indicate the detection accuracy.Matlab(Windows R2017a,MathWorks,U S A)was used to extract the plaque edge line of 109 groups of photos and to calculate the number of pixels for the measurement of the complexity of the plaque edge line.The percentage of dental plaque area was calculated.Multivariate linear regression was used to explore whether tooth site,plaque percentage,number of plaque edge line pixels and lens light spot location would influence the detection accuracy,of which P<0.05 was considered statistically significant.Results The MIoU of the permanent tooth model was 0.700±0.191 when 440 photos were used for training and 109 photos were used for testing.In the regression model of significance test(P<0.05),the percentage of plaque and the number of pixels on the edge of plaque had significant influence on the accuracy of dental plaque detection.The standardized coefficient of the number of pixels of the plaque edge line is-0.289,and the standardized coefficient of the percentage of plaque is-0.551.Conclusions In the present stud

关 键 词：牙菌斑 人工智能 深度学习 口腔内镜 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程] TP391.41[自动化与计算机技术—控制科学与工程] R781.2[医药卫生—口腔医学]