面向脑胶质瘤影像分析的混合现实技术  

Mixed Reality Technology for Medical Imaging Analysis of Glioma

作　　者：蔡林沁[1,2] 易文渊 黄宇婷 代宇涵 CAI Lin-Qin;YI Wen-Yuan;HUANG Yu-Ting;DAI Yu-Han(School of Automation,Chongqing University of Posts and Telecommunications,Chongqing 400065,China;Key Laboratory of Industrial Internet of Things&Networked Control,Ministry of Education(Chongqing University of Posts and Telecommunications),Chongqing 400065,China)

机构地区：[1]重庆邮电大学自动化学院,重庆400065 [2]工业物联网与网络化控制教育部重点实验室(重庆邮电大学),重庆400065

出　　处：《软件学报》2022年第9期3347-3369,共23页Journal of Software

基　　金：国家重点研发计划国际科技创新合作专项(2017YFE0123000)。

摘　　要：当前混合现实(MR)技术在数字医疗领域正日益受到广泛关注.以脑胶质瘤医学影像分析混合现实技术为对象,提出基于深度学习模型3D UNet的MR脑胶质瘤定位与区域分割算法,采用基于面绘制方法对脑胶质瘤影像进行多结构组织的三维绘制与优化,提出了基于交互式无标识和基于标识图的移动混合现实三维注册跟踪与视觉空间共享算法,实现MR多设备的第三视角空间实时共享,设计并实现了面向脑胶质瘤医学影像分析的混合现实原型系统.实验结果表明所提方法能有效实现MR脑胶质瘤检测、分割与三维重建,通过MR移动设备的实时共享,实现脑胶质瘤医学影像混合现实分析,有效支撑脑胶质瘤辅助诊断与治疗,也为手术术前规划、医学教育培训等提供了新的方法.At present, mixed reality(MR) technology is gaining increasingly attention in digital medicine. Targeted at MR of glioma medical image analysis, this study proposes an MR glioma location and regional segmentation algorithm based on the 3D UNet deep learning model, and uses the surface rendering method to render and optimize multi-structure tissue of the glioma image in threedimensional space. On this basis, three-dimensional registration tracking and visual space sharing algorithms are presented using the interactive markerless and the marker-based graphs for mobile MR to achieve the real-time third-view space sharing for MR multi-devices.In addition, an MR experimental system is designed and implemented for glioma medical image analysis. The experimental results show that the methods proposed in this paper can effectively realize the detection, segmentation and three-dimensional reconstruction of the brain glioma. Through the real-time sharing of mobile MR devices, the proposed methods can effectively achieve MR analysis of glioma medical images to support the auxiliary diagnosis and treatment of glioma, and it also can provide new methods for preoperative planning,medical education and training, etc.

关 键 词：混合现实 医学影像 脑胶质瘤 深度学习 面绘制 空间共享 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]