三维CT层间图像超分辨重建与修复  

Super-Resolution Reconstruction and Inpainting of Inter-Layer Image in 3D CT

作　　者：林毓秀 刘慧[1,2] 刘绍玲 张彩明[2,4] Lin Yuxiu;Liu Hui;Liu Shaoling;Zhang Caiming(School of Computer Science and Technology,Shandong University of Finance and Economics,Jinan 250014;Digital Media Technology Key Laboratory of Shandong Province,Jinan 250014;Shandong Medical Imaging Research Institute,Jinan 250021;Software College,Shandong University,Jinan 250101)

机构地区：[1]山东财经大学计算机科学与技术学院,济南250014 [2]山东省数字媒体技术重点实验室,济南250014 [3]山东省医学影像学研究所,济南250021 [4]山东大学软件学院,济南250101

出　　处：《计算机辅助设计与图形学学报》2020年第6期919-929,共11页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家自然科学基金重点项目浙江联合基金(U1609218);国家自然科学基金(61572286,61873145);山东省省属高校优秀青年人才联合基金项目(ZR2017JL029);山东省高等学校优势学科人才团队培养计划。

摘　　要：CT图像在疾病诊断、癌症精准放疗阶段发挥着重要的作用.然而,受X射线剂量的限制以及现有医疗设备等因素的影响,三维CT图像成像采样间距较大,层间分辨率远低于层内分辨率.为提高CT图像的层间分辨率,避免因相邻层CT图像之间存在较大差异对超分辨率重建造成干扰,提出一种在相邻CT图像序列切片间利用上下层的配准信息插值出一个新的中间切片,并对插值得到的中间切片进行修复的方法.首先,利用CLG-TV光流估计模型配准算法估计相邻2幅CT图像之间的像素运动,得到一个稠密的光流场,从而获得2个连续切片之间精确的像素对应关系,并依据新切片位置对速度矢量进行缩放;然后,利用计算出的速度场在连续2幅图像之间生成初始插值图像.由于相邻切片之间的像素难以一一对应,插值后的图像通常存在像素缺失现象.最后利用序列图像的帧间非局部自相似性,通过求解最优化问题以修复插值图像中像素丢失的区域.在DIR-Lab实验室和山东省医学影像学研究所提供的数据集上的实验结果表明,与其他经典方法相比,文中方法能够生成高质量的中间CT切片,在定量和定性上提高了层间分辨率.CT image plays an important role in the diagnosis of diseases and precise radiotherapy of cancer.However,due to the limitation of X-ray dose and the existing medical equipment,the sampling interval of 3D CT image is large,which results in the much lower inter-layer resolution of 3D CT images than the intra-layer resolution.In order to improve the inter-layer resolution and avoid the interference with super-resolution reconstruction from the large difference between adjacent layers,this paper proposes a new model for reconstructing an intermediate slice that combines the registration information from adjacent CT sequence,and then repairer the new slice via non-local self-similarity features.First,CLG-TV optical flow estimation model is used to estimate the motion between two adjacent CT slices,for obtaining a dense optical flow field.The model constructs the precise pixel correspondence between two consecutive slices,which can scale the velocity vector according to the position of new slice.Then,an initial interpolated image based on the calculated velocity field is generated.Since it is difficult to guarantee the one-to-one pixel correspondence between original adjacent slices,there generally exists the pixel missing phenomenon in interpolated images.Finally,non-local self-similarity among different frames is used to inpaint the missing regions in the interpolated image.The experimental results on the data sets provided by DIR-Lab laboratory and Shandong Medical Imaging Research Institute show that,compared with other classic methods,this method can generate high quality intermediate CT slices,and improve the inter-layer resolution quantitatively and qualitatively.

关 键 词：三维CT图像 非刚体配准 非局部自相似块 反距离权重 图像修复 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]