融合扩散模型技术的文物面部三维模型孔洞修补  

3D model hole filling in cultural relics’facial reconstruction fusion diffusion model

作　　者：王峥嵘 刘鑫达 周明全[1,2] WANG Zhengrong;LIU Xinda;ZHOU Mingquan(National and Local Joint Engineering Research Center for Cultural Heritage Digitization,Northwest University,Xi’an 710127,China;Institute of Visualization Technology,Northwest University,Xi’an 710127,China)

机构地区：[1]西北大学文化遗产数字化国家地方联合工程研究中心,陕西西安710127 [2]西北大学可视化技术研究所,陕西西安710127

出　　处：《西北大学学报(自然科学版)》2025年第1期213-222,共10页Journal of Northwest University(Natural Science Edition)

基　　金：国家自然科学基金(62271393);文化和旅游部重点实验室项目(1222000812,cr2021K01);西安市社会发展科技创新示范项目(2024JH-CXSF-0014);虚拟现实技术与系统全国重点实验室(北京航空航天大学)开放基金(VRLAB2024C02)。

摘　　要：在三维几何建模领域,孔洞指三维模型表面的不完整性,通常产生在数据采集、处理或转换过程中,这些孔洞的存在可能会对模型的几何完整性和视觉质量造成显著影响。在文化遗产保护领域,传统的孔洞修复技术侧重于几何表面的修复,而忽略了纹理信息的修复,纹理信息对于恢复文物的真实感和材质特性至关重要。文中提出了一种结合几何和纹理修复的扩散模型方法,特别适用于文物面部模型的修复。由于缺乏文物面部模型的基准真值,使用相似的残缺黄种人面部模型进行评估,鉴于公开可用的黄种人面部数据集较为稀缺,构建了一个黄种人面部数据集,包含约20000张黄种人面部图像、对应的三维模型及其纹理,以及渲染得到的高保真面部图像。首先,在构建的数据集上进行测试,以验证所提方法的有效性。结果显示,与现有基准方法相比,该方法在面部图像修复方面取得了显著改进,并且实现了对面部三维模型几何表面和纹理信息的同步修复。其次,将所提出的修复技术应用于文化遗产中的文物面部模型,通过实验验证该方法在文物面部模型的几何和纹理修复方面均展现出了优异的性能。研究结果为文物面部模型的数字化修复提供了一种有效的技术手段,有助于提高文物保护和数字化展示的质量。In the field of 3D geometric modeling,a hole refers to the incompleteness on the surface of a 3D model,often arising during data acquisition,processing,or transformation.The presence of such holes can significantly impact the geometric integrity and visual quality of the model.In the domain of cultural heritage preservation,traditional hole-filling techniques focus on the repair of geometric surfaces,neglecting the restoration of texture information,which is crucial for recovering the authenticity and material characteristics of artifacts.This paper proposes a diffusion model method that combines geometric and texture repair,particularly suitable for the restoration of facial models of cultural relics.Due to the absence of ground truth for facial models of cultural relics,this study uses similar incomplete Asian facial models for evaluation.Given the scarcity of publicly available Asian facial datasets,this paper constructs an Asian facial dataset comprising approximately 20000 Asian facial images,corresponding 3D models and textures,as well as high-fidelity facial images rendered from the models.Experiments are first conducted on the constructed dataset to validate the effectiveness of the proposed method.The results show that compared to existing benchmark methods,our method achieves significant improvements in facial imageinpainting and simultaneously repairs the geometric surfaces and texture information of the facial 3D models.Subsequently,the proposed repair technique is applied to facial models of cultural relics,and experiments confirm its excellent performance in both geometric and texture repair of the relic facial models.These findings provide an effective technical means for the digital restoration of facial models of cultural relics,contributing to the enhancement of the quality of cultural heritage preservation and digital exhibition.

关 键 词：三维模型孔洞修补 文物面部修复 扩散模型 图像修复 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]