De-DDPM:可控、可迁移的缺陷图像生成方法  

De-DDPM:A Controllable and Transferable Defect Image Generation Method

作　　者：岳忠牧 张喆[1] 吕武 赵瑞祥 马杰[1] YUE Zhong-Mu;ZHANG Zhe;LV Wu;ZHAO Rui-Xiang;MA Jie(School of Artificial Intelligence and Automation,Huazhong University of Science and Technology,Wuhan 430074;Marine Technology Co.,Ltd.,China State Shipbuilding Corporation Limited(CSSC),Beijing 100070)

机构地区：[1]华中科技大学人工智能与自动化学院,武汉430074 [2]中国船舶集团有限公司航海科技有限责任公司,北京100070

出　　处：《自动化学报》2024年第8期1539-1549,共11页Acta Automatica Sinica

基　　金：国家自然科学基金(U1913602,61991412);装备预先研究基金(50911020603)资助。

摘　　要：基于深度学习的表面缺陷检测技术是工业上的一项重要应用,而缺陷图像数据集质量对缺陷检测性能有重要影响.为解决实际工业生产过程中缺陷样本获取成本高、缺陷数据量少的痛点,提出了一种基于去噪扩散概率模型(Denoising diffusion probabilistic model,DDPM)的缺陷图像生成方法.该方法在训练过程中加强了模型对缺陷部位和无缺陷背景的差异化学习.在生成过程中通过缺陷控制模块对生成缺陷的类别、形态、显著性等特征进行精准控制,通过背景融合模块,能将缺陷在不同的无缺陷背景上进行迁移,大大降低新背景上缺陷样本的获取难度.实验验证了该模型的缺陷控制和缺陷迁移能力,其生成结果能有效扩充训练数据集,提升下游缺陷检测任务的准确率.Surface defect detection technology based on deep learning is an important application in industry and the quality of defect image dataset has a significant impact on defect detection performance.A defect image generation method based on denoising diffusion probabilistic model(DDPM)is designed to address the pain points of high cost of obtaining defect samples and low amount of defect data in actual industrial production processes.This method enhances the model's differential learning of defect locations and defect free backgrounds during the training process.Through the defect control module during the generation process,this method accurately controls the category,morphology,saliency and other features of generated defects.Through the background fusion module,defects can be migrated on different defect free backgrounds,which greatly reducing the difficulty of obtaining defect samples on new backgrounds.The experiment has verified the defect control and defect migration capabilities of the model,and its generated results can effectively expand the training dataset and improve the accuracy of downstream defect detection tasks.

关 键 词：数据增强 数据集扩充 缺陷图像生成 深度学习 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]