平衡幅度和相似度的滤波器剪枝算法  

Balancing Magnitude and Similarity for Filter Pruning Algorithm

作　　者：闫雅茹 Yaru Yan(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai)

机构地区：[1]上海理工大学光电信息与计算机工程学院,上海

出　　处：《建模与仿真》2025年第1期353-365,共13页Modeling and Simulation

摘　　要：深度神经网络在计算机视觉任务中广泛应用,但是大规模参数计算导致的高复杂性限制了其在资源有限环境中的部署。本文提出了一种平衡幅度和相似度的滤波器剪枝方法(MASFIP)。在每次剪枝迭代中,通过缩放因子α选择每层临时剪枝的滤波器。根据网络损失进行永久性剪枝,达到预定的浮点运算量后,采取少量的再训练步骤缓解模型精度的急剧下降。在CIFAR-10和CIFAR-100数据集上对VGGNet-16和ResNet模型进行剪枝实验,结果表明在CIFAR-10数据集上,MASFIP分别从VGGNet-16和ResNet-56中删除了60.6%和52.9%的FLOPs,精度提高了0.16%和0.14%。在CIFAR-100数据集上,从ResNet-56中删除了39.1%的FLOPs,仅导致0.05%的精度下降。There are extensive applications of Deep Neural Network(DNN)in the field of computer vision tasks.However,the high complexity resulting from the computing large-scale parameters of DNN would hinder its deployment in resource-constrained environments.We propose a filter pruning method,named Balancing Magnitude and Similarity for Filter Pruning(MASFIP),to address this challenge.During each pruning iteration,filters for temporary pruning are selected using a scaling factor.Permanent pruning is then performed based on network loss.Upon reaching the designated floating-point operations,a small number of retraining steps are taken to alleviate the sharp decline in model accuracy.Experimental pruning on VGGNet-16 and ResNet models on CIFAR-10 and CIFAR-100 datasets reveals that,on CIFAR-10,MASFIP removes 60.6%and 52.9%of FLOPs from VGGNet-16 and ResNet-56 respectively,resulting in accuracy improvements of 0.16%and 0.14%.On CIFAR-100,pruning from ResNet-56 leads to a reduction of 39.1%in FLOPs with only a marginal accuracy drop of 0.05%.

关 键 词：滤波器剪枝 深度神经网络 幅度 相似度 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]