多级度量网络的小样本学习  

Multilevel Metric Networks for Few-Shot Learning

作　　者：韦世红[1,2] 刘红梅 唐宏[1,2] 朱龙娇[1,2] WEI Shihong;LIU Hongmei;TANG Hong;ZHU Longjiao(School of Communication and Information Engineering,Chongqing University of Posts and Communications,Chongqing 400065,China;Chongqing Key Lab of Mobile Communications Technology,Chongqing University of Posts and Communications,Chongqing 400065,China)

机构地区：[1]重庆邮电大学通信与信息工程学院,重庆400065 [2]重庆邮电大学移动通信技术重庆市重点实验室,重庆400065

出　　处：《计算机工程与应用》2023年第2期94-101,共8页Computer Engineering and Applications

基　　金：长江学者和创新团队发展计划(IRT_16R72)。

摘　　要：小样本学习的分类结果依赖于模型对样本特征的表达能力,为了进一步挖掘图像所表达的语义信息,提出一种多级度量网络的小样本学习方法。将输入图像的特征向量放入嵌入模块进行特征提取;将经过第二层卷积及第三层卷积得到的特征描述子分别进行图像-类的度量以获得图像关系得分,对第四层卷积得到的特征向量进行全连接并将其做图像-图像的度量从而得到图像从属概率;通过交叉验证对2个图像关系得分以及1个图像从属概率进行加权融合并输出分类结果。实验结果表明在miniImageNet数据集上,该方法5-way 1-shot准确率为56.77%,5-way 5-shot准确率为75.83%。在CUB数据集上,该方法5-way 1-shot及5-way 5-shot准确率分别上升到55.34%及76.32%。在Omniglot数据集上准确率同传统方法相比也有一定提升。因此,该方法可有效挖掘图像中所表达的语义信息,显著提高小样本图像分类的准确率。The classification results of few-shot learning depend on the model’s ability to express the sample features.In order to further mine the semantic information expressed by images,a multilevel metric networks few-shot learning method is proposed.Firstly,the feature vector of the input image is put into the embedded module for feature extraction.Secondly,the feature descriptors obtained through the second layer convolution and the third layer convolution are measured by image-class to obtain the score of image relation respectively.The feature vectors obtained by the fourth layer convolution are fully connected and used as the image-image metric to obtain the image dependency probability.Finally,the weighted fusion of two image relational scores and one image membership probability is performed through cross validation and the classification results are output.The experimental results show that the accuracy of 5-way 1-shot and 5-way 5-shot of the proposed method is 56.77%and 75.83%in the miniImageNet dataset.The accuracy of 5-way 1-shot and 5-way 5-shot increases to 55.34%and 76.32%,respectively,on CUB dataset.The accuracy of the Omniglot dataset is also improved compared with the traditional method.Therefore,this method can effectively mine the semantic information expressed in the image,and significantly improve the accuracy of few-shot image classification.

关 键 词：小样本学习 度量学习 深度学习 多级度量 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]