基于记忆库和后处理方法解决长尾实例分割问题  

Method for long-tailed instance segmentation based on memory bank and confidence calibration

作　　者：范馨月 刘腾 鲍泓 潘卫国 梁天骄 李晗 Fan Xinyue;Liu Teng;Bao Hong;Pan Weiguo;Liang Tianjiao;Li Han(Beijing Key Laboratory of Information Service Engineering,Beijing Union University,Beijing 100101,China;College of Robotics,Beijing Union University,Beijing 100020,China;Information Network Center,Beijing University of Posts&Telecommunications,Beijing 100876,China)

机构地区：[1]北京联合大学北京市信息服务工程重点实验室,北京100101 [2]北京联合大学机器人学院,北京100020 [3]北京邮电大学信息网络中心,北京100876

出　　处：《计算机应用研究》2023年第6期1876-1881,共6页Application Research of Computers

基　　金：国家自然科学基金资助项目(61932012,62102033,61802019,62272049,62171042);北京联合大学科研资助项目(ZK10202202)。

摘　　要：数据的长尾特性一直是解决计算机视觉问题的一大挑战,为了应对这一挑战在实例分割任务中带来的困难,通常引入图像重采样作为一种简单有效的方法。然而一幅图像中可能存在多个类,仅通过图像重采样不足以在类别的数据量层面上获得足够均衡的分布,因此提出一种以目标为中心的记忆库后处理方法。首先引入记忆库模型,设立以目标为单位的存储策略,解决各类别数量不均衡问题;其次使用一种后处理校准方法,通过调整每个类的置信度得分提升稀有类和普通类的预测值。在公开数据集LVIS上的实验验证了所提方法的有效性,并且相比EQL方法,准确率能够提升2.2%。Long-tail characteristic of data has always been a great challenge in solving computer vision problems.To solve the difficulties brought to instance segmentation,image re-sampling,a simple and efficient method has always been used.However,there may be many classes in one image,it’s hard to balance different classes on the data level.This paper proposed a object-centric post-processable memory bank method.Firstly,it introduced a memory bank model and set up an object-based storage policy to address the number imbalance of categories.Then,in order to increase the predicted score for tail classes and common classes,it used a post-processing calibration to adjust the confidence score of each class.This paper verified the effectiveness of the proposed method by experiments on LVIS dataset.The accuracy can be improved by 2.2%compared to EQL method.

关 键 词：长尾分布 实例分割 记忆库 置信度校准 DCT 深度学习 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]