基于知识蒸馏的轻量化Transformer目标检测  

Object Detection of Lightweight Transformer Based on Knowledge Distillation

作　　者：王改华 李柯鸿 龙潜 姚敬萱 朱博伦 周正书 潘旭冉 Wang Gaihua;Li Kehong;Long Qian;Yao Jingxuan;Zhu Bolun;Zhou Zhengshu;Pan Xuran(College of Artificial Intelligence,Tianjin University of Science&Technology,Tianjin 300457,China;Hubei Key Laboratory of Optical Information and Pattern Recognition,Wuhan Institute of Technology,Wuhan 430205,China;Beijing Smarter Technology Co.,Ltd,Beijing 100020,China)

机构地区：[1]天津科技大学人工智能学院,天津300457 [2]湖北光信息与模式识别重点实验室,湖北武汉430205 [3]北京中科慧眼科技有限公司,北京100020

出　　处：《系统仿真学报》2024年第11期2517-2527,共11页Journal of System Simulation

基　　金：湖北省光学信息与模式识别重点实验室开放基金(202306)。

摘　　要：在自动驾驶领域,目标检测的高效性和准确性尤为重要,基于Transformer结构的目标检测方法逐渐成为主流,省去了复杂的锚点生成和非极大值抑制。针对现有方法计算成本高和收敛速度慢的问题,设计了一种基于池化操作的轻量化Transformer目标检测模型(LPT),包含了池化主干网络和双池化注意力机制,设计了针对DETR(detection transformer)模型的通用知识蒸馏方法,将预测结果、查询向量和教师提取的特征作为知识传递给轻量化的Transformer模型,帮助其提升精确度性能。通过在MS COCO 2017数据集上的实验,验证经过蒸馏的LPT模型在自动驾驶中的应用潜力,实验结果表明:本文方法具有较好的准确性,与一些先进的方法相比具有一定优势。In autonomous driving,the efficiency and accuracy of object detection are significant.Object detection based on Transformer structure has gradually become the mainstream method,eliminating the complex anchor generation and non-maximum suppression(NMS).It has problems of high computing cost and slow convergence.An object detection model of the based lightweight pooling transformer(LPT)is designed,which contains a pooling backbone network and dual pooling attention mechanism.A general knowledge distillation method is intended for the DETR(detection transformer)model,which transfers prediction results,query vector,and features extracted by the teacher as knowledge to the LPT model to improve its accuracy.To verify the application potential of the distilled LPT model in autonomous driving,extensive experiments are conducted on the MS COCO 2017 dataset.The results show that the method has great efficiency and accuracy,and is competitive with some advanced techniques.

关 键 词：目标检测 知识蒸馏 轻量化 DETR TRANSFORMER 自动驾驶 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]