基于双模态输入的孪生网络目标跟踪算法  

Target tracking algorithm in Siamese network based on bimodal input

作　　者：刘子龙[1] 王晨[1] Liu Zilong;Wang Chen(School of Optical-Electrical&Computer Engineering,University of Shanghai for Science&Technology,Shanghai 200093,China)

机构地区：[1]上海理工大学光电信息与计算机工程学院,上海200093

出　　处：《计算机应用研究》2021年第12期3796-3800,共5页Application Research of Computers

基　　金：国家自然科学基金资助项目(61603255)

摘　　要：主流的目标跟踪算法只使用可见光(RGB)图像进行跟踪任务,当跟踪场景的光照条件较差时,表征颜色和纹理特征的可见光图像会严重限制跟踪器的跟踪性能。针对单一模态目标信息存在缺失的问题,在SiamFC网络模型以及红外—可见光图像融合思想的基础上提出了双模态权值自更新孪生网络目标跟踪方法。根据红外图像可以采集运动目标热信息的特点,有效利用了红外和可见光图像在目标跟踪领域的互补优势;使用较浅的特征提取网络AlexNet即可提取到运动目标具有鲁棒性的特征,在保证跟踪精度的同时提高了跟踪模型的跟踪速度。在公开数据集OTB2015和红外—可见光数据集RGB-T210进行实验,结果表明提出的目标跟踪算法在各种跟踪场景下都取得了较好的跟踪效果。Mainstream target tracking algorithms only use visible light(RGB)images for tracking tasks.When the illumination conditions of the tracking scene are poor,visible light images algorithm of representing color and texture characteristics will seriously limit the tracking performance of the tracker.Aiming at the problem of missing single mode target information,based on the SiamFC network model and the idea of infrared and visible image fusion,this paper proposed a target tracking algorithm based on dual mode weight self-updating Siamese network.This algorithm effectively utilized the complementary advantages of infrared and visible image in the field of target tracking since the infrared image could collect the thermal information of moving target.It used the AlexNet model to extract the moving object with the robust characteristics,which guaranteed the tracking accuracy and improved the tracking speed of tracking model.Finally experimental results on OTB2015 datasets and infrared-visible light datasets RGB-T234 show that the proposed algorithm of target tracking under various tracking scenario has good tracking effect.

关 键 词：目标跟踪 孪生网络 可见光红外图像融合 模态权值更新 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]