基于双重注意力机制的人群计数方法  

Crowd counting method based on dual attention mechanism

作　　者：赵志强 马培红[1] 黑新宏 ZHAO Zhiqiang;MA Peihong;HEI Xinhong(School of Computer Science and Engineering,Xi’an University of Technology,Xi’an Shaanxi 710048,China;Shaanxi Key Laboratory of Network Computing and Security Technology(Xi’an University of Technology),Xi’an Shaanxi 710048,China)

机构地区：[1]西安理工大学计算机科学与工程学院,西安710048 [2]陕西省网络计算与安全技术重点实验室(西安理工大学),西安710048

出　　处：《计算机应用》2024年第9期2886-2892,共7页journal of Computer Applications

基　　金：国家自然科学基金资助项目(61976177);陕西省重点研发计划项目(2023-YBGY-222)。

摘　　要：针对复杂场景下人群计数问题中的尺度变化、背景干扰和部分遮挡等问题,在空洞卷积操作的基础上,提出一种基于双重注意力机制的空洞上下文卷积神经网络(DA-DCCNN)。首先,将VGG16中的卷积层作为特征提取器,获取人群图像抽象、深层的特征图;其次,利用空洞卷积构造空洞上下文模块(DCM)对不同层获取的特征进行连接,并引入空间注意力模块(SAM)和通道注意力模块(CAM)获取上下文信息;最后,组合欧氏距离和交叉熵构造损失函数,对网络预测注意力图和真实注意力图之间的差异进行度量。在ShanghaiTech、UCF_CC_50和UCF-QNRF 3个公开数据集上的实验结果表明,DA-DCCNN在有效获取图像的多尺度特征的同时,增强了对图像中重要区域和通道的感知能力,平均绝对误差(MAE)取得了相对最优的结果。基于双重注意力机制的特征融合网络能有效感知图像中的空间结构和局部特征,从而使得生成的密度图能更准确地对人群区域进行预测和计数。In response to challenges such as scale variation,background interference,and partial occlusion in crowd counting within complex scenes,a DA-DCCNN(Dual Attention based Dilated Contextual Convolutional Neural Network)was proposed.Firstly,the convolutional layers from VGG16 were utilized as feature extractors to obtain abstract and deeplevel feature maps of the crowd image.Subsequently,by employing dilated convolutions,a Dilated Context Module(DCM)was constructed to connect features obtained from different layers.The Spatial Attention Module(SAM)and Channel Attention Module(CAM)were introduced to acquire contextual information.Finally,a loss function was formulated by combining the Euclidean distance and cross entropy to measure the disparity between the predicted attention map and the ground truth attention map.Experimental results on three publicly available datasets—ShanghaiTech,UCF_CC_50 and UCF-QNRF demonstrate that DA-DCCNN can effectively capture multi-scale features in the image and enhance the perception of important regions and channels within the image,achieving the optimal Mean Absolute Error(MAE).The feature fusion network based on dual attention mechanism can efficiently recognize spatial structures and local features in images so that by using the generated density maps,the crowd regions can be predicted and counted more accurately.

关 键 词：空洞卷积 上下文特征 双重注意力机制 密度图 人群计数 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] TP391.1[自动化与计算机技术—控制科学与工程]