基于改进FeatDepth的足球运动场景无监督单目图像深度预测  

Unsupervised monocular image depth prediction in football sports scene based on improved featdepth

作　　者：傅荟璇[1] 徐权文 王宇超[1] FU Huixuan;XU Quanwen;WANG Yuchao(College of Intelligent Systems Science and Engineering,Harbin Engineering University,Harbin 150001,China)

机构地区：[1]哈尔滨工程大学智能科学与工程学院,黑龙江哈尔滨150001

出　　处：《实验技术与管理》2024年第10期74-84,共11页Experimental Technology and Management

基　　金：国家自然科学基金面上项目(52271313);中央高校基金项目(3072024GH0405)。

摘　　要：为了在降低成本的同时提高图像深度信息预测的精确度,并将深度估计应用于足球运动场景,提出一种基于改进FeatDepth的足球运动场景无监督单目图像深度预测方法。首先,对原FeatDepth引入注意力机制,使模型更加关注有效的特征信息;其次,将FeatDepth中的PoseNet网络和DepthNet网络分别嵌入GAM全局注意力机制模块,为网络添加额外的上下文信息,在基本不增加计算成本的情况下提升FeatDepth模型深度预测性能;再次,为在低纹理区域和细节上获得更好的深度预测效果,由单视图重构损失与交叉视图重构损失组合而成最终的损失函数。选取KITTI数据集中Person场景较多的部分进行数据集制作并进行仿真实验,结果表明,改进后的FeatDepth模型不仅在精确度上有所提升,且在低纹理区域及细节处拥有更好的深度预测效果。最后,对比模型在足球场景下的推理效果后得出,改进后的模型在低纹理区域(足球、球门等)及细节处(肢体等)有更好的深度预测效果,实现了将基于无监督的单目深度估计模型应用于足球运动场景的目的。[Objective]To reduce the cost and improve the accuracy of the depth estimation model in the process of image depth information prediction and apply the depth estimation model to the complex football sports scene,an unsupervised monocular image depth prediction method based on the improved FeatDepth is proposed.The monocular depth estimation model is used to obtain the relative depth information between the people,the football,and the goal in the football scene and calculate the distance information between the targets,which can be used for football auxiliary training and monitoring whether the player is offside and other application scenarios.[Methods]First,the attention mechanism was introduced to the original FeatDepth method so that the model pays more attention to the effective feature information.Second,the PoseNet and DepthNet networks in FeatDepth were embedded in the GAM global attention mechanism module,adding additional context information to the network and improving the depth prediction performance of the FeatDepth model without increasing the computational cost.Third,because of the higher requirements for depth information prediction in the football scene,to ensure that the model exhibits better performance in the low-texture areas and details,the loss function scheme used by the original FeatDepth method was adopted.The final loss function was mainly composed of the combination of single-view and cross-view reconstruction losses,in which the single-view reconstruction loss was composed of discriminant and convergence losses based on the reconstruction loss,and the cross-view reconstruction loss was composed of eigenmetric and photometric losses.Then,the dataset was made,and the parts of the KITTI public dataset with more person scenes were selected for dataset making,including 4,721 images in the training set,631 images in the verification set,and 584 images in the test set.Model comparison experiments were conducted to verify the effectiveness of the improvement strategy.[Results]The improved model

关 键 词：足球运动场景 无监督单目深度估计 FeatDepth 注意力机制 GAM 图像重构 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]