检索规则说明:AND代表“并且”;OR代表“或者”;NOT代表“不包含”;(注意必须大写,运算符两边需空一格)
检 索 范 例 :范例一: (K=图书馆学 OR K=情报学) AND A=范并思 范例二:J=计算机应用与软件 AND (U=C++ OR U=Basic) NOT M=Visual
作 者:孙浩淼 李宗民[1,2] 肖倩 孙文洁 张雯欣 SUN Haomiao;LI Zongmin;XIAO Qian;SUN Wenjie;ZHANG Wenxin(School of Computer Science and Technology,China University of Petroleum(East China),Qingdao 266580,Shandong,China;College of Big Data and Basic Science,Shandong Institute of Petroleum and Chemical Technology,Dongying 257061,Shandong,China)
机构地区:[1]中国石油大学(华东)计算机科学与技术学院,山东青岛266580 [2]山东石油化工学院大数据与基础科学学院,山东东营257061
出 处:《计算机工程》2025年第2期102-110,共9页Computer Engineering
基 金:国家重点研发计划(2019YFF0301800);国家自然科学基金(61379106);山东省自然科学基金(ZR2013FM036,ZR2015FM011)。
摘 要:为满足冰壶智能训练的需求,结合计算机视觉与深度强化学习(RL)技术,提出一种新的现场冰壶决策方法AI-Curling。AI-Curling包含冰壶检测(SR-Yolo)以及策略生成(GSP-MCTS)2个部分。SR-Yolo模块负责感知关键时刻冰壶状态,提取实景冰壶的位置与种类信息。为提高大场景下的小目标检测精度,防止不恰当下采样造成的特征损失,引入浅层细化骨干网络(SRNet),通过在网络初级阶段增加层级,捕获更丰富的特征信息。此外,在多尺度融合网络中,引入自适应特征优化融合(AFOF)模块,以增加各层网络有效样本,避免小尺度目标淹没在复杂背景和噪声中。GSP-MCTS模块通过蒙特卡洛树搜索(MCTS)算法结合策略价值网络的方式,实现冰壶比赛决策分析。该模块通过引入核函数处理动作空间连续性和执行不确定性,并在策略价值网络中嵌入全局策略感知模块(GSP),增强了网络空间感知能力。在实验中,SR-Yolo在常规冰壶数据集Curling上平均精度均值(mAP@0.5)为0.974,在遮挡较多的复杂冰壶数据集Curling_hard上mAP@0.5为0.723。同时,GSP-MCTS与最新实景冰壶模型Curling MCTS对战获得62%的胜率。实验结果表明,GSP-MCTS具有更好的性能。In response to the need for intelligent curling training,a new on-site curling decision-making method that combines computer vision and deep Reinforcement Learning(RL)technologies,Artificial Intelligence(AI)-Curling,is proposed.AI-Curling comprises two components:SR-Yolo for curling detection and Global Strategy Perception-Monte Carlo Tree Search(GSP-MCTS)for strategy generation.The former is responsible for sensing the state of the curling stones at critical moments and extracting information on the location and type of stones in real scenes.To improve the detection accuracy of small targets in large scenes and prevent feature loss due to inappropriate downsampling,a Shallow Refinement Backbone Network(SRNet)is introduced to capture richer feature information by adding layers during the initial stages of the network.An Adaptive Feature Optimization Fusion(AFOF)module is further introduced into the multiscale fusion network to increase the number of effective samples in each layer,thereby preventing small-scale targets from being submerged in complex backgrounds and noise.In the strategy generation module,curling match decision analysis is implemented using a combination of the MCTS algorithm and policy value network.A GSP module is embedded into the policy value network to enhance network spatial perception by introducing a kernel function to deal with action space continuity and execution uncertainty.In the experiments,SR-Yolo achieved 0.974 mAP@0.5 on the standard Curling dataset and 0.723 mAP@0.5 on the more complex obstructed Curling_hard dataset.In addition,GSP-MCTS achieved a 62%winning percentage compared with the latest real-scene curling model Curling MCTS,indicating that GSP-MCTS has superior performance.
关 键 词:强化学习 深度学习 冰壶检测 小目标检测 蒙特卡洛树搜索
分 类 号:TP391[自动化与计算机技术—计算机应用技术]
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在链接到云南高校图书馆文献保障联盟下载...
云南高校图书馆联盟文献共享服务平台 版权所有©
您的IP:216.73.216.49