检索规则说明:AND代表“并且”;OR代表“或者”;NOT代表“不包含”;(注意必须大写,运算符两边需空一格)
检 索 范 例 :范例一: (K=图书馆学 OR K=情报学) AND A=范并思 范例二:J=计算机应用与软件 AND (U=C++ OR U=Basic) NOT M=Visual
作 者:王慧[1] 秦广义 杨春梅[1] WANG Hui;QIN Guang-yi;YANG Chun-mei(College of Mechanical and Electrical Engineering,Northeast Forestry University,Harbin 150040,China)
机构地区:[1]东北林业大学机电工程学院,哈尔滨150040
出 处:《包装工程》2021年第17期203-209,共7页Packaging Engineering
基 金:黑龙江省应用技术研究与开发计划(GA19A402);中央高校基本科研业务费专项(2572020DR12)。
摘 要:目的针对应用在定制家具生产包装车间的板材搬运自动引导车存在的路径规划时间长以及规划出的路径转弯次数较多的问题,提出一种改进Q-learning算法的路径规划算法。方法根据定制家具生产包装车间环境情况,使用栅格法对车间进行建模,建立车间模型的人工标量场,使用人工标量场给予Q-learning算法前期搜索的目的性;增加Q-learning算法的学习层,使得算法可以更快进入收敛;在奖励函数中加入转弯惩罚,使得算法规划出的路径具有更少的转弯次数。结果仿真结果表明改进后的算法与标准Q-learning算法、增加学习层的Q-learning算法、引入人工势能场Q-learning算法、深度双Q网络算法相比,迭代次数减少了70.46%,64.40%,67.75%,30.49%,转弯次数减少了80%,80.95%,83.33%,73.33%。结论板材搬运自动引导车利用改进后的Q-learning算法可以有效地提高路径的平滑性,降低了路径规划的时间,提高了板材搬运自动引导车的工作效率。Aiming at the problems of long path planning time and more turns in the planned path of automatic guided vehicle used in customized furniture production and packaging workshop,a path planning algorithm based on improved Q-learning algorithm is proposed.According to the environment of customized furniture production and packaging workshop,the grid method was used to model the workshop.The artificial scalar field of the workshop environment was established to make purpose of the early search of the learning layer Q-learning algorithm more clear,and the turning pe-nalty was added to the reward function,so as to quickly plan a short path with less turns.Simulation results show that the iterations of the improved algorithm reduced by 70.46%,64.40%,67.75%,and 30.49%,respectively compared with stan-dard Q-learning algorithm,learning layer Q-learning,artificial potential field Q-learning,and deep double Q network al-gorithm.Turning times reduced by 80%,80.95%,83.33%,73.33%respectively.The improved Q-learning algorithm can effectively improve the smoothness of the path,reduce the time of path planning,and improve the efficiency of the auto-matic guided vehicle.
关 键 词:板材搬运自动导引车 路径规划 改进Q-learning算法
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在载入数据...
正在链接到云南高校图书馆文献保障联盟下载...
云南高校图书馆联盟文献共享服务平台 版权所有©
您的IP:3.17.74.222