一种基于强化学习的在线神经模糊控制系统  

Reinforcement-Learning-Based On-Line Neural-Fuzzy Control System

作　　者：李佳宁[1] 易建强[1] 赵冬斌 西广成[1] 

机构地区：[1]中国科学院自动化研究所复杂系统与智能科学实验室,北京100080

出　　处：《中国科学院研究生院学报》2005年第5期631-638,共8页Journal of the Graduate School of the Chinese Academy of Sciences

基　　金：国家973项目(2003CB517106);科技部国际科技合作重点项目(2004DFB02100)资助

摘　　要：为了实现基于非训练数据的神经模糊控制器的在线学习,提出了一种基于强化学习的神经模糊控制系统和相应的学习算法.该控制系统由神经模糊预测器和神经模糊控制器两部分组成,其中,神经模糊控制器采用基于确定度的模糊规则模型作为知识表示形式的扩展型神经模糊网络.在学习算法的设计中,尝试了利用强化信号得到输入状态的“期望输出”,进而将强化学习转化为基于训练数据学习的解决思路.仿真实验验证了所提出的控制系统结构和学习算法的合理性和可行性.To solve non-training-data-based on-line learning for neural-fuzzy controller, this paper proposes a reinforcement-learning-based neural-fuzzy control system and the corresponding learning algorithm. This control system consists of a neural-fuzzy predictor and a neural-fuzzy controller. Based on fuzzy if-then rules with certainty grades, the extended neural-fuzzy network proposed is used as the structure of the neural-fuzzy controller. In learning process of the control system, by using reinforcement signal to estimate the desired output of an input state, reinforcement learning is treated and solved according to training-data-based learning algorithm. Computer simulations illustrate the rationality and applicability of the proposed control system and the learning algorithm.

关 键 词：神经模糊预测器 神经模糊控制器 强化学习 模糊规则 确定度 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]