The skinner automaton: A psychological model formalizing the theory of operant conditioning  

作　　者：RUAN XiaoGang WU Xuan 

机构地区：[1]Institute of Artificial Intelligence and Robots,School of Electronic Information and Control Engineering,Beijing University of Technology

出　　处：《Science China(Technological Sciences)》2013年第11期2745-2761,共17页中国科学（技术科学英文版）

基　　金：supported by the National Natural Science Foundation of China(Grant Nos.61075110,60774077,61375086);the National Basic Research Program of China("973" Project)(Grant No.2012CB720000);the National High-Tech Research and Development Program of China("863" Project)(Grant No.2007AA04Z226);the Beijing Natural Science Foundation(Grant No.4102011);the Key Project of S&T Plan of Beijing Municipal Commission of Education(Grant Nos.KM2008-10005016,KZ201210005001);the Specialized Research Fund for the Doctoral Program of Higher Education(Grant No.20101103110007)

摘　　要：Operant conditioning is one of the fundamental mechanisms of animal learning, which suggests that the behavior of all animals, from protists to humans, is guided by its consequences. We present a new stochastic learning automaton called a Skinner au- tomaton that is a psychological model for formalizing the theory of operant conditioning. We identify animal operant learning with a thermodynamic process, and derive a so-called Skinner algorithm from Monte Carlo method as well as Metropolis algo- rithm and simulated annealing. Under certain conditions, we prove that the Skinner automaton is expedient, 6-optimal, optimal, and that the operant probabilities converge to the set of stable roots with probability of 1. The Skinner automaton enables ma- chines to autonomously learn in an animal-like way.

关 键 词：Learning automata Boltzmann distribution operant conditioning operant learning simulated annealing 

分 类 号：B849[哲学宗教—应用心理学]