基于复随机样本的结构风险最小化原则  

Structural Risk Minimization Principle Based on Complex Random Samples

作　　者：哈明虎[1] 田景峰[2] 张植明[1] 

机构地区：[1]河北大学数学与计算机学院,河北保定071002 [2]华北电力大学科技学院,河北保定071051

出　　处：《计算机研究与发展》2009年第11期1907-1916,共10页Journal of Computer Research and Development

基　　金：国家自然科学基金项目(60773062);教育部科学技术研究重点项目(206012);河北省教育厅科研计划重点项目(2005001D);河北省自然科学基金项目(2008000633)~~

摘　　要：统计学习理论目前是处理小样本学习问题的最佳理论.然而,该理论主要是针对实随机样本的,它难以讨论和处理现实世界中客观存在的涉及复随机样本的小样本统计学习问题.结构风险最小化原则是统计学习理论的核心内容之一,是构建支持向量机的重要基础.基于此,研究了基于复随机样本的统计学习理论的结构风险最小化原则.首先,给出了标志复可测函数集容量的退火熵、生长函数和VC维的定义,并证明了它们的一些性质;其次,构建了基于复随机样本的学习过程一致收敛速度的界;最后,给出了基于复随机样本的结构风险最小化原则,证明了该原则是一致的,同时推导出了收敛速度的界.Statistical learning theory is commonly regarded as a sound framework that handles a variety of learning problems in presence of small size data samples. However, statistical learning theory is based on real random samples （real number valued random variables） and as such is not ready to deal with the statistical learning problems involving complex random samples （complex number valued random variables）, which can be encountered in real world scenarios. Structural risk minimization principle is one of the kernel contents of statistical learning theory. The principle is the theoretical fundamental of establishing the support vector machine. Based on the above, the structural risk minimization principle of statistical learning theory based on complex random samples is explored. Firstly, the definitions of annealed entropy, growth function and VC dimension of a set of complex measurable functions are proposed and some important properties are proved. Secondly, the bounds on the rate of uniform convergence of learning process based on complex random samples are constructed. Finally, the structural risk minimization principle of complex random samples is proposed. The consistency of this principle is proven, and asymptotic bounds on the rate of convergence are derived. The investigations will help lay essential theoretical foundations for establishing support vector machine based on complex random samples.

关 键 词：统计学习理论 结构风险最小化原则 支持向量机 复随机样本 VC维 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]