ID3算法的合理性证明及实验分析  

The Proof of Rationality of ID3 Algorithm and Experimental Analysis

作　　者：左吉峰[1,2] 乔均俭[2] 

机构地区：[1]河北大学数学与计算机学院,河北保定071002 [2]河北农业大学理学院,河北保定071001

出　　处：《保定学院学报》2008年第4期24-27,共4页Journal of Baoding University

基　　金：河北农业大学非生命学科与新兴学科科研发展基金(FSY200739)

摘　　要：研究一个属性的某几个属性值并的权熵之和与该属性单个属性值的权熵之和的关系,从理论上证明一个属性的某几个属性值并的权熵之和不小于该属性单个属性值的权熵之和.为ID3算法的合理性提供理论基础.实验结果证明结论正确.The relation between the weighted entropy of the union of several attribute values and the sum of the weighted entropy of the single attribute value is studied. The proof is given for the conclusion that the weighted entropy of the union of several attribute values is not less than the sum of the weighted entropy of the single attribute value, and the theoretical foundation for ID3 algorithm is presented. The results of the experiment conform the conclusion.

关 键 词：信息熵 ID3算法 决策树 条件属性 决策属性 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]