基于信息论的连续属性离散化  

Discretization of continuous-valued attributes using information theory

作　　者：徐如燕[1] 鲁汉榕[2] 郭齐胜 

机构地区：[1]装甲兵工程学院,北京100072 [2]空军雷达学院,武汉430010

出　　处：《计算机工程与设计》2002年第2期62-64,共3页Computer Engineering and Design

摘　　要：使用信息论的方法进行连续属性的离散化。引入 Ｈｅｌｌｉｎｇｅｒ偏差 ＨＤ（Ｈｅｌｌｉｎｇｅｒ Ｄｉｖｅｒｇｅｎｃｅ）作为每个区间对决策的信息量度量，从而定义切分点的信息熵，最终的离散化结果是使各区间的信息量尽可能平均。分析了ＨＤ度量在两种离散化方法中的作用，说明它在划分算法中运用比较理想，而在归并算法中则有局限。This paper adopts the method of information theory in the discretization of continuous numerical values. This paper introduces hellinger divergence as the measure of amount of information that each potential interval gives to the decision attributes. Then the entropy of cutpoint is defined. This aim is to discretize numeric values so that the information content of each interval is as equal as possible. This paper analyzes the act of Hellinger divergence in both discretization algorithms of merging and splitting, and draw a conclusion that it is a fairly ideal measure in the latter and has some limitations in the former.

关 键 词：连续属性离散化 信息论 知识发现 机器学习 

分 类 号：TP182[自动化与计算机技术—控制理论与控制工程]