一种劣质数据上统计量的获取方法  

A Method for Acquire Statistics on Dirty Database

作　　者：张岩[1] 唐兴[1] 

机构地区：[1]哈尔滨工业大学计算机科学与技术学院,哈尔滨150001

出　　处：《智能计算机与应用》2014年第5期26-28,31,共4页Intelligent Computer and Applications

基　　金：国家自然科学基金(61133002);国家重点基础研究发展计划(973)(2012CB316202)

摘　　要：随着数据时代的发展,劣质数据越来越普遍存在于数据库中,严重影响了数据的质量,这给数据管理带来了新的挑战.目前,已经有很多管理劣质数据的数据模型面世,实体数据模型就是其中一种,模型以每条元组表示一个现实世界中的实体,允许劣质数据的存在,鉴于该模型的特点,在进行查询操作时,要根据查询语句和数据的相似程度判断数据是否满足用户需求,因此在实体数据模型相似判断的查询操作中,统计数据库中某条记录大约可以和多少记录相似即能为查询优化工作做一定的贡献,本文就如何获取这个统计量展开研究并提出一种有效的聚类算法解决这个问题。Along with the development of the era of data, dirty data is more and more widely existing in the database, and produces the serious influence in the quality of the data, which brings new challenges to data management. Nowdays, there emerges a lot of data model for dirty data management, one of them is entity - based relational data model in which one tup- le represents an entity in real - world, and allows for the possibility of bad data. In view of the characteristics of the model in the query operation, according to the similarity of the query and data to judge whether the data is what user＇ s require- ments, so in the query operations of the entity data model similarity judgment, counting how many records similar with one record in the database could do certain contribution for query optimization work. Based on the aboved, this article provides the research on how to obtain the statistic and put forward a kind of effective clustering algorithm to solve this problem.

关 键 词：劣质数据 聚类 统计量 查询优化 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]