面向Spark的图书借阅数据关联模型的研究  

Research of associative model for libraries' book lending data based on the spark

作　　者：高琪娟[1] 刘锴[2] 陈佳 GAO Qijuan1, LIU Kai2, CHEN Jia3(1. School of Information and Computer Science, Anhui Agricultural University, Hefei 230036; 2. Modem Educational Technology Center of Anhui Agricultural University, Hefei 230036; 3. High-standard clustering Service Center Department of China Telecom Co., Ltd., Wuhu 24100)

机构地区：[1]安徽农业大学信息与计算机学院,合肥230036 [2]安徽农业大学现代教育信息中心,合肥230036 [3]中国电信芜湖分公司高端聚类服务中心,芜湖241003

出　　处：《安徽农业大学学报》2018年第4期768-771,共4页Journal of Anhui Agricultural University

摘　　要：为了方便读者能在海量的图书资源中快速有效的找到需要的书籍,利用Map Reduce框架分块处理,结合关联分析Apriori算法,将数据挖掘技术应用到图书管理系统中。但需要多次扫描数据库和产生大量候选集,对Hadoop平台处理速度带来了巨大挑战,因此,针对传统的Apriori算法,提出基于内存计算、弹性分布式数据集处理的Spark平台为读者推荐书籍,指引读者的借阅行为。In order to search the required books from a tremendous amount of resources immediately for authors, we tried to use the method of MapReduce for dealing the process of block data, combining the algorithm of Apriori, and applying data mining technology to the library management system. But the method referring to above need scan database many times and emerge a large number of candidate set, which will produce tremendous challenge to the speed with Hadoop processing method. Thus, compared to the tradition method of Apriori, there is a new method based on the memory and RDD to compute in Spark platform to recommending books for readers and guiding their borrowing behavior.

关 键 词：Apriori关联规则 Spark平台 图书借阅行为模式 频繁项集 

分 类 号：TP391.3[自动化与计算机技术—计算机应用技术]