分布式全文检索技术的研究及应用  

Research and application of distributed full-text retrieval technology

作　　者：葛云生[1] 孔杰 GE Yun-sheng;KONG Jie(College of Information Science and Engineering,Guilin University of Technology,Guilin 541000,China)

机构地区：[1]桂林理工大学信息科学与工程学院,广西桂林541000

出　　处：《计算机工程与设计》2018年第9期2997-3001,共5页Computer Engineering and Design

基　　金："嵌入式技术与智能信息处理"广西高校重点实验室基金项目;国家自然科学基金项目(61262076)

摘　　要：为有效解决分布式对海量数据的资源管理、共享资源并发访问控制以及如何对海量数据进行快速且准确的检索,提出一种基于zookeeper的分布式服务协调模型为分布式提供资源的管理和并发访问的控制,在lucene搜索引擎的基础上,采用组件技术并在BM25F算法的基础上添加时间因子分别对文档进行解析,创建索引和检索结果排序算法进行优化的方案。系统应用结果表明,该方案有效解决了分布式的资源管理和控制问题,提高了检索的效率和准确度。To effectively solve the distributed data management of mass data,shared resources,concurrent access control,and to retrieve massive data quickly and accurately,a distributed service coordination model based on zookeeper was proposed for distributed resource management and concurrent access control.On the basis of the lucene search engine,component technology was used and time factor was added based on BM25F algorithm to parse document respectively,and the index and retrieval results sorting algorithm was created for optimization.The application of the system shows that the proposed scheme effectively solves the problem of distributed resource management and control,and improves the efficiency and accuracy of retrieval.

关 键 词：zookeeper框架 分布式 lucene搜索引擎 文档解析 BM25F算法 

分 类 号：TP311.52[自动化与计算机技术—计算机软件与理论]