高维分布式局部敏感哈希索引方法  

High-Dimensional Distributed Indexing Based on Locality-Sensitive Hashing

作　　者：林朝晖[1] 于俊清[1,2] 何云峰[1] 管涛[1] 艾列富[1] 

机构地区：[1]华中科技大学计算机科学与技术学院,武汉430074 [2]华中科技大学网络与计算中心,武汉430074

出　　处：《计算机科学与探索》2013年第9期811-818,共8页Journal of Frontiers of Computer Science and Technology

基　　金：国家自然科学基金Nos.61173114;61202300;61272202;湖北省杰出青年基金No.2010CDA084;广东省产学研项目No.2011B090400251~~

摘　　要：为了解决基于内容的图像检索中存在的索引存储量大和构建索引计算开销大等问题,在系统地分析局部敏感哈希索引算法及Hadoop分布式系统的基础上,改进了现有高维索引计算模型和索引结构方法。根据局部敏感哈希索引的特点,将现有局部敏感哈希索引改为松耦合的索引结构,将索引文件分布式部署在多个查询节点中实现了高并发的索引查询。通过MapReduce分布式计算模型实现了索引的并行构造,提高了索引构造的效率,并采用分布式数据库存储海量高维索引数据,增强了系统可扩展性。实验结果表明,该算法具有一定的可行性。To overcome the problems of high memory consumption and computational overhead of high-dimensional indexing in content-based image search engine, the locality-sensitive hashing （LSH） index and Hadoop can be combined to improve the performance of the index architecture and computational model. According to the features of LSH index, the structure of LSH index is modified to a loosely coupled structure, and the index files are deployed in the distributed query nodes for high concurrency index-guery. The MapReduce distributed computational model is used in index con- structing process to improve the efficiency of high-dimensional index creation. Besides, the distributed database is used to store large amounts of high-dimensional index data, which enhances the system＇ s scalability. The experimental results show that the proposed methods are reasonable.

关 键 词：局部敏感哈希 分布式索引 基于内容图像检索 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]