Contextual modeling on auxiliary points for robust image reranking  

作　　者：Ying LI Xiangwei KONG Haiyan FU Qi TIAN 

机构地区：[1]School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China [2]Department of Computer Science, University of Texas at San Antonio, Texas 78249, USA

出　　处：《Frontiers of Computer Science》2019年第5期1010-1022,共13页中国计算机科学前沿（英文版）

基　　金：This work was supported in part by the Foundation for Innovative Research Groups of the National Natural Science Foundation of China (NSFC)(Grant No. 71421001);in part by the National Natural Science Foundation of China (NSFC)(Grant Nos. 61502073, 61772111 and 61429201);in part by the Fundamental Research Funds for the Central Universities (DUT18JC02);in part to Dr. Qi Tian by ARO (W911NF-15- 1-0290) and Faculty Research Gift Awards by NEC Laboratories of America and Blippar. This work was supported in part by the China Scholarship Council.

摘　　要：Image reranking is an effective post-processing step to adjust the similarity order in image retrieval. As key components of initialized ranking lists, top-ranked neighborhoods of a given query usually play important roles in constructing dissimilarity measure. However, the number of pertinent candidates varies with respect to different queries. Thus the images with short lists of ground truth suffer from insufficient contextual information. It consequently introduces noises when using k-nearest neighbor rule to define the context. In order to alleviate this problem, this paper proposes auxiliary points which are added as assistant neighbors in an unsupervised manner. These extra points act on revealing implicit similarity in the metric space and clustering matched image pairs. By isometrically embedding each constructed metric space into the Euclidean space, the image relationships on underlying topological manifolds are locally represented by distance descriptions. Furthermore, by combining Jaccard index with our auxiliary points, we present a contextual modeling on auxiliary points ( CMAP ) method for image reranking. With richer contextual activations, the Jaccard similarity coefficient defined by local distribution achieves more reliable outputs as well as more stable parameters. Extensive experiments demonstrate the robustness and effectiveness of the proposed method.

关 键 词：IMAGE retrieval UNSUPERVISED RERANKING context construction Jaccard distance QUERY expansion 

分 类 号：TP[自动化与计算机技术]