跨模态检索的鉴别子空间学习方法  

Discriminative Subspace Learning Method for Cross-Modal Retrieval

作　　者：章浩明 吴小俊 徐天阳 张东霖 ZHANG Hao-ming;WU Xiao-jun;XU Tian-yang;ZHANG Dong-lin(School of Artificial Intelligence and Computer Science,Jiangnan University,Wuxi Jiangsu 214122,China;Jiangsu Provincial Laboratory of Pattern Recognition and Computational Intelligence,Jiangnan University,Wuxi Jiangsu 214122,China)

机构地区：[1]江南大学人工智能与计算机学院,江苏无锡214122 [2]江南大学江苏省模式识别与计算智能工程实验室,江苏无锡214122

出　　处：《计算机仿真》2023年第12期556-562,共7页Computer Simulation

基　　金：国家自然科学基金(61672265,U1836218,62020106012);中国教育部111项目(B12018)。

摘　　要：许多现有的基于子空间学习的跨模态检索方法只集中于学习一个潜在的子空间,忽略了对鉴别性信息的充分利用,没有很好地保留语义结构信息。为了弥补这一不足,提出了一种跨模态检索的鉴别子空间学习方法(DSL),首先构建一个共享语义图来保留每个模态中的语义结构,随后引入希尔伯特-施密特独立性准则(HSIC)来保持样本的特征和语义相似度之间的一致性,最后构建角度重构方案。由此DSL可以弥补鉴别性数据使用不足的缺陷,更好地保留每个模态的语义结构信息。在两个常用的基准数据集上进行实验,结果表明上述方法相对于经典子空间学习方法更具有效性。Many existing cross-modal retrieval methods based on subspace learning only focus on learning a latent subspace.They ignore the full use of discriminative information so that the semantic structure information is not well preserved.This paper proposes a discriminative subspace learning for cross-modalretrieval(DSL).Based on the DSL,a shared semantic graph was constructed to preserve the semantic structure within each modality.Subsequently,the Hilbert-Schmidt Independence Criteria(HSIC)was introduced to preserve the consistence between feature-similar⁃ityand semantic-similarity of samples.Thirdly,an angular reconstructive scheme was ntroduced,thus DSL can com⁃pensate for the shortcomings of insufficient use of discriminative data and better preserve the semantically structural information within each modality.The experimental results obtained on two well-known benchmark datasets demon⁃strate the effectiveness of the proposed method against the compared classic subspace learning approaches.

关 键 词：核相关性 跨模态检索 子空间学习 监督学习 鉴别性 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]