融合显著深度特征的RGB-D图像显著目标检测  

RGB-D Saliency Detection Based on Integration Feature of Color and Depth Saliency Map

作　　者：吴建国[1,2] 邵婷[1,2] 刘政怡[1,2] 

机构地区：[1]安徽大学信息保障技术协同创新中心,合肥230601 [2]安徽大学计算机科学与技术学院,合肥230601

出　　处：《电子与信息学报》2017年第9期2148-2154,共7页Journal of Electronics & Information Technology

基　　金：国家科技支撑计划(2015BAK24B00);高等学校博士学科点专项科研基金(20133401110009);安徽高校省级自然科学研究项目(KJ2015A009);安徽大学信息保障技术协同创新中心开放课题~~

摘　　要：深度信息被证明是人类视觉的重要组成部分,然而大部分显著性检测工作侧重于2维图像上的方法,并不能很好地利用深度进行RGB-D图像显著性检测。该文提出一种融合显著深度特征的RGB-D图像显著目标检测方法,提取基于颜色和深度显著图的综合特征,根据构图先验和背景先验的方法进行显著目标检测。首先,对原始深度图进行预处理:使用背景顶点区域、构图交点和紧密度处理深度图,多角度融合形成深度显著图,并作为显著深度特征,结合颜色特征形成综合特征;其次,从前景角度,将综合特征通过边连接权重构造关联矩阵,根据构图先验,假设多层中心矩形为前景种子,通过流形排序方法计算出RGB-D图像的前景显著图;从背景角度,根据背景先验以及边界连通性计算出背景显著图;最后,将前景显著图和背景显著图进行融合并优化得到最终显著图。实验采用RGB-D1000数据集进行显著性检测,并与4种不同的方法进行对比,所提方法的显著性检测结果更接近人工标定结果,PR(查准率-查全率)曲线显示在相同召回率下准确率高于其他方法。Depth information is proved to be an important part of human vision. However, most saliency detection methods based on 2D images do not make good use of depth information, thus an effective saliency detection method for RGB-D image is presented. It extracts color feature combined with depth saliency feature and detects salient objects based on photographic composition prior and background prior. First, original depth map is preprocessed to form depth saliency feature by background vertex area, photographic composition intersections, and compactness method. Then the association matrix is constructed by the adjacency weight of comprehensive feature. Manifold ranking is running from foreground view to form foreground saliency map based on photographic composition prior and fusion of depth saliency feature and color feature. In order to correct the error caused by assumption, the boundary connectivity is used to suppress background from background view. Final saliency map builds on fusion of foreground and background saliency map. Experiments compared with 4 different methods on RGB-D1000 database show that the proposed method has better precision-recall curve and outperforms the state- of-the-art methods.

关 键 词：显著目标检测 显著深度特征 多层中心矩形 流形排序 构图先验 背景先验 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]