具有纹理感知能力的超像素分割方法  

Superpixel segmentation with texture awareness

作　　者：吴江 刘春晓[1] Wu Jiang;Liu Chunxiao(School of Computer Science and Information Engineering,Zhejiang Gongshang University,Hangzhou 310018,China)

机构地区：[1]浙江工商大学计算机与信息工程学院,杭州310018

出　　处：《中国图象图形学报》2021年第5期1006-1016,共11页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61003188,61379075);国家科技支撑计划项目(2014BAK14B01);浙江省自然科学基金项目(LY14F020004);浙江省公益性技术应用研究计划项目(2015C33071);浙江工商大学青年人才基金项目(QZ13-9);浙江省智能交通工程技术研究中心开放课题项目(2015ERCITZJ-KF1)。

摘　　要：目的超像素分割是计算机视觉领域常用的一项预处理技术,目标是将相邻像素聚集成为具有一定语义的子区域,能够大幅度降低后续处理的计算复杂度,但是对包含强梯度纹理的图像分割效果不佳,为此提出一种具有纹理感知能力的超像素分割方法。方法提出一种能够区分强梯度噪声和纹理像素的颜色距离,其中利用带方向的1/4圆形窗口均值滤波后的颜色信息,提升包含强梯度噪声和纹理图像的超像素分割性能。利用区间梯度幅值与Sobel梯度幅值相乘得到混合梯度幅值,具有纹理抑制、结构保持以及边缘线条细的优点,能够提升超像素的贴合边缘性能,增强超像素形状规则程度。最后,利用混合梯度的幅值计算具有结构回避能力的综合聚类距离,进一步防止超像素跨越物体的边界,增强超像素的贴边性能。结果在BSDS500(Berkeley segmentation dataset 500)图像数据集和强纹理马赛克图像等不同类型图像上的测试结果显示,与目前主流的超像素分割方法相比,本文算法在UE(undersegmentation error)、ASA(achievable segmentation accuracy)和CM(compactness measure)等性能指标上分别提高了1.5%、0.2%和4.3%。从视觉效果上看,能够在排除纹理干扰的情况下生成结构边缘贴合程度更好的形状规则超像素。结论本文算法在包含强梯度纹理图像上的超像素分割性能优于对比方法,在目标识别、目标追踪和显著性检测等易受强梯度干扰的技术领域具有较大应用潜力。Objective Superpixel segmentation is widely used as a preprocessing step in many computer vision applications.It groups the pixels of an image into homogeneous regions while trying to respect the object boundary.Generally,a good superpixel segmentation method would meet the following three conditions.First,the boundaries of the superpixel should adhere well to the image boundaries.Second,the boundaries of the superpixel should not wing across different objects in the image.Third,superpixels should have similar sizes and regular shapes.In recent years,various superpixel segmentation methods have been proposed;however,most of these state-of-the-art methods only use the pixel information as a clustering feature.Therefore,they can be severely impacted by high-frequency contrast variations and fail to produce equally sized regions having the same texture.To make superpixels robust to contrast variations such as strong gradient texture,we propose a texture-aware superpixel segmentation algorithm that uses patch-level features for clustering purposes.Method The main idea of our algorithm is to calculate the color distance by using a specially designed quarter-circular mean filtering operator.Because the mean filtering has the characteristics of noise suppression and texture smoothing and the rotated quarter-circular window ensures that the mean filtering sampled pixels are located inside the superpixels as much as possible,the quarter-circular mean filtering operator has the capacity to identify the texture pattern.The Sobel gradient has the advantages of fast speed and thin edge,but it is easy to be disturbed by strong gradient texture.The interval gradient is characterized by texture suppression and structure preservation,but its edge is too thick.To overcome their shortcomings while retaining their strengths,we devise a hybrid gradient based on the multiplication of the Sobel gradient and interval gradient,which has the advantages of texture suppression,structure preservation,and edge thinning;therefore,its magnitude

关 键 词：图像分割 超像素 聚类 强梯度纹理 图像块 线性路径 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]