Detection of salient objects with focused attention based on spatial and temporal coherence  

作　　者：WU Yang ZHENG NanNing YUAN ZeJian JIANG HuaiZu LIU Tie 

机构地区：[1]Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi 'an 710049, China [2]IBM Research-China, Beijing 100193, China

出　　处：《Chinese Science Bulletin》2011年第10期1055-1062,共8页

基　　金：supported by the National Natural Science Foundation of China(60635050 and 90820017);the National Basic Research Program of China(2007CB311005)

摘　　要：The understanding and analysis of video content are fundamentally important for numerous applications,including video summarization,retrieval,navigation,and editing.An important part of this process is to detect salient (which usually means important and interesting) objects in video segments.Unlike existing approaches,we propose a method that combines the saliency measurement with spatial and temporal coherence.The integration of spatial and temporal coherence is inspired by the focused attention in human vision.In the proposed method,the spatial coherence of low-level visual grouping cues (e.g.appearance and motion) helps per-frame object-background separation,while the temporal coherence of the object properties (e.g.shape and appearance) ensures consistent object localization over time,and thus the method is robust to unexpected environment changes and camera vibrations.Having developed an efficient optimization strategy based on coarse-to-fine multi-scale dynamic programming,we evaluate our method using a challenging dataset that is freely available together with this paper.We show the effectiveness and complementariness of the two types of coherence,and demonstrate that they can significantly improve the performance of salient object detection in videos.The understanding and analysis of video content are fundamentally important for numerous applications, including video summarization, retrieval, navigation, and editing. An important part of this process is to detect salient （which usually means important and interesting） objects in video segments. Unlike existing approaches, we propose a method that combines the saliency measurement with spatial and temporal coherence. The integration of spatial and temporal coherence is inspired by the focused attention in human vision. In the proposed method, the spatial coherence of low-level visual grouping cues （e.g. appearance and motion） helps per-frame object-background separation, while the temporal coherence of the object properties （e.g. shape and appearance） ensures consistent object localization over time, and thus the method is robust to unexpected environment changes and camera vibrations. Having developed an efficient optimization strategy based on coarse-to-fine multi-scale dynamic programming we evaluate our method using a challenging dataset that is freely available together with this paper. We show the effectiveness and complementariness of the two types of coherence, and demonstrate that they can significantly improve the performance of salient object detection in videos.

关 键 词：时间相干性 空间相干性 连贯性 检测 突出 视频内容 组成部分 人类视觉 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] O436.1[自动化与计算机技术—计算机科学与技术]