Interactive multi-scale structures for summarizing video content  

作　　者：WANG HongAn MA CuiXia 

机构地区：[1]State Key Laboratory of Computer Science,Institute of Software,Chinese Academy of Sciences [2]Beijing Key Laboratory of Human-Computer Interaction,Institute of Software,Chinese Academy of Sciences

出　　处：《Science China(Information Sciences)》2013年第5期98-109,共12页中国科学（信息科学）（英文版）

基　　金：supported by National Basic Research Program of China (973 Program) (Grant Nos. 2013CB3293-05,2011CB302205);National Natural Science Foundation of China (Grant Nos. 61173058,61232013);Distinguished Young Scientists Program of the Institute of Software,CAS (Grant No. ISCAS2011-JQ01);National High-tech R&D Program of China (863 Program) (Grant No. 2012AA02A608)

摘　　要：Efficient video summarization leads to facilely exploring video content appropriate to the user＇s intention with low cognitive demand. In this paper, we present a novel approach for summarizing videos in the form of multi-scale structures that exhibit different video features at different scale levels and allow exploration of video contents with multi-scale interaction. The semantic relationship between structures is addressed and user intention is also considered and integrated in the summarization and interaction. This paper first introduces the concept of multi-scale structures for summarizing video content and describes three different types of structures that present important features at different scale levels. Furthermore, a continuous zooming interaction for browsing multi-scale structures is provided to facilitate video browsing. Finally, an elaborate user study is conducted showing that user performance on understanding and browsing videos is improvedEfficient video summarization leads to facilely exploring video content appropriate to the user＇s intention with low cognitive demand. In this paper, we present a novel approach for summarizing videos in the form of multi-scale structures that exhibit different video features at different scale levels and allow exploration of video contents with multi-scale interaction. The semantic relationship between structures is addressed and user intention is also considered and integrated in the summarization and interaction. This paper first introduces the concept of multi-scale structures for summarizing video content and describes three different types of structures that present important features at different scale levels. Furthermore, a continuous zooming interaction for browsing multi-scale structures is provided to facilitate video browsing. Finally, an elaborate user study is conducted showing that user performance on understanding and browsing videos is improved

关 键 词：MULTI-SCALE video summarization SKETCH VISUALIZATION INTERACTION 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TN919.81[自动化与计算机技术—计算机科学与技术]