EmotionMap:Visual Analysis of Video Emotional Content on a Map  

作　　者：Cui-Xia Ma Jian-Cheng Song Qian Zhu Kevin Maher Ze-Yuan Huang Hong-An Wang 

机构地区：[1]State Key Laboratory of Computer Science,Institute of Software,Chinese Academy of Sciences,Beijing 100190,China [2]Beijing Key Laboratory of Human-Computer Interaction,Institute of Software Chinese Academy of Sciences,Beijing 100190,China [3]University of Chinese Academy of Sciences,Beijing 100190,China [4]Academy of Arts and Design,Tsinghua University,Beijing 100084,China

出　　处：《Journal of Computer Science & Technology》2020年第3期576-591,共16页计算机科学技术学报（英文版）

基　　金：This work was supported by the National Key Research and Development Program of China under Grant No.2016YFB1001200;the National Natural Science Foundation of China under Grant No.61872346;the Strategic Priority Research Program of the Chinese Academy of Sciences under Grant No.19080102.

摘　　要：Emotion plays a crucial role in gratifying users’needs during their experience of movies and TV series,and may be underutilized as a framework for exploring video content and analysis.In this paper,we present EmotionMap,a novel way of presenting emotion for daily users in 2D geography,fusing spatio-temporal information with emotional data.The interface is composed of novel visualization elements interconnected to facilitate video content exploration,understanding,and searching.EmotionMap allows understanding of the overall emotion at a glance while also giving a rapid understanding of the details.Firstly,we develop EmotionDisc which is an effective tool for collecting audiences’emotion based on emotion representation models.We collect audience and character emotional data,and then integrate the metaphor of a map to visualize video content and emotion in a hierarchical structure.EmotionMap combines sketch interaction,providing a natural approach for users’active exploration.The novelty and the effectiveness of EmotionMap have been demonstrated by the user study and experts’feedback.

关 键 词：video visualization emotion analysis visual analysis sketch interaction 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]