基于注视兴趣区域聚类和转移的群体扫视路径生成  

Group scanpath generation based on fixation regions of interest clustering and transferring

作　　者：刘楠博 肖芬 张文雷 李旺鑫 翁尊 LIU Nanbo;XIAO Fen;ZHANG Wenlei;LI Wangxin;WENG Zun(Key Laboratory of Intelligent Computing and Information Processing,Ministry of Education(Xiangtan University),Xiangtan Hunan 411105,China)

机构地区：[1]智能计算与信息处理教育部重点实验室(湘潭大学),湖南湘潭411105

出　　处：《计算机应用》2021年第1期150-156,共7页journal of Computer Applications

基　　金：湖南省自然科学基金资助项目(2018JJ2405);湖南省教育厅创新平台开放基金资助项目(18K034)。

摘　　要：为解决自然场景下群体观察者扫视路径数据冗余繁乱、缺乏表征的问题,通过挖掘个体路径的潜在特性,提出了一种基于注视兴趣区域(ROI)时空聚类和转移的群体扫视路径生成方法。首先,分析同一刺激样本下多名观察者的扫视路径,利用亲和力传播聚类算法来聚类注视点以生成多个注视兴趣区域;其次,统计分析兴趣区域的观察者数量、注视频率以及注视时长等与注视强度相关的信息并筛选兴趣区域;然后,通过定义兴趣区域中的注视行为提取不同类型的兴趣子区域;最后,提出了基于注视优先度的兴趣区域和兴趣子区域转移模式,从而生成自然场景下的群体扫视路径。在MIT1003和OSIE公共数据集上进行群体扫视路径生成实验,结果表明,与目前先进的eMine、扫视路径趋势分析(STA)、序列模式挖掘算法(SPAM)、基于候选约束的动态时间规整质心平均方法(CDBA)和Heuristic方法相比,所提方法生成的群体扫视路径获得了较高的整体相似度,ScanMatch(w/o duration)分别可达0.426和0.467,ScanMatch(w/duration)分别可达0.404和0.439。可见该所生成的扫视路径与真实扫视路径的整体相似度较高,具有一定表征作用。For redundancy chaos,and the lack of representation of group observers􀆳scanpath data in natural scenes,by mining the potential characteristics of individual scanpaths,a method for group scanpath generation based on fixation Regions of Interest(ROI)spatial temporal clustering and transferring was proposed.Firstly,multiple observers’scanpaths under the same stimulus sample were analyzed,and multiple fixation regions of interest were generated by utilizing affinity propagation clustering algorithm to cluster the fixation points.Then,the statistics and analysis of the information related to fixation intensity such as the number of observers,fixation frequency and lasting time were carried out and the regions of interest were filtered.Afterwards,the subregions of interest with different types were extracted via defining fixation behaviors in the regions of interest.Finally,the transformation mode of regions and subregions of interest was proposed on the basis of fixation priority,so as to generate the group scanpath in natural scenes.The group scanpath generation experiments were conducted on two public datasets MIT1003 and OSIE.The results show that compared with the state-of-the-art methods,such as eMine,Scanpath Trend Analysis(STA),Sequential Pattern Mining Algorithm(SPAM),Candidate-constrained Dynamic time warping Barycenter Averaging method(CDBA)and Heuristic,the proposed method has the group scanpath generated of higher entirety similarity indexes with ScanMatch(w/o duration)reached 0.426 and 0.467 respectively,and ScanMatch(w/duration)reached 0.404 and 0.439 respectively.It can be seen that the scanpath generated by the proposed method has high overall similarity to the real scanpath,and has a certain function of representation.

关 键 词：自然场景 扫视路径 群体扫视路径 注视兴趣区域 注视行为 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]