基于运动路径全曲率的视频稳定质量评价  

Video Stabilization Quality Assessment Based on Total Curvature of Motion Path

作　　者：郑清卓 张磊[1] 黄华[1] ZHENG Qing-Zhuo;ZHANG Lei;HUANG Hua(School of Computer Science and Technology,Beijing Institute of Technology,Beijing 100081)

机构地区：[1]北京理工大学计算机学院,北京100081

出　　处：《计算机学报》2018年第11期2524-2535,共12页Chinese Journal of Computers

基　　金：国家自然科学基金面上项目(61772069);国家杰出青年科学基金(61425013)资助

摘　　要：现有的无参考视频稳定质量评价算法存在对剧烈的抖动敏感或与主观评价结果一致性不高等问题.针对这些问题,提出了一种直接度量视频运动路径平滑程度的无参考视频稳定评价算法.首先检测相邻两帧图像的特征点,计算相邻帧间单应变换;然后将单应变换映射到李群空间形成运动路径;最后借助离散测地逼近方法计算运动路径全曲率,以此衡量运动路径平滑程度,进而评价视频稳定程度.为了验证评价的有效性,根据已公开的数据集构建了150段抖动视频及其稳定处理后的视频组成的数据集进行测试.实验结果表明,该文算法获得的视频稳定评价结果与人眼主观评价结果的相关性达到97%,相比于帧间保真度、频域分析等现有评价算法提高20%以上.与全参考视频稳定质量评价算法的一致性对比结果进一步验证了该文算法的有效性.A video captured with a hand-held device(e.g.,cell-phone or tablet computer)often appears remarkably shaky.It has a great negative impact on people’s visual perception and is difficult for the following processing of the video.As a technology that can remove video jitter to enhance visual quality,video stabilization algorithms have been widely and deeply studied in the last ten years.However,how to effectively evaluate the performance of video stabilization algorithms is a topic that has not been studied deeply.Due to the lack of a comprehensive and fair evaluation mechanism,it is impossible to judge the performance of video stabilization algorithm objectively,which makes it difficult for users to choose video stabilization algorithm.The video stabilization objective assessment can be divided into two ways:non-reference and full-reference.The full-reference method needs the benchmark video,then calculates the difference between the evaluated video and the benchmark video,and then evaluates the stability of the video.Non-reference method is used to analyze the jitter characteristics of video directly through the motion information of video,and then evaluates the video stability.Compared with the full-reference methods,non-reference methods are more flexible and economical.But the existing non-reference video quality assessment algorithms have some problems,such as sensitive to video with severe jitter or inconsistent with the subjective assessment.In view of these problems,a non-reference video stability assessment method for directly measuring the smoothness of video motion path is proposed.Firstly,we detect the feature points of adjacent frames,and then calculate the inter-frame homography matrix.Homography matrix can accurately describe the translation,rotation and other transformations between video frames.Secondly,we map the homography matrices in the Lie Group space to form the motion path.Finally,we calculate the total curvature by using the discrete geodesic approximation method to measure the smoothness

关 键 词：视频稳定质量评价 全曲率 单应变换 运动路径 李群 视觉运动感知 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]