视觉光流计算技术及其应用  

Visual Optical Flow Computing:Algorithms and Applications

作　　者：崔毅博 汤仁东 邢大军 王隽 李尚生 CUI Yibo;TANG Rendong;XING Dajun;WANG Juan;LI Shangsheng(Naval Aviation University,Yantai 264001,China;Academy of Military Medical Sciences,Beijing 100850,China;State Key Laboratory of Cognitive Neuroscience and Learning,Beijing 100875,China;Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China)

机构地区：[1]海军航空大学,烟台264001 [2]军事医学研究院,北京100850 [3]北京师范大学认知神经科学与学习国家重点实验室,北京100875 [4]中国科学院自动化研究所,北京100190

出　　处：《电子与信息学报》2023年第8期2710-2721,共12页Journal of Electronics & Information Technology

摘　　要：视觉光流计算是计算机视觉从处理2维图像走向加工3维视频的重要技术手段,是描述视觉运动信息的主要方式。光流计算技术已经发展了较长的时间,随着相关技术尤其是深度学习技术在近些年的迅速发展,光流计算的性能得到了极大提升,但仍然有大量的局限性问题没有解决,准确、快速且稳健的光流计算目前仍然是一个有挑战性的研究领域和业内研究热点。光流计算作为一种低层视觉信息处理技术,其技术进展也将有助于相关中高层级视觉任务的实现。该文主要内容是介绍基于计算机视觉的光流计算及其技术发展路线,从经典算法和深度学习算法这两个主流技术路线出发,总结了技术发展过程中产生的重要理论、方法与模型,着重介绍了各类方法与模型的核心思想,说明了各类数据集及相关性能指标,同时简要介绍了光流计算技术的主要应用场景,并对今后的技术方向进行了展望。Visual optical flow calculation is an important technique for computer vision to move from processing 2D images to processing 3D videos,and is the main way of describing visual motion information.The optical flow calculation technique has been developed for a long time.With the rapid development of related technologies,especially deep learning technology in recent years,the performance of optical flow calculation has been greatly improved.However,there are still many limitations that have not been solved.Accurate,fast,and robust optical flow calculation is still a challenging research field and a hot topic in the industry.As a low-level visual information processing technology,the implementation of related high-level visual tasks will also be contributed by the technological advances of optical flow calculation.In this paper,the development path of optical flow calculation based on computer vision is mainly introduced.The important theories,methods,and models generated during the technological development process from the two mainstream technology paths of classical algorithms and deep learning algorithms are summarized,the core ideas of various methods and models are being introduced and the various datasets and performance indicators are explained,the main application scenarios of optical flow calculation technology are briefly introduced,and the future technical directions are also prospected.

关 键 词：计算机视觉 光流 深度学习 综述 

分 类 号：TN919.8[电子电信—通信与信息系统] TP391.41[电子电信—信息与通信工程]