Real-time distance field acceleration based free-viewpoint video synthesis for large sports fields  

作　　者：Yanran Dai Jing Li Yuqi Jiang Haidong Qin Bang Liang Shikuan Hong Haozhe Pan Tao Yang 

机构地区：[1]School of Telecommunications Engineering,Xidian University,Xi’an 710071,China [2]National Engineering Laboratory for Integrated AeroSpace-Ground-Ocean Big Data Application Technology,SAIIP,the School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China

出　　处：《Computational Visual Media》2024年第2期331-353,共23页计算可视媒体（英文版）

基　　金：supported by the National Natural Science Foundation of China(Nos.62172315,62073262,and 61672429);the Fundamental Research Funds for the Central Universities,the Innovation Fund of Xidian University(No.20109205456);the Key Research and Development Program of Shaanxi(No.S2021-YF-ZDCXL-ZDLGY-0127),and HUAWEI.

摘　　要：Free-viewpoint video allows the user to view objects from any virtual perspective,creating an immersive visual experience.This technology enhances the interactivity and freedom of multimedia performances.However,many free-viewpoint video synthesis methods hardly satisfy the requirement to work in real time with high precision,particularly for sports fields having large areas and numerous moving objects.To address these issues,we propose a freeviewpoint video synthesis method based on distance field acceleration.The central idea is to fuse multiview distance field information and use it to adjust the search step size adaptively.Adaptive step size search is used in two ways:for fast estimation of multiobject three-dimensional surfaces,and synthetic view rendering based on global occlusion judgement.We have implemented our ideas using parallel computing for interactive display,using CUDA and OpenGL frameworks,and have used real-world and simulated experimental datasets for evaluation.The results show that the proposed method can render free-viewpoint videos with multiple objects on large sports fields at 25 fps.Furthermore,the visual quality of our synthetic novel viewpoint images exceeds that of state-of-the-art neural-rendering-based methods.

关 键 词：free-viewpoint video view synthesis camera array distance field sports video 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]