Dynamic ocean inverse modeling based on differentiable rendering  

作　　者：Xueguang Xie Yang Gao Fei Hou Aimin Hao Hong Qin 

机构地区：[1]State Key Lab of Virtual Reality Technology and Systems,Beihang University,Beijing 100191,China [2]Qingdao Research Institute,Beihang University,Qingdao 266100,China,and Peng Cheng Lab,Shenzhen 518000,China [3]SKLCS,Institute of Software,Chinese Academy of Sciences,Beijing 100190,China,and University of Chinese Academy of Sciences,Beijing 100049,China [4]Department of Computer Science,Stony Brook University(SUNY at Stony Brook),Stony Brook,New York 11794-2424,USA

出　　处：《Computational Visual Media》2024年第2期279-294,共16页计算可视媒体（英文版）

基　　金：sponsored by grants from the National Natural Science Foundation of China(62002010,61872347);the CAMS Innovation Fund for Medical Sciences(2019-I2M5-016);the Special Plan for the Development of Distinguished Young Scientists of ISCAS(Y8RC535018).

摘　　要：Learning and inferring underlying motion patterns of captured 2D scenes and then re-creating dynamic evolution consistent with the real-world natural phenomena have high appeal for graphics and animation.To bridge the technical gap between virtual and real environments,we focus on the inverse modeling and reconstruction of visually consistent and property-verifiable oceans,taking advantage of deep learning and differentiable physics to learn geometry and constitute waves in a self-supervised manner.First,we infer hierarchical geometry using two networks,which are optimized via the differentiable renderer.We extract wave components from the sequence of inferred geometry through a network equipped with a differentiable ocean model.Then,ocean dynamics can be evolved using the reconstructed wave components.Through extensive experiments,we verify that our new method yields satisfactory results for both geometry reconstruction and wave estimation.Moreover,the new framework has the inverse modeling potential to facilitate a host of graphics applications,such as the rapid production of physically accurate scene animation and editing guided by real ocean scenes.

关 键 词：inverse modeling surface reconstruction wave modeling ocean waves differentiable rendering(DR) 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]