模拟真实场景的场景流预测  

Scene flow prediction with simulated real scenarios

作　　者：梅海艺 朱翔昱 雷震[2,3] 高瑞 马喜波[2,3] MEI Hai-yi;ZHU Xiang-yu;LEI Zhen;GAO Rui;MA Xi-bo(School of Control Science and Engineering,Shandong University,Jinan Shandong 250061,China;Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China;School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]山东大学控制科学与工程学院,山东济南250061 [2]中国科学院自动化研究所,北京100190 [3]中国科学院大学人工智能学院,北京100049

出　　处：《图学学报》2022年第3期404-413,共10页Journal of Graphics

基　　金：国家重点研究计划项目(2016YFA0100900,2016YFA0100902);NSFC-山东联合基金项目(U1806202);国家自然科学基金项目(81871442,61876178,61806196,61976229,61872367);中国科学院青年创新促进会项目(Y201930)。

摘　　要：人工智能发展至今正逐渐进入认知时代,计算机对真实物理世界的认知与推理能力亟待提高。有关物体物理属性与运动预测的现有工作多局限于简单的物体和场景,因此尝试拓展常识推理至仿真场景下物体场景流的预测。首先,为了弥补相关领域数据集的短缺,提出了一个基于仿真场景的数据集ModernCity,从常识推理的角度出发还原了现代都市的街边景象,并提供了包括RGB图像、深度图、场景流数据和语义分割图在内的多种标签;此外,设计了一个物体描述子解码模型(ODD),通过物体属性辅助预测场景流。通过消融实验证明,该模型可以在仿真的场景下通过物体的属性准确地预测物体未来的运动趋势,通过与其他SOTA模型的对比实验验证了该模型的性能及ModernCity数据集的可靠性。Artificial intelligence is stepping into the age of cognition,the ability of cognizing and inferring the physical world for machines needs to be improved.Recent works about exploring the physical properties of objects and predicting the motion of objects are mostly constrained by simple objects and scenes.We attempted to predict the scene flow of objects in simulated scenarios to extend common sense cognizing.First,due to the lack of data in the related field,a dataset called Modern City based on simulated scenarios is proposed,which contains the street scene of modern cities designed from the perspective of cognizing common sense,and provides RGB images,depth maps,scene flow,and semantic segmentations.In addition,we design an object descriptor decoder(ODD)to predict the scene flow through the properties of the objects.The model we proposed is proved to have the ability to predict future motion accurately through the properties of objects in simulated scenarios by experiments.The comparison experiment with other SOTA models demonstrates the performance of the model and the reliability of the ModernCity dataset.

关 键 词：常识推理 场景流 仿真场景 物体物理属性 运动预测 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]