基于三维视频融合的智慧港口全景建模研究  

Study on Panoramic Modeling of Smart Port Based on 3D Video Fusion

作　　者：陈立家[1,2] 王莹涛 李胜为 许毅[3] CHEN Li-jia;WANG Ying-tao;LI Sheng-wei;XU Yi(School of Navigation,Wuhan University of Technology,Wuhan Hubei 430063,China;Hubei Provincial Key Laboratory of Inland Navigation Technology,Wuhan University of Technology,Wuhan Hubei 430063,China;School of Computer and Architecture Intelligence,Wuhan University of Technology,Wuhan Hubei 430063,China)

机构地区：[1]武汉理工大学航运学院,湖北武汉430063 [2]武汉理工大学内河航运技术湖北省重点实验室,湖北武汉430063 [3]武汉理工大学计算机与人工智能学院,湖北武汉430063

出　　处：《计算机仿真》2024年第9期251-257,共7页Computer Simulation

基　　金：国家重点研发计划项目(2019YFB1600603)。

摘　　要：针对港区监控视频图像之间联动性差与缺乏三维立体视觉感受等问题,提出一种基于三维视频融合的港口全景建模方法。首先,基于倾斜摄影对港区进行三维重建,在重建过程中利用体素滤波法处理点云数据,以构建轻量化模型;其次,提出一种改进SURF(Speeded-Up Robust Features)算法进行图像相似配准,以求解相机姿态,实现三维模型与视频的融合;最后,以武汉某港口为实验区域,基于Cesium开源引擎实现了三维全景模型可视化渲染。结果表明,上述方法可以将港口监控视频流以纹理的形式投影到实景模型上,构建含有实时视频数据的三维全景模型,解决港口监控现存问题,为实现智慧港口立体监控提供一种新思路。Aiming at the problems of poor linkage between surveillance video images in port areas and lack of three-dimensional visual experience,a port panoramic modeling method based on three-dimensional video fusion is proposed.Firstly,based on oblique photography,the port area is reconstructed in 3D,and the point cloud data is processed by the voxel filtering method during the reconstruction process to construct a lightweight model.Secondly,an improved SURF(Speeded-Up Robust Features) algorithm is proposed to perform image similarity registration to solve the camera pose and realize the fusion of three-dimensional models and videos.Finally,taking a port in Wuhan as the experimental area,the visual rendering of the three-dimensional panoramic model is realized based on the Cesium open-source engine.The results show that the proposed method can project the port surveillance video stream into the real scene model in the form of texture,construct a three-dimensional panoramic model with real-time video data,solve the existing problems of port monitoring,and provide a new idea for realizing the three-dimensional monitoring of smart ports.

关 键 词：三维重建 三维视频融合 图像相似匹配 全景建模 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术] U65[自动化与计算机技术—计算机科学与技术]