基于三维重建的虚拟现实类鸟飞行系统  

Virtual reality bird like flight system based on 3D reconstruction

作　　者：缪长蔚 陈铭 张淑芳 张涛 MIAO Changwei;CHEN Ming;ZHANG Shufang;ZHANG Tao(School of Electrical Automation and Information Engineering,Tianjin University,Tianjin 300072,China)

机构地区：[1]天津大学电气自动化与信息工程学院,天津300072

出　　处：《光电子．激光》2023年第3期268-277,共10页Journal of Optoelectronics·Laser

基　　金：天津大学自主创新基金资助项目。

摘　　要：随着虚拟现实(virtual reality,VR)技术的飞速发展,各种应用层出不穷。然而目前大多应用仅限于定点的静态全景展示及游览,无法利用VR化不可能为可能的优越性。本文提出了一种融合VR技术与三维重建算法的类鸟飞行交互模拟系统。该系统搭建了结构稳定的硬件控制平台用以改变实际姿态,同时通过软件仿真了虚拟环境中鸟类的飞行,结合硬件驱动及软件模拟实现了深层次的飞行模拟。现有的虚拟环境大多通过人工建模、激光扫描仪或无人机(unmanned aerial vehicle,UAV)航拍构造,其中建模存在费时费力的缺点,激光扫描仪则无法适应大规模重建,而UAV成本高昂且需专业培训。本文引入了基于图像分簇的PMVS(patch based multi-view stereopesis)算法,只需输入特定场景的图片即可利用计算机自动恢复出三维结构,不仅快速而且可对任意场景重构。使用户在足不出户的情况下即可在世界各地体验飞行,为旅游事业及VR产业提供了一种新的可能。With the rapid development of virtual reality(VR)technology,various applications emerge.However,the current applications can not make full use of the advantages of VR,and are mostly limited to fixed-point static panoramic display and tour.Therefore,this paper proposes a bird like flight interactive simulation system which integrates VR technology and 3Dreconstruction algorithm.The system builds a hardware control platform with stable structure to change the actual posture,and at the same time the bird flight in the virtual environment is simulated by software,thus a deep flight simulation combined hardware driving and software simulation is realized.Most of the existing virtual environments are constructed by artificial modeling,laser scanning or unmanned aerial vehicle(UAV)aerial photography.The artificial modeling is time-consuming and laborious,the laser scanner can not adapt to largescale reconstruction,and the UAV needs professional training.This paper introduces the patch based multi-view stereopesis(PMVS)algorithm based on image clustering,which can automatically restore the three-dimensional structure.By inputting a specific set of images,the algorithm can reconstruct any scene quickly.Users can experience to fly around the world without leaving home,which provides a new possibility for tourism and VR industry.

关 键 词：计算机仿真 虚拟现实(VR) 运动恢复结构(SFM) 多视图立体 软硬件平台开发 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]