基于置信度的TOF与双目系统深度数据融合  

In-depth data fusion of TOF and stereo vision system based on confidence level

作　　者：孙哲 张勇[1] 常衢通 SUN Zhe;ZHANG Yong;CHANG Qutong(School of Instrumentation Science and Opto-eleetronies Engineering,Beijing University of Aeronautics and Astronautics,Beijing 100083,China)

机构地区：[1]北京航空航天大学仪器科学与光电工程学院,北京100083

出　　处：《北京航空航天大学学报》2018年第8期1764-1771,共8页Journal of Beijing University of Aeronautics and Astronautics

摘　　要：为了解决铁路火车等结构单一环境的三维重建问题,提出了置信度的概念,将TOF系统与双目系统的互补性特点有效结合。通过联合标定,建立起TOF系统与双目系统的坐标关系,将TOF中的点映射到左相机视角下,得出双目系统左相机视角下的TOF测量视差图,再利用图像分割以及曲面拟合对其上采样处理至双目图像的分辨率大小。根据各系统特点定义置信度,确定数据融合的不同系统权重。利用Middlebury的数据集处理结果,融合后的匹配精度较双目系统精度提高一倍以上,且视差图的分辨率提升至与双目系统相同大小。To solve the problem of 3 D reconstruction in textureless environment like railway,the confidence coefficient is proposed to combine TOF and stereo vision system effectively. Through the joint calibration,the coordinate relationship between TOF and stereo vision systems is established. Then by projecting the points in TOF to left camera in stereo vision system,the disparity map of TOF is obtained. After image segment and surface fitting the disparity map is up-sampled and its resolution is equal to that of stereo images.According to the confidence coefficients of different systems,the system weight values of data fusion are defined. Finally,the proposed method is evaluated with Middlebury dataset,and the results show that the accuracy has been raised twofold or more,and the resolution of disparity map is equal to that of stereo images as well.

关 键 词：双目立体匹配 TOF 数据上采样 数据融合 置信度 

分 类 号：V219[航空宇航科学与技术—航空宇航推进理论与工程] TP391.4[自动化与计算机技术—计算机应用技术]