基于字典学习的稠密光场重建算法  

Dense light field reconstruction algorithm based on dictionary learning

作　　者：夏正德 宋娜 刘宾 潘晋孝 闫文敏 邵子惠 Xia Zheng-De;Song Na;Liu Bin;Pan Jin-Xiao;Yan Wen-Min;Shao Zi-Hui(Shanxi Key Laboratory of Signal Capturing&Processing,School of Science,North University of China,Taiyuan 030051,China;Shanxi Key Laboratory of Signal Capturing&Processing,School of Information and Communication Engineering,North University of China,Taiyuan 030051,China;Science and Technology on Transient Impact Laboratory,Beijing 102202,China;Unit 32178,Beijing 100220,China)

机构地区：[1]中北大学理学院,信息探测与处理山西省重点实验室,太原030051 [2]中北大学信息与通信工程学院,信息探测与处理山西省重点实验室,太原030051 [3]瞬态冲击技术重点实验室,北京102202 [4]32178部队,北京100220

出　　处：《物理学报》2020年第6期73-81,共9页Acta Physica Sinica

基　　金：瞬态冲击技术重点实验室基金(批准号:614260603030817);山西省青年科技研究基金(批准号:201901D211275)资助的课题~~

摘　　要：相机阵列是获取空间中目标光场信息的重要手段,采用大规模密集相机阵列获取高角度分辨率光场的方法增加了采样难度和设备成本,同时产生的大量数据的同步和传输需求也限制了光场采样规模.为了实现稀疏光场采样的稠密重建,本文基于稀疏光场数据,分析同一场景多视角图像的空间、角度信息的关联性和冗余性,建立有效的光场字典学习和稀疏编码数学模型,并根据稀疏编码元素间的约束关系,建立虚拟角度图像稀疏编码恢复模型,提出变换域稀疏编码恢复方法,并结合多场景稠密重建实验,验证提出方法的有效性.实验结果表明,本文方法能够对场景中的遮挡、阴影以及复杂的光影变化信息进行高质量恢复,可以用于复杂场景的稀疏光场稠密重建.本研究实现了线性采集稀疏光场的稠密重建,未来将针对非线性采集稀疏光场的稠密重建进行研究,以推进光场成像在实际工程中的应用.The camera array is an important tool to obtain the light field of target in space.The method of obtaining high angular resolution light field by a large-scaled dense camera array increases the difficulty of sampling and the equipment cost.At the same time,the demand for synchronization and transmission of a large number of data also limits the sampling rate of light field.In order to complete the dense reconstruction of sparse sampling of light field,we analyze the correlation and redundancy of multi-view images in the same scene based on sparse light field data,then establish an effective mathematical model of light field dictionary learning and sparse coding.The trained light field atoms can sparsely express the local spatial-angular consistency of light field,and the four-dimensional(4D)light field patches can be reconstructed from a two-dimensional(2D)local image patch centered around each pixel in the sensor.The global and local constraints of the four-dimensional light field are mapped into the low-dimensional space by the dictionary.These constraints are shown as the sparsity of each vector in the sparse representation domain,the constraints between the positions of non-zero elements and their values.According to the constraints among sparse encoding elements,we establish the sparse encoding recovering model of virtual angular image,and propose the sparse encoding recovering method in the transform domain.The atoms of light field in dictionary are screened and the patches of light field are represented linearly by the sparse representation matrix of the virtual angular image.In the end,the virtual angular images are constructed by image fusion after sparse inverse transform.According to multi-scene dense reconstruction experiments,the effectiveness of the proposed method is verified.The experimental results show that the proposed method can recover the occlusion,shadow and complex illumination in satisfying quality.That is to say,it can be used for dense reconstruction of sparse light field in complex sce

关 键 词：光场 字典学习 稀疏编码 稠密重建 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TP181[自动化与计算机技术—计算机科学与技术]