光场数据压缩研究综述  

Survey of light field data compression

作　　者：刘宇洋[1] 朱策[1] 郭红伟 Liu Yuyang;Zhu Ce;Guo Hongwei(University of Electronic Science and Technology of China,Chengdu 611731,China)

机构地区：[1]电子科技大学

出　　处：《中国图象图形学报》2019年第11期1842-1859,共18页Journal of Image and Graphics

基　　金：国家自然科学基金面上项目(61571102);四川省科技厅应用基础研究项目(2018JY0035)~~

摘　　要：光场数据体量大,为存储和压缩带来巨大困难。由于光场数据格式与传统图像视频数据不同,现有图像视频编码工具难以高效压缩光场数据。因此,光场数据高效压缩研究对降低存储消耗和传输带宽具有重要意义。目前,光场压缩的研究越来越深入,提出的方法种类也越来越丰富。本文对现阶段光场压缩进行系统综述,为后续研究者提供研究基础。本文简要介绍了光场的基本理论及四类光场采集设备,分析了4类采集设备的优缺点,阐明了光场采集方式对光场数据格式的影响;介绍了国际标准组织联合图像专家组(JPEG)在光场压缩标准化方面的最新进展,对JPEG Pleno光场编码器的每个模块做了详细介绍;在广泛文献调研的基础上,将光场压缩算法分成3类:基于变换的压缩方法、基于伪视频序列的压缩方法和基于预测的压缩方法,对每类算法进行详细梳理和总结,并做了详细地对比分析。通过系统地梳理,凝练出光场压缩近期的进展和尚存在的问题,并对未来光场压缩的研究趋势进行展望。实现光场的高效压缩非常具有挑战性,虽然光场压缩研究近期迅猛发展,但是压缩性能仍有待进一步提高。Light field imaging is an attractive technique for 3 D visualization,especially in virtual and augmented reality application scenarios. This technique has also been applied to computer vision areas,such as depth estimation,3 D reconstruction,and object detection. However,light field data have put great pressure on cost-effective storage and transmission owing to the large data volume. The data format of light field is also relatively different from that of conventional images or videos. This difference has resulted in the inefficient compression of light field data by current coding tools designed for traditional images or videos. Thus,light field compression methods must be developed,especially from the perspective of costeffective storage and transmission bandwidth. With the advancement of light field compression,various light field compression methods have been proposed. This study conducts a survey of related works on light field compression to provide a research foundation for later researchers who will focus on this topic. First,this study briefly introduces the fundamentals of light field and the four types of light field-capturing devices. The advantages and drawbacks of different types of capturing devices are presented accordingly. The influence of different capturing devices on light field data format is also described.Second,this work discusses the recent advances in JPEG Pleno,which is a standard framework for representing and signaling plenoptic modalities. JPEG Pleno was started in 2015 by the Joint Photographic Experts Group Committee. The term"pleno"is an abbreviation of"plenoptic,"which is a mathematical formulation to represent the information of a beam of light passing through an arbitrary point within a scene. JPEG Pleno proposes a light field-coding framework for the light field data acquired by a plenoptic camera or a high-density array of cameras. The JPEG Pleno light field encoder consists of three parts,with each part illustrated in detail. Lastly,on the basis of extensive literature res

关 键 词：光场 光场压缩 光场成像 JPEG Pleno 变换 伪视频序列 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]