Ultra-wide FOV meta-camera with transformerneural-network color imaging methodology  

作　　者：Yan Liu Wen-Dong Li Kun-Yuan Xin Ze-Ming Chen Zun-Yi Chen Rui Chen Xiao-Dong Chen Fu-Li Zhao Wei-Shi Zheng Jian-Wen Dong 

机构地区：[1]Sun Yat-sen University,School of Physics,State Key Laboratory of Optoelectronic Materials and Technologies,Guangzhou,China [2]Sun Yat-sen University,School of Computer Science and Engineering,Guangzhou,China

出　　处：《Advanced Photonics》2024年第5期31-40,共10页先进光子学(英文)

基　　金：supported by the National Key R&D Program of China(Grant No.2023YFB2806800);the National Natural Science Foundation of China(Grant Nos.62035016 and U21A20471);the Guangdong Basic and Applied Basic Research Foundation(Grant No.2023B1515040023);the Guangzhou Science and Technology Program(Grant No.202201011671).

摘　　要：Planar cameras with high performance and wide field of view(FOV)are critical in various fields,requiring highly compact and integrated technology.Existing wide FOV metalenses show great potential for ultrathin optical components,but there is a set of tricky challenges,such as chromatic aberrations correction,central bright speckle removal,and image quality improvement of wide FOV.We design a neural meta-camera by introducing a knowledge-fused data-driven paradigm equipped with transformer-based network.Such a paradigm enables the network to sequentially assimilate the physical prior and experimental data of the metalens,and thus can effectively mitigate the aforementioned challenges.An ultra-wide FOV metacamera,integrating an off-axis monochromatic aberration-corrected metalens with a neural CMOS image sensor without any relay lenses,is employed to demonstrate the availability.High-quality reconstructed results of color images and real scene images at different distances validate that the proposed metacamera can achieve an ultra-wide FOV(>100 deg)and full-color images with the correction of chromatic aberration,distortion,and central bright speckle,and the contrast increase up to 13.5 times.Notably,coupled with its compact size(<0.13 cm^(3)),portability,and full-color imaging capacity,the neural meta-camera emerges as a compelling alternative for applications,such as micro-navigation,microendoscopes,and various on-chip devices.

关 键 词：metalens meta-camera wide field of view neural network color imaging compact imaging device 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]