基于CNN特征提取的双焦相机连续数字变焦  

Dual-focal camera continuous digital zoom based on CNN and feature extraction

作　　者：赫贵然 李奇[1] 冯华君[1] 徐之海[1] 陈跃庭[1] HE Gui-ran;LI Qi;FENG Hua-jun;XU Zhi-hai;CHEN Yue-ting(College of Science and Engineering, Zhejiang University, Hangzhou 310058, China)

机构地区：[1]浙江大学光电科学与工程学院,浙江杭州310058

出　　处：《浙江大学学报（工学版）》2019年第6期1182-1189,共8页Journal of Zhejiang University：Engineering Science

基　　金：十三五民用航天资助项目;中央高校基本科研业务费专项资金资助项目(2018QN81002)

摘　　要：设计一种主要针对智能手机双焦镜头的连续数字变焦方案.该方案基于卷积神经网络特征层提取和特征块匹配,充分利用2个不同焦距镜头的拍摄信息,将长焦镜头图像的高分辨信息迁移到短焦图像的可修复区域,并以修复后的短焦图像为基础进行数字变焦.仿真和实验结果表明,相比基于传统插值放大的变焦方案和基于单图像超分辨的变焦方案,所提方案的处理结果拥有更高的主观分辨率和视觉清晰度;当用户给定的变焦倍数在长、短焦镜头倍数之间时,所提方案可以显著提升变焦图像的质量;对于处于长焦相机视场外、短焦相机视场内的纹理,修复效果比现有方法更好;该方法的处理结果对长焦、短焦图像的双目视差大小有着很好的鲁棒性.A digital continuous zooming scheme mainly for smartphone dual-focal lens was proposed, which was based on extraction and patch-matching of the convolutional neural network feature map, making full use of the shooting information of two different focal length lenses. The high-resolution information of the long-focal image was migrated to the repairable area of the short-focus image, then the zoomed image was produced accordingly. The simulation and experimental results show that the image produced by the proposed method has higher subjective resolution and better visual clarity, compared with the traditional interpolation and super-resolution results. The method can greatly enhance the imaging quality of the dual-focal lens when the magnification factor is between the two lens. For the texture outside the Short-Focal-Len filed but in the Long-Focal-Len field, the proposed method also performs better than the existing methods. Otherwise, the proposed method has good robustness in dealing with the parallax problem of the dual-focal camera.

关 键 词：非对称双焦镜头 连续数字变焦 卷积神经网络(CNN) 特征提取 超分辨成像 图像恢复 

分 类 号：TP751.1[自动化与计算机技术—检测技术与自动化装置]