一种基于Spike Camera的彩色脉冲相机仿真  

A Simulation of Color Spike Camera Based on Spike Camera

作　　者：马雪山[1] 刘斌[1] 杨静[1] 田娟[1] 马雷 Ma Xueshan;Liu Bin;Yang Jing;Tian Juan;Ma Lei(Karamay Vocational&Technical College,Karamay 834000;Institute of Digital Media,Peking University,Peking 100871)

机构地区：[1]克拉玛依职业技术学院,克拉玛依834000 [2]北京大学数字媒体研究所,北京100871

出　　处：《现代计算机》2022年第12期17-23,共7页Modern Computer

基　　金：克拉玛依职业技术学院院级科研项目(KZY2021-3)。

摘　　要：受到生物视觉机制的启发,一种新型的仿视网膜中央凹的视觉传感器Spike Camera被研制出来。相比传统基于帧的相机和其他事件相机,Spike Camera更适合处理超高速场景的视觉任务。目前物理设备推广受到限制,此类视觉类传感器的发展和应用也受到影响。在本文中,我们实现了一种基于Spike Camera的仿真建模方法,将连续的视频帧转化成脉冲数据,再根据脉冲数据重构成图像帧。通过仿真程序,探索了在Spike Camera传感器上的彩色信息脉冲编码的方式。实验结果表明,相比其他彩色编码方式,使用单通道的RGB彩色脉冲编码能在损失很少的图像信息的情况下,极大地压缩脉冲数据,减少传输带宽。本文的研究结果对设计彩色脉冲相机具有重要参考意义。Inspired by the biological vision mechanism,a new type of visual sensor called Spike Camera that mimics the fovea of the retina has been invented,which has better image reconstruction performance in high-speed scenes than conventional framebased cameras and other event cameras.At present,limited by the promotion of physical equipment,the development and applica⁃tion of such visual sensors are affected.This paper implements a simulation method based on Spike Camera,which converts con⁃tinuous video frames into spike data,and then reconstructs image frames according to the spike data.By using the simulation pro⁃gram,this paper explores the color information spike coding mechanism on the Spike Camera sensor.The experimental results show that,compared with other color spike coding methods,the single-channel RGB color spike coding can greatly compress the spike data and reduce the transmission bandwidth with little loss of image information.The results of this study have important reference significance for designing color mode spike camera.

关 键 词：脉冲相机 彩色脉冲 传感器仿真 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TP391.9[自动化与计算机技术—计算机科学与技术]