基于高速相机的智能事件识别时扩存储方法及FPGA实现  

Intelligent event recognition time-expanded memory measure based on high speed camera and FPGA implementation

作　　者：许海龙 王超 孙海江[1,2] XU Hailong;WANG Chao;SUN Haijiang(Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China;University of Chinese Academy of Sciences,Beijing 100049,China;Military Representative Office of Equipment Department of Aerospace System Department in Changchun,Changchun 130000,China)

机构地区：[1]中国科学院长春光学精密机械与物理研究所,吉林长春130033 [2]中国科学院大学,北京100049 [3]航天系统部装备部驻长春地区军事代表室,吉林长春130000

出　　处：《液晶与显示》2025年第4期655-664,共10页Chinese Journal of Liquid Crystals and Displays

基　　金：吉林省创新创业人才资助项目(No.2023QN10)。

摘　　要：在高速相机定点拍摄中,为了在不增加高速相机体积与成本的情况下延长高速相机的拍摄时间,在一体式高速相机存储资源小等强硬件约束条件下,设计并验证了一种可并行计算的智能事件识别时扩存储方法,利用FPGA作为主控芯片实现了视频帧数据的时间扩展存储,有效延长了高速相机的拍摄时间。首先介绍了双环形灰度比差算法原理并分析了算法的捕捉目标性能,根据算法捕捉到的目标位置信息将图像数据分割存储,存储变化区域剔除非变化区域,输出高速相机拍摄视频时利用前帧重复非变化区域部分图像和当前帧变化目标部分图像将其拼接成完整视频帧图像数据。其次设计了一种AXI_DMA模块以减少FPGA板卡硬件资源消耗,硬件资源消耗对比VDMA IP节省约75%,可以高效地与DDR3传输数据。最后通过FPGA板卡对该方法进行实现并验证方法可行性。实验结果表明,该方法可以有效识别出高速视频帧数据中的目标并将其分割存储,可有效识别50×50大小的目标,在2560×1440视频中可以节省47%的存储资源,有效提高了高速相机的拍摄时间。In order to extend the shooting time of high-speed camera without increasing the size and cost of high-speed camera,a parallel computing intelligent event recognition time-expanded storage method is designed and verified under the strong hardware constraints such as small storage resources of integrated high-speed camera.FPGA is used as the main control chip to realize the time-extended storage of video frame data and effectively extend the shooting time of high-speed camera.Firstly,the principle of doublering gray scale difference algorithm is introduced and the performance of the algorithm to capture the target is analyzed.According to the location information of the target captured by the algorithm,the image data is segmented and stored,and the stored variable area is deleted from the non-variable area.When output high-speed camera shoots video,the image of the previous frame repeats the non-variable area and the current frame changes the image into a complete video frame image data.Secondly,an AXI_DMA module is designed to reduce the hardware resource consumption of FPGA board.The hardware resource consumption is about 75%less than that of VDMA IP,which can efficiently transmit data with DDR3.Finally,the method is implemented by FPGA board and the feasibility of the method is verified.Experimental results show that the proposed method can effectively identify targets in high-speed video frame data and segment and store them,and can effectively identify targets of 50×50 size,save 47%of storage resources in 2560×1440 video,and effectively improve the shooting time of high-speed camera.

关 键 词：现场可编程门阵列 高速动态图像 流水线 双环形灰度比差算法 时扩存储 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论] TP391[自动化与计算机技术—计算机科学与技术]