基于ZYNQ的实时水果识别系统  

Real-Time Fruit Recognition System Based on ZYNQ

作　　者：宋宛容 向强[1] 

机构地区：[1]西南民族大学电子信息学院,四川 成都

出　　处：《理论数学》2023年第2期251-264,共14页Pure Mathematics

摘　　要：由于农业与科技快速发展,机器人被更多用于农业生产中,机器视觉是机器人设计中不可或缺的一部分,如何在嵌入式平台上实现实时视频捕捉与视频处理及优化是目前热门研究方向。本系统采用软硬结合方式实现ZYNQ平台上视频采集水果识别系统。硬件平台为XILINX ZYNQ 7020板卡,双目摄像头采集水果图像并通过以太网口将视频数据传输至上位机;上位机使用改进后的MobileV3-YOLOv3算法对图像进行识别。结果显示,硬件平台能够传送实时视频数据至上位机,且经过预处理IP核处理后的图像有明显的优化,改进后的算法AP50达到92%,FPS为34 f/s,模型参数量为235.61M,并回传识别物体位置三维坐标。Due to the rapid development of agriculture and technology, robots are more used in agricultural production. Machine vision is an indispensable part of robot design. How to realize real-time video capture and video processing and optimization on an embedded platform is currently a popular re-search direction. The system adopts the combination of software and hardware to realize the video collection fruit recognition system on the ZYNQ platform. The hardware platform is XILINX ZYNQ 7020 board, the binocular camera collects fruit images and transmits the video data to the host computer through the Ethernet port;the host computer uses the improved MobileV3-YOLOv3 algo-rithm to identify the images. The results show that the hardware platform can transmit real-time video data to the host computer, and the images processed by the pre-processing IP core are obvi-ously optimized. The improved algorithm AP50 reaches 92%, FPS is 34 f/s, the model parameter quantity is 235.61M, and the position of the object is retrieved three-dimensional.

关 键 词：可编程片上系统 千兆以太网 上位机 YOLO-v3 水果识别 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]