GStreamer音视频传输系统研究与实现  

Research and Implementation of Audio and Video Transmission System Based on GStreamer

作　　者：王鑫 左乐 施振华 苏成悦[1] 罗文俊 任开众 陈玉怀 Wang Xin;Zuo Le;Shi Zhenhua;Su Chengyue;Luo Wenjun;Ren Kaizhong;Chen Yuhuai(Department of Physics and Optoelectronic Engineering,Guangdong University of Technolog,Guangzhou 510006,China;Guangzhou Henglian Computer Technology Co.,Ltd.)

机构地区：[1]广东工业大学物理与光电工程学院,广州510006 [2]广州市恒联计算机科技有限公司

出　　处：《单片机与嵌入式系统应用》2020年第9期6-10,共5页Microcontrollers & Embedded Systems

基　　金：广东省科技计划项目(2017A020208063);广州市科技计划项目(201804010384);中山市重大科技专项(2016A1003)。

摘　　要：基于GStreamer框架研究实现音视频同步无线传输。以树莓派3B为硬件平台,使用V4L2驱动框架采集视频数据,采用H.264视频编码;通过PulseAudio声音服务器捕获音频数据,使用Opus音频编码,音视频数据按照RTP协议封装,通过UDP协议完成数据传输。测试结果表明:系统WiFi网络音视频同步传输延时可达261 ms,4G网络音视频同步传输延时可达330 ms,仅视频传输分别可达136 ms、206 ms,具有高实时性;传输质量测试采用空间域无参考图像质量评估器和MOS评分标准,图像质量评价优于对比方案40%。系统针对不同应用需求及网络环境,实现多分辨率可选的实时视频采集和WiFi与4G网络自动切换传输,提高使用灵活性和经济性,满足众多场景应用需要,对音视频传输应用有较好参考价值。Based on GStreamer framework,the audio and video wireless transmission is researched.Based on Raspberry Pi 3B platform,the V4L2 framework is used to collect video,and uses H.264 for video coding.The PulseAudio sound server is used to capture audio data,and Opus for audio coding,then uses RTP protocol to package audio and video data,finally uses UDP protocol for data transmission.The test results show that the system has high real-time performance,in WiFi audio and video synchronization transmission delay is 261 ms,in 4G audio and video synchronization transmission delay is 330 ms,and only video transmission is 136 ms and 206 ms respectively.The transmission quality test uses no-reference image quality assessment in the spatial domain and MOS scoring standard,the system image quality evaluation is 40%better than the comparison scheme.According to different application requirements and network environment,the system realizes multi-resolution optional video acquisition and automatic switching transmission between WiFi and 4G network.The system can be applied to many industries.

关 键 词：GSTREAMER 树莓派 视频 音频 无线传输 

分 类 号：TP31[自动化与计算机技术—计算机软件与理论]