基于视频语义的码率控制算法  

Bitrate Control Algorithm Based on Video Semantic

作　　者：黄发仁 柯捷铭 郑楚飞 周简心 张森林 陈锋[1,2] HUANG Faren;KE Jieming;ZHENG Chufei;ZHOU Jianxin;ZHANG Senlin;CHEN Feng(School of Advanced Manufacturing,Fuzhou University,Quanzhou 362251,China;College of Physics and Information Engineering,Fuzhou University,Fuzhou 350108,China;Istrong Technology Co.,Ltd.,Fuzhou,350108,China)

机构地区：[1]福州大学先进制造学院,福建泉州362251 [2]福州大学物理与信息工程学院,福建福州350108 [3]四创科技有限公司,福建福州350108

出　　处：《无线电工程》2024年第8期1890-1899,共10页Radio Engineering

基　　金：国家自然科学基金(61801120);福建省自然科学基金面上项目(2022J01551)。

摘　　要：随着远程监控和人工智能的融合发展,传统的码率优化算法并不适用于现阶段的移动监控网络场景。在机器视觉应用场景中,相对于传统码率优化算法只关注视频的质量,机器更关注于视频所表达的语义信息。以5G路侧摄像头远程智能检测为应用场景,提出一种基于视频语义的码率优化算法,在有限的码率传输范围内最大化目标检测准确率。具体地,该算法引入视频语义任务模型,将目标检测作为语义任务。分析目标比特与语义之间的特征关系,建立复杂度与运动区域结合的新权重来分配目标比特,使目标检测准确率达到最大化。实验结果表明,相较于HM16.23所使用的帧级树编码单元(Coding Tree Unit, CTU)层码率控制算法,所提算法不仅能够节省码率而且更符合无线远程监控的目标检测需求。在测试环境下平均提升了1.4%的目标检测准确率,最高能够提升2.5%的目标检测准确率。With the integration and development of remote monitoring and artificial intelligence,traditional bitrate optimization algorithms are not suitable for the current stage of mobile monitoring network scenarios.In machine vision applications,machines are more concerned with the semantic information conveyed by videos rather than just the quality of the videos compared with traditional bitrate optimization algorithm.A semantic-based bitrate optimization algorithm is proposed for 5G roadside camera remote intelligent detection as the application scenario,aiming to maximize the object detection accuracy within the limited bitrate transmission range.Specifically,a video semantic task model is introduced to the algorithm and the object detection is treated as a semantic task.By analyzing the relationship between target bits and semantics,a new weight combining complexity and motion regions is established to allocate target bits,thereby maximizing the object detection accuracy.Experimental results show that compared to the frame-level Coding Tree Unit(CTU)-layer bitrate control algorithm used in HM16.23,this algorithm not only saves bitrate but also better meets the object detection requirements of wireless remote monitoring.It achieved an average improvement of 1.4%in object detection accuracy in the test environment,with a maximum improvement of 2.5%in object detection accuracy.

关 键 词：人工智能 机器视觉 目标检测 视频语义 

分 类 号：TN919.8[电子电信—通信与信息系统] TP391.41[电子电信—信息与通信工程]