面向体验质量的多媒体计算通信  

Quality of experience oriented multimedia computing communications

作　　者：陶晓明[1] 杨铀[2] 徐迈[3] 段一平 黄丹蓝 刘文予[2] Tao Xiaoming;Yang You;Xu Mai;Duan Yiping;Huang Danlan;Liu Wenyu(Tsinghua University,Beijing 100084,China;Huazhong University of Science and Technology,Wuhan 430074,China;Beihang University,Beijing 100191,China)

机构地区：[1]清华大学,北京100084 [2]华中科技大学,武汉430074 [3]北京航空航天大学,北京100191

出　　处：《中国图象图形学报》2021年第6期1201-1215,共15页Journal of Image and Graphics

基　　金：国家重点研发计划项目(2019YFB1803404,2017YFC0806202);国家自然科学基金项目(61925105,61801260,61971203)。

摘　　要：随着移动互联网和通讯技术的发展,多媒体通信技术成为国家信息产业发展的重大需求,广泛地应用在视频会议、各类直播应用、远程医疗、远程监控和远程教育等方面。然而,大容量多媒体通信业务面临着网络带宽的压力。本文将媒体计算引入通信系统,建立新的多媒体通信研究范式,从提升体验质量(quality of experience,QoE)的角度,形成新的多媒体编码与传输方法,从根本上降低网络带宽需求的压力。体验质量即信息接收者结合自身期望对客观信息载体的有关性能给出的主观评价,是区别于服务质量(quality of service,QoS)的通信质量评价准则。本文介绍了QoE的评价准则,分为基于用户的评价方法和基于客观参数的评价方法,通过用户主观评分或对用户的相关生理、心理指标进行测量进而分析、推测用户的感受;或者通过对业务客观指标的主观化修正实现体验质量的评价。本文综述了多媒体编码方法,主要包括基于波形的编码和基于内容的编码方法。前者对任意视频信号进行有效编码而不需要分析视频内容,如一系列视频编码标准;后者识别视频序列中的物体和相关区域并对它们进行编码。本文阐述了5G+AI(artificial intelligence)时代的新型视频传输方法,如多视点视频编码、4 K、8 K视频编码,3D立体视频,点云、光场、AR(augmented reality)、VR(virtual reality)等视频业务。With the development of mobile Internet and communication technology,multimedia communication technology has become a major demand for the development of the national information industry,which is widely used in video conferencing,various live broadcast applications,telemedicine,remote monitoring,and remote education.However,large-capacity multimedia communication services face pressure on network bandwidth.Media computing is introduced into the communication system,a new multimedia communication research paradigm is established,and a new multimedia coding and transmission method is developed from the perspective of improving the quality of experience(QoE),which fundamentally reduces the pressure on network bandwidth requirements.The quality of experience refers to the subjective evaluation of the relevant performance of the objective information carrier by the information receiver in combination with its own expectations.It is a communication quality evaluation criterion that is different from the quality of service(QoS).This article initially introduces the evaluation criteria of QoE,which are divided into user-based evaluation methods and objective parameter-based methods.The user’s subjective score or the measurement of the user’s relevant physiological and psychological indicators is used to analyze and infer the user’s feelings.The subjective correction of business objective indicators realizes the evaluation of experience quality.Then,multimedia coding methods,including waveform-based coding and content-based coding methods are reviewed.The former effectively encodes any video signal without analyzing the video content,such as a series of video coding standards;the latter identifies objects and related areas in the video sequence and encodes them.Subsequently,this article describes new video transmission methods in the 5 G+AI(artificial intelligence)era,such as multiview video coding,4 K,8 K video coding,3 D stereo video,point cloud,light field,AR(augmented reality),VR(virtual reality),and other vide

关 键 词：计算通信 多媒体通信 评价准则 多媒体编码 多媒体传输 

分 类 号：TN929.5[电子电信—通信与信息系统]