基于信息瓶颈的信道自适应语义压缩编码方法  

Channel Adaptive Semantic Compression Coding Method Based on Information Bottleneck

作　　者：李洁[1] 郭彩丽[1] 朱美逸 杜忠田 LI Jie;GUO Caili;ZHU Meiyi;DU Zhongtian(Beijing University of Posts and Telecommunications,Beijing 100876,China;China Telecom Digital Intelligence Technology Co.,LTD,Beijing 100035,China)

机构地区：[1]北京邮电大学,北京100876 [2]中电信数智科技有限公司,北京100035

出　　处：《移动通信》2023年第4期65-70,共6页Mobile Communications

基　　金：中央高校基本科研业务费专项资金资助(2021XD-A01-1)。

摘　　要：深度神经网络被广泛用于语义压缩编码,然而所生成的语义特征是否还有冗余信息和压缩空间等难以判断。针对此问题,首先基于信息瓶颈理论给出损失函数,接着引入信道自适应压缩模块构建系统模型,然后利用vCLUB互信息估计和变分近似方法推导损失函数上界,设计互信息估计网络等结构。实验结果表明,与基线方法相比,所提出的基于信息瓶颈的信道自适应语义压缩编码方法实现了更高的智能任务性能和更低的通信开销。Deep neural network is widely used in semantic compression coding,however,it is difficult to judge whether there exists redundant information and compression space in the generated semantic features.To solve this problem,the loss function is first given based on the information bottleneck theory,and the channel adaptive compression module is introduced to construct the system model.Then,the upper bound of the loss function is derived by using vCLUB mutual information estimation and variational approximation,and the structures are designed such as the mutual information estimation network.The experimental results show that compared with the baseline methods,the proposed channel adaptive semantic compression coding method based on information bottleneck achieves higher performance on smart tasks and lower communication overhead.

关 键 词：语义通信 语义编码 信息瓶颈 深度学习 

分 类 号：TN929.5[电子电信—通信与信息系统]