Re-quantization based binary graph neural networks  

作　　者：Kai-Lang YAO Wu-Jun LI 

机构地区：[1]National Key Laboratory for Novel Software Technology,Department of Computer Science and Technology,Nanjing University,Nanjing 210046,China

出　　处：《Science China(Information Sciences)》2024年第7期156-167,共12页中国科学（信息科学）（英文版）

基　　金：supported by National Key R&D Program of China(Grant No.2020YFA0713901);National Natural Science Foundation of China(Grant Nos.61921006,62192783);Fundamental Research Funds for the Central Universities(Grant No.020214380108).

摘　　要：Binary neural networks have become a promising research topic due to their advantages of fast inference speed and low energy consumption.However,most existing studies focus on binary convolutional neural networks,while less attention has been paid to binary graph neural networks.A common drawback of existing studies on binary graph neural networks is that they still include lots of inefficient full-precision operations in multiplying three matrices and are therefore not efficient enough.In this paper,we propose a novel method,called re-quantization-based binary graph neural networks(RQBGN),for binarizing graph neural networks.Specifically,re-quantization,a necessary procedure contributing to the further reduction of superfluous inefficient full-precision operations,quantizes the results of multiplication between any two matrices during the process of multiplying three matrices.To address the challenges introduced by requantization,in RQBGN we first study the impact of different computation orders to find an effective one and then introduce a mixture of experts to increase the model capacity.Experiments on five benchmark datasets show that performing re-quantization in different computation orders significantly impacts the performance of binary graph neural network models,and RQBGN can outperform other baselines to achieve state-of-the-art performance.

关 键 词：graph neural networks binary neural networks mixture of experts computation-efficient algorithms 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]