高斯过程回归中的logdet近似算法及数值实验  

Approximate Implementation of Logarithm of Matrix Determinant in Gaussian Process Regression and Numerical Experiments

作　　者：周杰英[1] 张雨浓[1] 张佳佳[1] 卢建林[1] 李晓峰[1] 

机构地区：[1]中山大学电子与通信工程系,广州510275

出　　处：《系统仿真学报》2009年第1期174-179,共6页Journal of System Simulation

基　　金：国家自然科学基金(60643004);广州市科技攻关计划(2060402)

摘　　要：在高斯过程以及其他空间回归模型中,超参数的最大似然估计(MLE)通常需要求矩阵行列式对数的估计,简称logdet。提出了一种基于幂级数展开的结构,用于广义正定矩阵logdet的近似计算,并给出三种新的补偿方案,进一步提高近似值的精确度和计算效率,所提logdet的近似实现方案仅需50N2次操作。大量的数值实验,包括对随机产生的正定矩阵、随机产生的协方差矩阵以及两个高斯过程回归实例产生的协方差矩阵序列的检验,都已证实所提方案的可行性。Maximum likelihood estimation （MLE） of hyperparameters in Gaussian processes as well as other spatial regression models usually requires the evaluation of the logarithm of the matrix determinant, in short, log det. A power-series expansion based framework was proposed for approximating the log det of general positive-definite matrices. Three novel compensation schemes were given to further improve the approximation accuracy and computational efficiency. The proposed log det approximation required only 50（ N 2） operations. The proposed scheme was substantiated by a large number of numerical experiments, including tests on randomly-generated positive-definite matrices, randomly-generated covariance matrices and sequences of covariance matrices generated online in two Gaussian process regression examples.

关 键 词：高斯过程 矩阵行列式的对数 幂级数展开 补偿 数值实验 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]