基于形状上下文和方向梯度直方图特征的异源图像配准  

Multi-sensor Image Registration Based on Shape Context and Histograms of Oriented Gradient Feature

作　　者：黄微 任卫红[1,2,3] 朱琳琳 田建东[1,2] HUANG Wei;REN Weihong;ZHU Linlin;TIAN JiANDong(State Key Laboratory of Robotics,Shenyang Institute of Automation,Chinese Academy of Sciences,Shenyang 110016,China;Institutes for Robotics and Intelligent Manufacturing,Chinese Academy of Sciences,Shenyang 110016,China;University of Chinese Academy of Sciences,Beijing 100049,China;Shenyang Aerospace University,Shenyang 110136,China)

机构地区：[1]中国科学院沈阳自动化研究所机器人学国家重点实验室,辽宁沈阳110016 [2]中国科学院机器人与智能制造创新研究院,辽宁沈阳110016 [3]中国科学院大学,北京100049 [4]沈阳航空航天大学,辽宁沈阳110136

出　　处：《信息与控制》2019年第2期149-155,共7页Information and Control

基　　金：国家自然科学基金资助项目(91648118;61503256)

摘　　要：针对单模态图像包含的信息存在局限性的问题,提出了一种基于形状上下文和HOG(histogram of oriented gradient)特征的红外和可见光图像配准方法.在混合高斯模型前景检测的基础上,通过提出的形状上下文和HOG特征结合的方法实现轮廓特征匹配,再利用TPS(thin plate spline)转换模型将匹配延伸到整个形状,并使用正则化和缩放特性迭代重组对应关系及估计转换降低估计误差.最后,采用RANSAC(random sample consensus)算法去除错误匹配点.与已有的形状上下文方法相比,此方法结合了边缘和轮廓特征信息,降低了误差,鲁棒性更好.We propose a registration method for infrared and visible images based on shape context and histogram of oriented gradient(HOG)feature to overcome the limitations of single-mode image information.On the basis of foreground detection by Gaussian mixture model,we realize the contour feature matching using the proposed shape context and HOG feature.Matching is extended to the whole shape through a thin plate spline(TPS)transformation model.Then,we use the regularization and scaling characteristics to reorganize the corresponding relationship and estimate the transformation in order to reduce the estimation error.Finally,the random sample consensus(RANSAC)algorithm is used to remove the error matching points.Compared with existing shape context methods,this method combines edge and contour feature information with lower error and better robustness.

关 键 词：图像配准 前景检测 形状上下文 方向梯度直方图(HOG)特征 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TP212[自动化与计算机技术—计算机科学与技术]