基于纹理信息的室内场景语义标注学习方法  

Learning method of indoor scene semantic annotation based on texture information

作　　者：张圆圆[1,2] 黄宜军 王跃飞[1] ZHANG Yuanyuan;HUANG Yijun;WANG Yuefei(School of Mechanical and Marine Engineering, Qinzhou University, Qinzhou Guangxi 535011, China;Qinzhou Key Laboratory for Advanced Technology to Internet of Things, Qinzhou Guangxi 535011, China)

机构地区：[1]钦州学院机械与船舶海洋工程学院,广西钦州535011 [2]钦州市物联网先进技术重点实验室,广西钦州535011

出　　处：《计算机应用》2018年第12期3409-3413,共5页journal of Computer Applications

基　　金：广西高校中青年教师基础能力提升项目(17KY0793);广西高校临海机械装备设计制造及控制重点实验室项目(GXLH2014ZD-05;GXLH2016YB-07);钦州市物联网先进技术重点实验室项目(IOT2018C02)~~

摘　　要：针对目前室内场景视频中关键物体的检测、跟踪及信息编辑等方面主要是采用人工处理方式,存在效率低、精度不高等问题,提出了一种基于纹理信息的室内场景语义标注学习方法。首先,采用光流方法获取视频帧间的运动信息,利用关键帧标注和帧间运动信息进行非关键帧的标注初始化;然后,利用非关键帧的图像纹理信息约束及其初始化标注构建能量方程;最后,利用图割方法优化得到该能量方程的解,即为非关键帧语义标注。标注的准确率和视觉效果的实验结果表明,与运动估计法和基于模型的学习法相比较,所提基于纹理信息的室内场景语义标注学习法具有较好的效果。该方法可以为服务机器人、智能家居、应急响应等低时延决策系统提供参考。The manual processing method is mainly used for the detection,tracking and information editing of key objects in indoor scene video,which has the problems of low efficiency and low precision.In order to solve the problems,a new learning method of indoor scene semantic annotation based on texture information was proposed.Firstly,the optical flow method was used to obtain the motion information between video frames,and the key frame annotation and interframe motion information were used to initialize the annotation of non-key frames.Then,the image texture information constraint of non-key frames and its initialized annotation were used to construct an energy equation.Finally,the graph-cuts method was used for optimizing to obtain the solution of the energy equation,which was the non-key frame semantic annotation.The experimental results of the annotation accuracy and visual effects show that,compared with the motion estimation method and the model-based learning method,the proposed learning method of indoor scene semantic annotation based on texture information has the better effect.The proposed method can provide the reference for low-latency decision-making systems such as service robots,smart home and emergency response.

关 键 词：室内场景 语义标注学习 运动估计 图像纹理 图割 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术] TP391.7[自动化与计算机技术—计算机科学与技术]