手机室内场景要素实例化现实增强方法研究进展  

Progress of Instantiated Reality Augmentation Method for Smart Phone Indoor Scene Elements

作　　者：刘建华 王楠 白明辰 LIU Jianhua;WANG Nan;BAI Mingchen(Mobile Geospatial Big Data Cloud Service Innovation Team,School of Geomatics and Urban Spatial Information,Beijing University of Civil Engineering and Architecture,Beijing 100044,China)

机构地区：[1]北京建筑大学测绘与城市空间信息学院移动地理空间大数据云服务创新团队,北京100044

出　　处：《计算机工程与应用》2024年第7期58-69,共12页Computer Engineering and Applications

基　　金：北京市高等教育学会重点项目(ZD202244);北京建筑大学教育科学研究重点项目(Y2111)。

摘　　要：室内手机导航与位置服务是当前的研究热点,场景要素实例化现实增强方法是其中重要的组成部分。实例分割是场景要素感知中一项具有挑战性的基本任务,增强现实是数字孪生建筑物地图应用的有效途径,两者在室内定位导航领域有着重要意义。当前,增强现实技术主要应用在对场景中的语义增强,智能手机室内导航AR增强也只是停留在视觉可视化效果方面,尚没有真正深入到对场景中要素实例的增强层面。针对该问题,提出手机场景要素实例化AR研究思路,通过识别室内场景中的对象并与建筑物地图进行匹配,将建筑物地图中对应存储的要素信息利用AR技术进行增强显示,进而辅助行人进行室内导航与位置服务等相关应用,提升用户室内定位导航等位置服务的信息化水平。对智能手机端视频的实例分割和增强现实方法进行了系统的梳理,并分析了相关方法的特点和适用场景,总结了移动端实例分割和增强现实的研究进展,最后探讨了室内场景要素实例化现实增强方法在导航与位置服务领域的应用前景。Indoor mobile phone navigation and location services are current research hotspots,of which scene element instantiation reality augmentation methods are an important part.Instantiated segmentation is a challenging and fundamental task in scene element perception,and augmented reality is an effective way to apply digital twin building maps,both of which are of great importance in the field of indoor location navigation.At present,augmented reality technology is mainly applied to semantic enhancements in scenes,and AR enhancements for smartphone indoor navigation only stay in the visual visualization effect,and have not yet really penetrated to the level of enhancement of elemental instances in scenes.To address this problem,this paper proposes an AR research idea of mobile phone scene element instantiation,by identifying objects in indoor scenes and matching them with building maps,the corresponding stored element information in the building maps will be enhanced and displayed using AR technology,thus assisting pedestrians in indoor navigation and location services and other related applications,and improving the information level of location services such as indoor positioning and navigation for users.This paper provides a systematic overview of instance segmentation and augmented reality methods for smartphone-side video,and analyses the characteristics and applicable scenarios of the relevant methods,summaries the research progress of instance segmentation and augmented reality in mobile,and finally discusses the application prospects of instantiated reality augmentation methods for indoor scene elements in the field of navigation and location services.

关 键 词：增强现实 实例分割 深度学习 手机室内定位导航 建筑物地图匹配 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]