面向室内空间智能的三维场景图表达与应用  

3D scene graph representation and application for intelligent indoor spaces

作　　者：汤圣君 杜思齐 王伟玺 郭仁忠 TANG Shengjun;DU Siqi;WANG Weixi;GUO Renzhong(State Key Laboratory of Subtropical Building and Urban Science,Shenzhen University,Shenzhen 518061,China;School of Architecture and Urban Planning,Shenzhen University,Shenzhen 518061,China)

机构地区：[1]深圳大学亚热带建筑与城市科学全国重点实验室,广东深圳518061 [2]深圳大学建筑与城市规划学院,广东深圳518061

出　　处：《测绘学报》2024年第7期1355-1370,共16页Acta Geodaetica et Cartographica Sinica

基　　金：广东省自然科学基金(2024A1515030061);深圳市科技计划项目(KJZD20230923115508017;JCYJ20210324093012033);亚热带建筑与城市科学全国重点实验室自主研究课题(2023ZB18)。

摘　　要：现有室内三维场景表达聚焦于对象化的描述方法,其要素表达还停留在对象级语义理解层面,欠缺对室内场景复杂关系信息的显示表达。面向室内空间智能任务需求,亟需一个能够完整、准确描述室内要素几何、语义及关系,且具备语义检索和分析推理能力的结构化模型支撑。基于三维场景图基础理论,本文创新性地提出面向室内空间智能的三维场景图表达模型,系统性介绍了室内三维场景图要素层级化组织、几何表达、语义描述、关系描述方法,建立了一个可统一描述室内要素几何、语义及关系的室内三维场景图概念模型。同时,该图模型可以与现有的三维场景表达方法进行融合表达,具有良好的数据兼容性。最终,本文基于公开的IFC模型构建了完整且具有多层级关系信息的三维场景图模型,并且结合大语言模型通过复杂场景检索、拓扑分析等应用对该模型的应用能力、潜力及局限性进行了系统性探讨和分析。结果表明,室内三维场景图模型具备复杂计算和分析能力,可直接与大语言模型集成,通过简单的自然语言提示实现复杂的场景分析应用。Existing methods for indoor 3D scene representation focus on object-oriented descriptions,with element representations limited to object-level semantic understanding.These methods lack the ability to express complex relational information within indoor scenes.Addressing the demands of intelligent indoor space tasks,there is a critical need for a structured model that can comprehensively and accurately describe the geometry,semantics,and relationships of indoor elements,while also supporting semantic retrieval and analytical reasoning.Based on the fundamental theory of 3D scene graphs,this paper innovatively proposes a 3D scene graph representation model tailored for intelligent indoor spaces.It systematically introduces the hierarchical organization,geometric representation,semantic description,and relational description methods of indoor 3D scene graphs.A conceptual model is established that uniformly describes the geometry,semantics,and relationships of indoor elements.Additionally,this graph model is compatible with existing 3D scene representation methods,ensuring good data compatibility.Finally,a comprehensive multi-level relational 3D scene graph model is constructed based on the publicly available IFC model.This model's application capabilities,potential,and limitations are systematically explored and analyzed through applications such as complex scene retrieval and topological analysis,in conjunction with large language models.The results demonstrate that the indoor 3D scene graph model possesses complex computation and analysis capabilities,can be directly integrated with large language models,and enables complex scene analysis applications through simple natural language prompts.

关 键 词：室内建模 图模型 IFC CITYGML 大语言模型 

分 类 号：P208[天文地球—地图制图学与地理信息工程]