Mixed reality head mounted displays for enhanced indoor point cloud segmentation with virtual seeds  

作　　者：Juan C.Navares-Vázquez Pedro Arias Lucía Díaz-Vilarino Jesús Balado 

机构地区：[1]CINTECX,Universidade de Vigo,GeoTECH group,36310 Vigo,Spain

出　　处：《Resilient Cities and Structures》2024年第3期43-52,共10页韧性城市与结构（英文）

基　　金：partially supported by RYC2022-038100-I and RYC2020-029193-I funded by MCIN/AEI/10.13039/501100011033 and FSE‘El FSE invierte en tu futuro’;a result of the project PID2021-123475OA-I00,funded by MCIN/AEI/10.13039/501100011033/FEDER,UE.";the framework of the SUM4Re project(Creating materials banks from digital urban mining),which has received funding from the Horizon Europe research and innovation program under grant agreement no.101129961;Funded by the European Union.

摘　　要：Mixed Reality(MR)Head Mounted Displays(HMDs)offer a hitherto underutilized set of advantages compared to conventional 3D scanners.These benefits,inherent to MR-HMDs albeit not originally intended for such appli-cations,encompass the freedom of hand movement,hand tracking capabilities,and real-time mesh visualization.This study leverages these attributes to enhance indoor scanning process.The primary innovation lies in the con-ceptualization of manual-positioned MR virtual seeds for the purpose of indoor point cloud segmentation via a region-growing approach.The proposed methodology is effectively implemented using the HoloLens 2 platform.An application is designed to enable the remote placement of virtual tags based on the user’s visual focus on the MR-HMD display.This non-intrusive interface is further enriched with expedited tag saving and deletion functionalities,as well as augmented tag visualization through overlaying them on real-world objects.To assess the practicality of the proposed method,a comprehensive real-world case study spanning an area of 330 s^(2) is conducted.Remarkably,the survey demonstrates remarkable efficiency,with 20 virtual tags swiftly deployed,each requiring a mere 2 s for precise positioning.Subsequently,these virtual tags are employed as seeds in a region-growing algorithm for point cloud segmentation.The accuracy of virtual tag positioning is found to be exceptional,with an average error of 2.4±1.8 cm.Importantly,the user experience is significantly enhanced,leading to improved seed positioning and,consequently,more accurate final segmentation results.

关 键 词：Augmented reality eXtended Reality Handheld mobile laser scanning Region growing Semantic segmentation 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]