一种识别植被覆盖滑坡的多模态深度神经网络模型  

A Multi-modal Deep Neural Network Model for Forested Landslide Detection

作　　者：唐小川 涂子涵 任绪清 方成勇 王宇[1] 刘鑫[1] 范宣梅[2] TANG Xiaochuan;TU Zihan;REN Xuqing;FANG Chengyong;WANG Yu;LIU Xin;FAN Xuanmei(College of Computer Science and Cyber Security,Chengdu University of Technology,Chengdu 610059,China;State Key Laboratory of Geohazard Prevention and Geoenvironment Protection,Chengdu University of Technology,Chengdu 610059,China;Key Laboratory of Flight Techniques and Flight Safety,Civil Aviation Flight University of China,Deyang 618307,China;National Key Laboratory of Wireless Communications,University of Electronic Science and Technology of China,Chengdu 611731,China)

机构地区：[1]成都理工大学计算机与网络安全学院,四川成都610059 [2]成都理工大学地质灾害防治与地质环境保护国家重点实验室,四川成都610059 [3]中国民用航空飞行学院民航飞行技术与飞行安全重点实验室,四川德阳618307 [4]电子科技大学通信抗干扰技术国家级重点实验室,四川成都611731

出　　处：《武汉大学学报（信息科学版）》2024年第9期1566-1573,共8页Geomatics and Information Science of Wuhan University

基　　金：中国博士后科学基金(2021M690024);民航飞行技术与飞行安全重点实验室开放项目(FZ2022KF13)。

摘　　要：中国西南山区植被茂盛,该区域光学遥感影像上的滑坡常被植被遮挡、难以辨识,基于光学遥感影像的植被覆盖滑坡识别错误率较高,难以满足实际需求。针对这一问题,利用机载激光雷达(light detection and ranging,LiDAR)生成的数字高程模型(digital elevation model,DEM)和山体阴影图去除滑坡表面的植被覆盖,构建了一个植被覆盖山区的滑坡数据集。在此基础上,提出一种基于多模态深度学习的智能滑坡识别模型,综合利用DEM和山体阴影图识别植被覆盖条件下的滑坡,模型主要包括3个神经网络模块:自动提取DEM数据特征的Transformer神经网络,自动提取山影图特征的Transformer神经网络,以及融合多模态遥感数据的卷积注意力神经网络。实验对比了ResU-Net、LandsNet、HRNet、SeaFormer模型,结果表明,所提模型达到了最高的滑坡预测精度,交并比和F1值分别提高了9.3%和6.8%。因此,LiDAR能够有效地去除植被干扰,适用于识别西南山区植被覆盖条件下的滑坡;提出的LiDAR滑坡识别模型能够预测滑坡的位置,为滑坡监测设备选址提供了有力支撑。Objectives Vegetation widely spread in the southwestern mountainous regions of China.In the remote sensing images of this area,the landslides are usually shaded by vegetation.The error rate of forested landslide detection in remote sensing images is high,which is hard to meet practical needs.Methods To address this issue,this paper uses light detection and ranging(LiDAR)-derived digital elevation mode(DEM)and hillshade to remove the forest on the landslides.In addition,a new dataset for forested landslide detection is also constructed.On this basis,an intelligent landslide detection model base on multi-modal deep learning is proposed.The proposed model uses DEM and hillshade to identify forested landslides,which consists of three neural network models:A transformer network for automatically extracting DEM features,a transformer network for automatically extracting hillshade features,and a convolution neural network with attention mechanism for merging multi-modal remote sensing data.Results The proposed model is compared with ResU-Net,LandsNet,HRNet and SeaFormer.Experimental results show that the proposed model achieves the highest prediction accuracy.Intersection over union and F1 are improved by 9.3%and 6.8%,respectively.Conclusions LiDAR is able to remove the impact of forest cover,which is suitable for identifying the forested landslides in the southwest mountain areas of China.The proposed LiDAR-based landslide detection model is able to predict the position of landslides,which is useful for deciding the position of landslide monitoring devices.

关 键 词：滑坡识别 植被覆盖 山体阴影图 DEM 多模态深度学习 神经网络模型 

分 类 号：P237[天文地球—摄影测量与遥感]