Multi-classifier information fusion for human activity recognition in healthcare facilities  

作　　者：Da HU Mengjun WANG Shuai LI 

机构地区：[1]Department of Civil and Environmental Engineering,Kennesaw State University,Marietta,GA 30060,USA [2]Department of Civil and Environmental Engineering,The University of Tennessee,Knoxville,TN 37996,USA

出　　处：《Frontiers of Engineering Management》2025年第1期99-116,共18页工程管理前沿(英文版)

基　　金：US National Science Foundation(NSF)via Grant number 2038967;This research also received support from the Science Alliance at the University of Tennessee Knoxville(UTK)via the Joint Directed Research and Development Program.

摘　　要：In healthcare facilities,including hospitals,pathogen transmission can lead to infectious disease outbreaks,highlighting the need for effective disinfection protocols.Although disinfection robots offer a promising solution,their deployment is often hindered by their inability to accurately recognize human activities within these environments.Although numerous studies have addressed Human Activity Recognition(HAR),few have utilized scene graph features that capture the relationships between objects in a scene.To address this gap,our study proposes a novel hybrid multi-classifier information fusion method that combines scene graph analysis with visual feature extraction for enhanced HAR in healthcare settings.We first extract scene graphs,complete with node and edge attributes,from images and use a graph classifi-cation network with a graph attention mechanism for activity recognition.Concurrently,we employ Swin Transformer and convolutional neural network models to extract visual features from the same images.The outputs from these three models are then integrated using a hybrid information fusion approach based on Dempster-Shafer theory and a weighted majority vote.Our method is evalu-ated on a newly compiled hospital activity data set,consisting of 5,770 images across 25 activity categories.The results demonstrate an accuracy of 90.59%,a recall of 90.16%,and a precision of 90.31%,outperforming existing HAR methods and showing its potential for practical applications in healthcare environments.

关 键 词：human activity classification scene graph graph neural network multi-classifier fusion healthcare facility 

分 类 号：O15[理学—数学]