Behavior Recognition of the Elderly in Indoor Environment Based on Feature Fusion of Wi-Fi Perception and Videos  

作　　者：Yuebin Song Chunling Fan 

机构地区：[1]College of Automation and Electronic Engineering,Qingdao University of Science and Technology,Qingdao 266100,China

出　　处：《Journal of Beijing Institute of Technology》2023年第2期142-155,共14页北京理工大学学报（英文版）

基　　金：supported by the National Natural Science Foundation of China(No.62006135);the Natural Science Foundation of Shandong Province(No.ZR2020QF116)。

摘　　要：With the intensifying aging of the population,the phenomenon of the elderly living alone is also increasing.Therefore,using modern internet of things technology to monitor the daily behavior of the elderly in indoors is a meaningful study.Video-based action recognition tasks are easily affected by object occlusion and weak ambient light,resulting in poor recognition performance.Therefore,this paper proposes an indoor human behavior recognition method based on wireless fidelity(Wi-Fi)perception and video feature fusion by utilizing the ability of Wi-Fi signals to carry environmental information during the propagation process.This paper uses the public WiFi-based activity recognition dataset(WIAR)containing Wi-Fi channel state information and essential action videos,and then extracts video feature vectors and Wi-Fi signal feature vectors in the datasets through the two-stream convolutional neural network and standard statistical algorithms,respectively.Then the two sets of feature vectors are fused,and finally,the action classification and recognition are performed by the support vector machine(SVM).The experiments in this paper contrast experiments between the two-stream network model and the methods in this paper under three different environments.And the accuracy of action recognition after adding Wi-Fi signal feature fusion is improved by 10%on average.

关 键 词：human behavior recognition two-stream convolution neural network channel status information feature fusion support vector machine(SVM) 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TN92[自动化与计算机技术—计算机科学与技术] C913.6[电子电信—通信与信息系统]