多传感器数据融合的复杂人体活动识别  

Multi-sensor data fusion for complex human activity recognition

作　　者：宋欣瑞 张宪琦 张展[1] 陈新昊 刘宏伟[1] SONG Xinrui;ZHANG Xianqi;ZHANG Zhan;CHEN Xinhao;LIU Hongwei(School of Computer Science and Technology,Harbin Institute of Technology,Harbin 150001,China)

机构地区：[1]哈尔滨工业大学计算机科学与技术学院,哈尔滨150001

出　　处：《清华大学学报（自然科学版）》2020年第10期814-821,共8页Journal of Tsinghua University(Science and Technology)

基　　金：国家重点研发计划(2018YFC0830602)。

摘　　要：基于传感器的人体活动识别被广泛应用到各个领域,但利用多种异构传感器识别日常的复杂人体活动,仍然存在很多问题。对多个异构传感器数据进行数据融合时,存在兼容性问题,导致对并发复杂活动识别准确率较低。该文提出基于多传感器决策级数据融合的多任务深度学习模型。该模型利用深度学习自动地从每个传感器原始数据中进行特征提取。利用多任务学习的联合训练方法将并发复杂活动分为多个子任务,多个子任务共享网络结构,相互促进学习,提高模型的泛化性能。实验表明:该模型对周期性活动的识别准确率可达到94.6%,非周期性活动可达到93.4%,并发复杂活动可达到92.8%。该模型比3个基线模型的识别准确率平均高出8%。Human activity recognition based on wearable sensors has been widely used in various fields,but complex human activity recognition based on multiple wearable sensors still has many problems.These problems include the incompatibility of many signals from multiple sensors and the low classification accuracy of complex activities.This paper presents a multi-sensor decision-level data fusion model using multi-task deep learning for complex activity recognition.The model uses deep learning to automatically extract the features of the original sensor data.In addition,the concurrent complex activities are divided into multiple sub-tasks using a multi-task learning method.Each sub-task shares the network structure and promotes mutual learning,which improves the generalization performance of the model.Tests show that the model can achieve a 94.6%recognition accuracy rate for cyclical activities,93.4%for non-cyclical activities,and 92.8%for concurrent complex activities.The recognition accuracy rate is on average 8%higher than those of three baseline models.

关 键 词：复杂人体活动识别 多传感器数据融合 深度学习 多任务学习 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]