Contactless interaction recognition and interactor detection in multi-person scenes  

作　　者：Jiacheng LI Ruize HAN Wei FENG Haomin YAN Song WANG 

机构地区：[1]College of Intelligence and Computing,Tianjin University,Tianjin 300350,China [2]Department of Computer Science and Engineering,University of South Carolina,Columbia SC 29208,USA

出　　处：《Frontiers of Computer Science》2024年第5期83-95,共13页计算机科学前沿（英文版）

基　　金：This work was supported by the National Natural Science Foundation of China(NSFC)(Grant Nos.62072334,U1803264).

摘　　要：Human interaction recognition is an essential task in video surveillance.The current works on human interaction recognition mainly focus on the scenarios only containing the close-contact interactive subjects without other people.In this paper,we handle more practical but more challenging scenarios where interactive subjects are contactless and other subjects not involved in the interactions of interest are also present in the scene.To address this problem,we propose an Interactive Relation Embedding Network(IRE-Net)to simultaneously identify the subjects involved in the interaction and recognize their interaction category.As a new problem,we also build a new dataset with annotations and metrics for performance evaluation.Experimental results on this datasesthow significant improvements of the proposed method when compared with current methodsdeveloped for human interaction recognition and group activity recognition.

关 键 词：human-human interaction recognition multiper-son scene contactless interaction human relation modeling 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]