用于学习和解释行人预期行为的群体交互场  

The Group Interaction Field for Learning and Explaining Pedestrian Anticipation

作　　者：Xueyang Wang Xuecheng Chen Puhua Jiang Haozhe Lin Xiaoyun Yuan Mengqi Ji Yuchen Guo Ruqi Huang Lu Fang 

机构地区：[1]Sigma Laboratory,Department of Electronic Engineering,Tsinghua University,Beijing 100084,China [2]Beijing National Research Center for Information Science and Technology,Tsinghua University,Beijing 100084,China [3]Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China [4]Department of Automation,Tsinghua University,Beijing 100084,China [5]Institute of Artificial Intelligence,Beihang University,Beijing 100191,China [6]Zhejiang Future Technology Institute,Yangtze Delta Region Institute of Tsinghua University,Zhejiang,Jiaxing 314033,China

出　　处：《Engineering》2024年第3期70-82,共13页工程（英文）

基　　金：supported in part by the National Natural Science Foundation of China (NSFC,62125106,61860206003,and 62088102);in part by the Ministry of Science and Technology of China (2021ZD0109901);in part by the Provincial Key Research and Development Program of Zhejiang (2021C01016).

摘　　要：Anticipating others’actions is innate and essential in order for humans to navigate and interact well with others in dense crowds.This ability is urgently required for unmanned systems such as service robots and self-driving cars.However,existing solutions struggle to predict pedestrian anticipation accurately,because the influence of group-related social behaviors has not been well considered.While group relationships and group interactions are ubiquitous and significantly influence pedestrian anticipation,their influence is diverse and subtle,making it difficult to explicitly quantify.Here,we propose the group interaction field(GIF),a novel group-aware representation that quantifies pedestrian anticipation into a probability field of pedestrians’future locations and attention orientations.An end-to-end neural network,GIFNet,is tailored to estimate the GIF from explicit multidimensional observations.GIFNet quantifies the influence of group behaviors by formulating a group interaction graph with propagation and graph attention that is adaptive to the group size and dynamic interaction states.The experimental results show that the GIF effectively represents the change in pedestrians’anticipation under the prominent impact of group behaviors and accurately predicts pedestrians’future states.Moreover,the GIF contributes to explaining various predictions of pedestrians’behavior in different social states.The proposed GIF will eventually be able to allow unmanned systems to work in a human-like manner and comply with social norms,thereby promoting harmonious human-machine relationships.

关 键 词：Human behavior modeling and prediction Implicit representation of pedestrian ANTICIPATION Group interaction Graph neural network 

分 类 号：R319[医药卫生—基础医学] TP18[自动化与计算机技术—控制理论与控制工程]