Multi-feature hierarchical topic models for human behavior recognition  

作　　者：LI HePing ZHANG Feng ZHANG ShuWu 

机构地区：[1]Institute of Automation,Chinese Academy of Sciences

出　　处：《Science China(Information Sciences)》2014年第9期83-97,共15页中国科学（信息科学）（英文版）

基　　金：supported by National Key Technology R&D Program of China(Grant Nos.2011BAH16B01,2011BAH16B02);National Natural Science Foundation of China(Grant No.61103154)

摘　　要：Human behavior recognition is one important task of image processing and surveillance system. One main challenge of human behavior recognition is how to effectively model behaviors on condition of unconstrained videos due to tremendous variations from camera motion,background clutter,object appearance and so on. In this paper,we propose two novel Multi-Feature Hierarchical Latent Dirichlet Allocation models for human behavior recognition by extending the bag-of-word topic models such as the Latent Dirichlet Allocation model and the Multi-Modal Latent Dirichlet Allocation model. The two proposed models with three hierarchies including low-level visual features,feature topics,and behavior topics can effectively fuse two different types of features including motion and static visual features,avoid detecting or tracking the motion objects,and improve the recognition performance even if the features are extracted with a great amount of noise. Finally,we adopt the variational EM algorithm to learn the parameters of these models. Experiments on the YouTube dataset demonstrate the effectiveness of our proposed models.Human behavior recognition is one important task of image processing and surveillance system. One main challenge of human behavior recognition is how to effectively model behaviors on condition of unconstrained videos due to tremendous variations from camera motion,background clutter,object appearance and so on. In this paper,we propose two novel Multi-Feature Hierarchical Latent Dirichlet Allocation models for human behavior recognition by extending the bag-of-word topic models such as the Latent Dirichlet Allocation model and the Multi-Modal Latent Dirichlet Allocation model. The two proposed models with three hierarchies including low-level visual features,feature topics,and behavior topics can effectively fuse two different types of features including motion and static visual features,avoid detecting or tracking the motion objects,and improve the recognition performance even if the features are extracted with a great amount of noise. Finally,we adopt the variational EM algorithm to learn the parameters of these models. Experiments on the YouTube dataset demonstrate the effectiveness of our proposed models.

关 键 词：hierarchical Bayesian model behavior analysis human behavior recognition latent Dirichlet allocation multi-feature hierarchical topic model 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] F270[自动化与计算机技术—计算机科学与技术]