Pulse rate estimation based on facial videos:an evaluation and optimization of the classical methods using both self-constructed and public datasets  

作　　者：Chao-Yong Wu Jian-Xin Chen Yu Chen Ai-Ping Chen Lu Zhou Xu Wang 

机构地区：[1]School of Life Sciences,Beijing University of Chinese Medicine,Beijing 100029,China [2]Cardiology Department,Shenzhen Hospital of Beijing University of Chinese Medicine,Shenzhen 518172,China [3]Traditional Chinese Medicine(Zhong Jing)School,Henan University of Chinese Medicine,Henan 450046,China

出　　处：《Traditional Medicine Research》2024年第1期14-22,共9页TMR传统医学研究

基　　金：supported by the Key Research Program of the Chinese Academy of Sciences(grant number ZDRW-ZS-2021-1-2).

摘　　要：Pulse rate is one of the important characteristics of traditional Chinese medicine pulse diagnosis,and it is of great significance for determining the nature of cold and heat in diseases.The prediction of pulse rate based on facial video is an exciting research field for getting palpation information by observation diagnosis.However,most studies focus on optimizing the algorithm based on a small sample of participants without systematically investigating multiple influencing factors.A total of 209 participants and 2,435 facial videos,based on our self-constructed Multi-Scene Sign Dataset and the public datasets,were used to perform a multi-level and multi-factor comprehensive comparison.The effects of different datasets,blood volume pulse signal extraction algorithms,region of interests,time windows,color spaces,pulse rate calculation methods,and video recording scenes were analyzed.Furthermore,we proposed a blood volume pulse signal quality optimization strategy based on the inverse Fourier transform and an improvement strategy for pulse rate estimation based on signal-to-noise ratio threshold sliding.We found that the effects of video estimation of pulse rate in the Multi-Scene Sign Dataset and Pulse Rate Detection Dataset were better than in other datasets.Compared with Fast independent component analysis and Single Channel algorithms,chrominance-based method and plane-orthogonal-to-skin algorithms have a more vital anti-interference ability and higher robustness.The performances of the five-organs fusion area and the full-face area were better than that of single sub-regions,and the fewer motion artifacts and better lighting can improve the precision of pulse rate estimation.

关 键 词：pulse rate heart rate PHOTOPLETHYSMOGRAPHY observation and pulse diagnosis facial videos 

分 类 号：R54[医药卫生—心血管疾病]