视觉Transformer与多特征融合的脑卒中检测算法  

Cerebral stroke detection algorithm for visual Transformer and multi-feature fusion

作　　者：赵琛琦 王华虎 赵涓涓 冀伦文 王麒达 李慧芝 赵紫娟 Zhao Chenqi;Wang Huahu;Zhao Juanjuan;Ji Lunwen;Wang Qida;Li Huizhi;Zhao Zijuan(College of Information and Computer,Taiyuan University of Technology,Jinzhong 030600,China;Guanghua School of Management,Peking University,Beijing 100871,China;The Journal Center,Taiyuan University of Technology,Taiyuan 030024,China;Shanxi Huihu Health Science and Technology Company with Limited Liability,Taiyuan 030032,China)

机构地区：[1]太原理工大学信息与计算机学院,晋中030600 [2]北京大学光华管理学院,北京100871 [3]太原理工大学期刊中心,太原030024 [4]山西慧虎健康科技有限公司,太原030032

出　　处：《中国图象图形学报》2022年第3期923-934,共12页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61972274);虚拟现实技术与系统国家重点实验室开放课题项目(VRLAB2020B06);细胞生理学教育部重点实验室开放基金项目(KLMEC/SXMU-201905);山西省重点研发计划项目(201903D321034)。

摘　　要：目的急性缺血性卒中是最常见的脑卒中类型,具有发病率高、死亡率高和致残率高的特点。患者发病前症状不明显、发病急骤以及溶栓治疗时间窗窄等问题导致其成为临床上的高危疾病。中医望诊可以在疾病发展早期,通过观察患者形、色、气和神的变化,对患者病情进行诊断和预测,达到“治未病”的目的,与人工智能技术相结合,可以解决缺乏客观和定量评价标准的问题。因此,通过中医望诊中的脸部和手部图像,充分利用两种图像的颜色、纹理等特征以及二者之间的关系特征,本文提出一种基于序列自注意力网络的急性缺血性卒中辅助诊断方法。方法对脸部和手部图像进行山根和大鱼际处的感兴趣区域提取。采用YCbCr颜色空间和灰度共生矩阵,提取区域图像的颜色和纹理特征,将颜色特征和纹理特征进行融合并将其与原图像特征相结合,得到的特征图序列化地输入到Transformer模型中,进一步学习高层次的空间特征和注意力特征。将模型输出结果输入到多层感知机中,从而实现急性缺血性卒中的检测。结果在收集的急性缺血性卒中患者数据集上进行实验,结果表明,提出的基于序列自注意力网络的方法取得了83.57%的准确率,获得较高性能,在速度和便携性上具有很大的优势。结论该方法采用端到端的学习方式,能够有效解决目前临床诊断因医疗资源的差异而受到影响的问题,对于初步判断患者疾病具有指导性的作用,为诊断急性缺血性卒中提供了一种新思路和新方法。Objective Cerebral ischemic stroke is the most common type of cerebral stroke,which is characterized by high morbidity,mortality and disability.The lack of obvious symptoms before the onset of the disease,the rapid onset of the disease,and the narrow time window for thrombolytic therapy have led to it being a high-risk disease in clinical practice.Although initial progress has been made in cerebral stroke prevention and treatment,it remains a significant cause of disability or death in adults.According to the survey,approximately 75%of stroke patients have varying degrees of functional impairment and loss of work,causing a heavy burden on families and society.With the accelerated aging and urbanization of society,the prevalence of unhealthy lifestyles among the population and the widespread exposure to cerebrovascular disease risk factors,in the disease burden of stroke has greatly increased,with a trend of rapid growth in low-income groups,marked gender and geographical differences and youthfulness.Therefore,effective ways to reduce disability and mortality rates should be developed.The early diagnosis of cerebral stroke is important.Many methods can be used to diagnose cerebral stroke in modern medicine,but the processes are relatively complex.In addition,some tests have certain drawbacks,and the presence of the disease is hard to detect in the early stages of illness,thus requiring advanced equipment and experienced clinicians.How to improve the accuracy of early diagnosis of cerebral stroke has become an important research hotspot for medical aid diagnosis.The characteristics and advantages of traditional Chinese medicine(TCM)are essential in the contemporary medical system of diseases,especially the inspection diagnosis of TCM,which is the most important in TCM diagnosis.Chinese medicine diagnosis is an objective and accurate empirical medicine,which has gradually formed and developed in long-term medical practice and clinically proven,with extremely rich connotations.Based on the basic principles of Chinese

关 键 词：中医望诊 特征提取 特征融合 端到端 TRANSFORMER 

分 类 号：TP399[自动化与计算机技术—计算机应用技术]