基于视觉的手指语识别系统设计  

Design of finger language recognition system based on vision

作　　者：韩团军[1] 马晨 王战备[1] 尹继武[1] HAN Tuanjun;MA Chen;WANG Zhanbei;YIN Jiwu(School of Physics and Telecommunication Engineering,Shaanxi University of Technology,Hanzhong 723000,China)

机构地区：[1]陕西理工大学物理与电信工程学院,陕西汉中723000

出　　处：《实验技术与管理》2023年第4期119-124,共6页Experimental Technology and Management

基　　金：国家自然科学基金项目(61972239,61772398);陕西省重点研发计划项目(2019SF-257);陕西省科技厅计划研究项目(2022GY-122);陕西理工大学2021年科研基金项目(SLGKY-2118)。

摘　　要：针对传统手指语识别系统识别速度慢、准确率低、运算量大等问题,提出一种基于MediaPipe框架与支持向量机(SVM)的轻量级手指语识别系统。该系统通过MediaPipe提取手指语图像关节特征点,使用支持向量机(SVM)中的径向基核函数(RBF)对提取的特征进行分类,以一对一的方法将基本的二分类SVM转变为多类SVM,从而实现手语识别目的。该文还用准确度、精度、召回率和F分数等指标对该系统的性能进行了评价。Aiming at the problems of traditional finger language recognition system such as slow recognition speed,low accuracy and large amount of computation,a lightweight finger language recognition method based on MediaPipe framework and support vector machine(SVM)is proposed.The system extracts the joint feature points of finger language image through MediaPipe,classifies the extracted features using radial basis function(RBF)in support vector machine(SVM),and converts the basic two-class SVM into multi-class SVM by one-to-one method,thus realizing the purpose of sign language recognition.The proposed system performance is measured by accuracy,precision,recall rate and F score.

关 键 词：MediaPipe 支持向量机 手指语识别 机器视觉 

分 类 号：TP37[自动化与计算机技术—计算机系统结构] TJ0[自动化与计算机技术—计算机科学与技术]