Alphabet-Level Indian Sign Language Translation to Text Using Hybrid-AO Thresholding with CNN  

作　　者：Seema Sabharwal Priti Singla 

机构地区：[1]Department of Computer Science and Engineering,Baba Mastnath University,Rohtak,124001,India [2]Department of Computer Science,Government Post Graduate College for Women,Panchkula,134109,India

出　　处：《Intelligent Automation & Soft Computing》2023年第9期2567-2582,共16页智能自动化与软计算（英文）

摘　　要：Sign language is used as a communication medium in the field of trade,defence,and in deaf-mute communities worldwide.Over the last few decades,research in the domain of translation of sign language has grown and become more challenging.This necessitates the development of a Sign Language Translation System(SLTS)to provide effective communication in different research domains.In this paper,novel Hybrid Adaptive Gaussian Thresholding with Otsu Algorithm(Hybrid-AO)for image segmentation is proposed for the translation of alphabet-level Indian Sign Language(ISLTS)with a 5-layer Convolution Neural Network(CNN).The focus of this paper is to analyze various image segmentation(Canny Edge Detection,Simple Thresholding,and Hybrid-AO),pooling approaches(Max,Average,and Global Average Pooling),and activation functions(ReLU,Leaky ReLU,and ELU).5-layer CNN with Max pooling,Leaky ReLU activation function,and Hybrid-AO(5MXLR-HAO)have outperformed other frameworks.An open-access dataset of ISL alphabets with approx.31 K images of 26 classes have been used to train and test the model.The proposed framework has been developed for translating alphabet-level Indian Sign Language into text.The proposed framework attains 98.95%training accuracy,98.05%validation accuracy,and 0.0721 training loss and 0.1021 validation loss and the perfor-mance of the proposed system outperforms other existing systems.

关 键 词：Sign language translation CNN THRESHOLDING Indian sign language 

分 类 号：TP391.1[自动化与计算机技术—计算机应用技术] TP181[自动化与计算机技术—计算机科学与技术]