Static Peruvian Sign Language Classifier Based on Manual Spelling Using a Convolutional Neural Network

Gerardo Portocarrero-Banda, Eveling Gloria Castro-Gutierrez, Abdel Alejandro Portocarrero-Banda, Claudia Acra-Despradel, David Rondon, Hugo Guillermo Jimenez-Pacheco, Miguel Angel Ortiz-Esparza

Producción científica: Contribución a una revistaArtículo de la conferenciarevisión exhaustiva

Resumen

There are great difficulties for people who suffer from mixed language disorders, having only one means for interpretive communication, sign language. A great challenge is to efficiently recognize these static gestures in real environments, therefore, the present research presents a convolutional neural network model that allows recognizing and classifying Peruvian Sign Language (PSL) with a dataset of 3025 frames through 4 stages: a) Generation of a dataset that involves 11 gestural components per frame, which involve invariant characteristics, sign parameters and gestural space, which allows greater generalization of the model compared to samples from other research b) Image preprocessing through the application of techniques and computer vision algorithms, c) Application of a convolutional neural network (CNN) model architecture and d) Execution of the model on a web platform to support model testing. The proposed CNN model obtained an accuracy rate of 99% in training, 88% in validation, and 84% in PSL recognition in the testing stage. The present model is better prepared to recognize static signs of the PSL in real scenarios.

Idioma originalInglés
Páginas (desde-hasta)69-76
Número de páginas8
PublicaciónCEUR Workshop Proceedings
Volumen3693
EstadoPublicada - 2023
Evento2023 International Conference on Systems Engineering, JINIS 2023 - Arequipa, Perú
Duración: 3 oct. 20235 oct. 2023

Huella

Profundice en los temas de investigación de 'Static Peruvian Sign Language Classifier Based on Manual Spelling Using a Convolutional Neural Network'. En conjunto forman una huella única.

Citar esto