Colombian Sign Language Interpretation Model using Artificial Intelligence

In this work, two interpretation models of Colombian Sign Language (CSL) are presented, using static and dynamic methods that employ artificial intelligence. The CRISP-DM methodology was used as a reference, creating a database with videos from seventy non-expert participants, being preprocessed and...

Full description

Autores:
Tipo de recurso:
http://purl.org/coar/resource_type/c_6739
Fecha de publicación:
2023
Institución:
Universidad Pedagógica y Tecnológica de Colombia
Repositorio:
RiUPTC: Repositorio Institucional UPTC
Idioma:
spa
OAI Identifier:
oai:repositorio.uptc.edu.co:001/10432
Acceso en línea:
https://revistas.uptc.edu.co/index.php/investigacion_duitama/article/view/16840
https://repositorio.uptc.edu.co/handle/001/10432
Palabra clave:
colombian sign language;
CNN;
LSTM;
CRISP-DM
lengua de señas colombiano;
CNN;
LSTM;
CRISP-DM
Rights
License
Derechos de autor 2023 Revista de Investigación, Desarrollo e Innovación
Description
Summary:In this work, two interpretation models of Colombian Sign Language (CSL) are presented, using static and dynamic methods that employ artificial intelligence. The CRISP-DM methodology was used as a reference, creating a database with videos from seventy non-expert participants, being preprocessed and subsequently divided into proportions of 70% - 30% for training and testing, respectively. The repository was named LSC-W70 and was used on a pre-trained model of convolutional neural networks and another in combination with LSTM networks. The results reached 67% and 76% accuracy for the static and dynamic models, respectively, where the dynamic model presents improvements in similar signs by identifying the direction of movement to define the type of sign. In this sense, a dynamic Colombian sign language interpretation tool was developed that helps close communication gaps, generating equality between people.