Speech to Mexican Sign Language for Learning with an Avatar

Fernando Barrera Melchor, Julio César Alcibar Palacios, Obdulia Pichardo-Lagunas, Bella Martinez-Seis

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device.

Original languageEnglish
Title of host publicationAdvances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings
EditorsLourdes Martínez-Villaseñor, Hiram Ponce, Oscar Herrera-Alcántara, Félix A. Castro-Espinoza
PublisherSpringer Science and Business Media Deutschland GmbH
Pages179-192
Number of pages14
ISBN (Print)9783030608866
DOIs
StatePublished - 2020
Event19th Mexican International Conference on Artificial Intelligence, MICAI 2020 - Mexico City, Mexico
Duration: 12 Oct 202017 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12469 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference19th Mexican International Conference on Artificial Intelligence, MICAI 2020
Country/TerritoryMexico
CityMexico City
Period12/10/2017/10/20

Keywords

  • Application
  • Avatar
  • Database
  • Hearing impairment
  • Inclusive education
  • Mexican Sign Language
  • Natural Language Processing

Fingerprint

Dive into the research topics of 'Speech to Mexican Sign Language for Learning with an Avatar'. Together they form a unique fingerprint.

Cite this