Speech to Mexican Sign Language for Learning with an Avatar

Fernando Barrera Melchor; Julio César Alcibar Palacios; Obdulia Pichardo-Lagunas; Bella Martinez-Seis

doi:10.1007/978-3-030-60887-3_16

Speech to Mexican Sign Language for Learning with an Avatar

Fernando Barrera Melchor, Julio César Alcibar Palacios, Obdulia Pichardo-Lagunas, Bella Martinez-Seis

Unidad Profesional Interdisciplinaria de Ingeniería y Tecnologías Avanzadas (UPIITA)

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

6 Citas (Scopus)

Resumen

This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device.

Idioma original	Inglés
Título de la publicación alojada	Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings
Editores	Lourdes Martínez-Villaseñor, Hiram Ponce, Oscar Herrera-Alcántara, Félix A. Castro-Espinoza
Editorial	Springer Science and Business Media Deutschland GmbH
Páginas	179-192
Número de páginas	14
ISBN (versión impresa)	9783030608866
DOI	https://doi.org/10.1007/978-3-030-60887-3_16
Estado	Publicada - 2020
Evento	19th Mexican International Conference on Artificial Intelligence, MICAI 2020 - Mexico City, México Duración: 12 oct. 2020 → 17 oct. 2020

Serie de la publicación

Nombre	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volumen	12469 LNAI
ISSN (versión impresa)	0302-9743
ISSN (versión digital)	1611-3349

Conferencia

Conferencia	19th Mexican International Conference on Artificial Intelligence, MICAI 2020
País/Territorio	México
Ciudad	Mexico City
Período	12/10/20 → 17/10/20

ODS de las Naciones Unidas

Este resultado contribuye a los siguientes Objetivos de Desarrollo Sostenible

Acceder al documento

10.1007/978-3-030-60887-3_16

Otros archivos y enlaces

Enlace a la publicación en Scopus

Citar esto

Barrera Melchor, F., Alcibar Palacios, J. C., Pichardo-Lagunas, O., & Martinez-Seis, B. (2020). Speech to Mexican Sign Language for Learning with an Avatar. En L. Martínez-Villaseñor, H. Ponce, O. Herrera-Alcántara, & F. A. Castro-Espinoza (Eds.), Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings (pp. 179-192). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12469 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-60887-3_16

Barrera Melchor, Fernando ; Alcibar Palacios, Julio César ; Pichardo-Lagunas, Obdulia et al. / Speech to Mexican Sign Language for Learning with an Avatar. Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings. editor / Lourdes Martínez-Villaseñor ; Hiram Ponce ; Oscar Herrera-Alcántara ; Félix A. Castro-Espinoza. Springer Science and Business Media Deutschland GmbH, 2020. pp. 179-192 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e9d9d889a2c840a4b9f5fba753b53d81,

title = "Speech to Mexican Sign Language for Learning with an Avatar",

abstract = "This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device.",

keywords = "Application, Avatar, Database, Hearing impairment, Inclusive education, Mexican Sign Language, Natural Language Processing",

author = "{Barrera Melchor}, Fernando and {Alcibar Palacios}, {Julio C{\'e}sar} and Obdulia Pichardo-Lagunas and Bella Martinez-Seis",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 19th Mexican International Conference on Artificial Intelligence, MICAI 2020 ; Conference date: 12-10-2020 Through 17-10-2020",

year = "2020",

doi = "10.1007/978-3-030-60887-3_16",

language = "Ingl{\'e}s",

isbn = "9783030608866",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "179--192",

editor = "Lourdes Mart{\'i}nez-Villase{\~n}or and Hiram Ponce and Oscar Herrera-Alc{\'a}ntara and Castro-Espinoza, {F{\'e}lix A.}",

booktitle = "Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings",

address = "Alemania",

}

Barrera Melchor, F, Alcibar Palacios, JC, Pichardo-Lagunas, O & Martinez-Seis, B 2020, Speech to Mexican Sign Language for Learning with an Avatar. En L Martínez-Villaseñor, H Ponce, O Herrera-Alcántara & FA Castro-Espinoza (eds.), Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12469 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 179-192, 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Mexico City, México, 12/10/20. https://doi.org/10.1007/978-3-030-60887-3_16

Speech to Mexican Sign Language for Learning with an Avatar. / Barrera Melchor, Fernando; Alcibar Palacios, Julio César; Pichardo-Lagunas, Obdulia et al.
Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings. ed. / Lourdes Martínez-Villaseñor; Hiram Ponce; Oscar Herrera-Alcántara; Félix A. Castro-Espinoza. Springer Science and Business Media Deutschland GmbH, 2020. p. 179-192 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12469 LNAI).

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

TY - GEN

T1 - Speech to Mexican Sign Language for Learning with an Avatar

AU - Barrera Melchor, Fernando

AU - Alcibar Palacios, Julio César

AU - Pichardo-Lagunas, Obdulia

AU - Martinez-Seis, Bella

PY - 2020

Y1 - 2020

N2 - This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device.

AB - This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device.

KW - Application

KW - Avatar

KW - Database

KW - Hearing impairment

KW - Inclusive education

KW - Mexican Sign Language

KW - Natural Language Processing

UR - http://www.scopus.com/inward/record.url?scp=85092934288&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-60887-3_16

DO - 10.1007/978-3-030-60887-3_16

M3 - Contribución a la conferencia

AN - SCOPUS:85092934288

SN - 9783030608866

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 179

EP - 192

BT - Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings

A2 - Martínez-Villaseñor, Lourdes

A2 - Ponce, Hiram

A2 - Herrera-Alcántara, Oscar

A2 - Castro-Espinoza, Félix A.

PB - Springer Science and Business Media Deutschland GmbH

T2 - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020

Y2 - 12 October 2020 through 17 October 2020

ER -

Barrera Melchor F, Alcibar Palacios JC, Pichardo-Lagunas O, Martinez-Seis B. Speech to Mexican Sign Language for Learning with an Avatar. En Martínez-Villaseñor L, Ponce H, Herrera-Alcántara O, Castro-Espinoza FA, editores, Advances in Computational Intelligence - 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Proceedings. Springer Science and Business Media Deutschland GmbH. 2020. p. 179-192. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-60887-3_16

Speech to Mexican Sign Language for Learning with an Avatar

Resumen

Serie de la publicación

Conferencia

ODS de las Naciones Unidas

Acceder al documento

Otros archivos y enlaces

Huella

Citar esto