Dendrite morphological neurons trained by stochastic gradient descent

Producción científica: Capítulo del libro/informe/acta de congresoContribución a la conferenciarevisión exhaustiva

8 Citas (Scopus)

Resumen

Dendrite morphological neurons are a type of artificial neural network that work with min and max operators instead of algebraic products. These morphological operators allow each dendrite to build a hyper-box in classification N-dimensional space. In contrast with classical perceptrons, these simple geometrical representations, hyper-boxes, allow the proposal of training methods based on heuristics without using of an optimisation method. In literature, it has been claimed that these heuristics-based trainings have advantages: there are no convergence problems, perfect classification can always be reached and training is performed in only one epoch. This paper shows that these assumed advantages come with a cost: these heuristics increase classification errors in the test set because they are not optimal and learning generalisation is poor. To solve these problems, we introduce a novel method to train dendrite morphological neurons based on stochastic gradient descent for classification tasks, using these heuristics just for initialisation of learning parameters. We add a softmax layer to the neural architecture for calculating gradients and also propose and evaluate four different methods to initialise the dendrite parameters. Experiments are performed based on several real and synthetic datasets. Results show that we can enhance the testing accuracy in comparison with solely heuristics-based training methods. This approach reaches competitive performance with respect to other popular machine learning algorithms. Our code developed in Matlab is available online.

Idioma originalInglés
Título de la publicación alojada2016 IEEE Symposium Series on Computational Intelligence, SSCI 2016
EditorialInstitute of Electrical and Electronics Engineers Inc.
ISBN (versión digital)9781509042401
DOI
EstadoPublicada - 9 feb. 2017
Evento2016 IEEE Symposium Series on Computational Intelligence, SSCI 2016 - Athens, Grecia
Duración: 6 dic. 20169 dic. 2016

Serie de la publicación

Nombre2016 IEEE Symposium Series on Computational Intelligence, SSCI 2016

Conferencia

Conferencia2016 IEEE Symposium Series on Computational Intelligence, SSCI 2016
País/TerritorioGrecia
CiudadAthens
Período6/12/169/12/16

Huella

Profundice en los temas de investigación de 'Dendrite morphological neurons trained by stochastic gradient descent'. En conjunto forman una huella única.

Citar esto