Extreme learning machine adapted to noise based on optimization algorithms

The extreme learning machine for neural networks of feedforward of a single hidden layer randomly assigns the weights of entry and analytically determines the weights the output by means the Moore-Penrose inverse, this algorithm tends to provide an extremely fast learning speed preserving the adjustment levels achieved by classifiers such as multilayer perception and support vector machine. However, the Moore-Penrose inverse loses precision when using data with additive noise in training. That is why in this paper a method to robustness of extreme learning machine to additive noise proposed. The method consists in computing the weights of the output layer using non-linear optimization algorithms without restrictions. Tests are performed with the gradient descent optimization algorithm and with the Levenberg-Marquardt algorithm. From the implementation it is observed that through the use of these algorithms, smaller errors are achieved than those obtained with the Moore-Penrose inverse.

• Autores: Vásquez, A; Mora, M; Salazar, E; Gelvez, E
• Fecha de publicación: 2020
• Institución: Universidad Simón Bolívar
• Repositorio: Repositorio Digital USB
• Idioma: eng
• OAI Identifier: oai:bonga.unisimon.edu.co:20.500.12442/6380
• Acceso en línea: https://hdl.handle.net/20.500.12442/6380; https://iopscience.iop.org/article/10.1088/1742-6596/1514/1/012006/pdf
• Palabra clave: Optimization algorithm; Moore-Penrose; Learning
• Rights: openAccess
• License: Attribution-NonCommercial-NoDerivatives 4.0 Internacional