Parallel methods for linear systems solution in extreme learning machines: an overview
This paper aims to present an updated review of parallel algorithms for solving square and rectangular single and double precision matrix linear systems using multi-core central processing units and graphic processing units. A brief description of the methods for the solution of linear systems based...
- Autores:
-
Gelvez-Almeida, E
Baldera-Moreno, Y
Huérfano, Y
Vera, M
Mora, M
Barrientos, R
- Tipo de recurso:
- Fecha de publicación:
- 2020
- Institución:
- Universidad Simón Bolívar
- Repositorio:
- Repositorio Digital USB
- Idioma:
- eng
- OAI Identifier:
- oai:bonga.unisimon.edu.co:20.500.12442/8802
- Acceso en línea:
- https://hdl.handle.net/20.500.12442/8802
https://doi.org/10.1088/1742-6596/1702/1/012017
- Palabra clave:
- Multilayer perceptron
Support vector machines
Algorithms
Moore-Penrose
- Rights
- openAccess
- License
- Attribution-NonCommercial-NoDerivatives 4.0 Internacional
| id |
USIMONBOL2_206ee178e6109d4bfd82edb6d6be508e |
|---|---|
| oai_identifier_str |
oai:bonga.unisimon.edu.co:20.500.12442/8802 |
| network_acronym_str |
USIMONBOL2 |
| network_name_str |
Repositorio Digital USB |
| repository_id_str |
|
| dc.title.eng.fl_str_mv |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| title |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| spellingShingle |
Parallel methods for linear systems solution in extreme learning machines: an overview Multilayer perceptron Support vector machines Algorithms Moore-Penrose |
| title_short |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| title_full |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| title_fullStr |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| title_full_unstemmed |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| title_sort |
Parallel methods for linear systems solution in extreme learning machines: an overview |
| dc.creator.fl_str_mv |
Gelvez-Almeida, E Baldera-Moreno, Y Huérfano, Y Vera, M Mora, M Barrientos, R |
| dc.contributor.author.none.fl_str_mv |
Gelvez-Almeida, E Baldera-Moreno, Y Huérfano, Y Vera, M Mora, M Barrientos, R |
| dc.subject.eng.fl_str_mv |
Multilayer perceptron Support vector machines Algorithms Moore-Penrose |
| topic |
Multilayer perceptron Support vector machines Algorithms Moore-Penrose |
| description |
This paper aims to present an updated review of parallel algorithms for solving square and rectangular single and double precision matrix linear systems using multi-core central processing units and graphic processing units. A brief description of the methods for the solution of linear systems based on operations, factorization and iterations was made. The methodology implemented, in this article, is a documentary and it was based on the review of about 17 papers reported in the literature during the last five years (2016-2020). The disclosed findings demonstrate the potential of parallelism to significantly decrease extreme learning machines training times for problems with large amounts of data given the calculation of the Moore Penrose pseudo inverse. The implementation of parallel algorithms in the calculation of the pseudo-inverse will allow to contribute significantly in the applications of diversifying areas, since it can accelerate the training time of the extreme learning machines with optimal results. |
| publishDate |
2020 |
| dc.date.issued.none.fl_str_mv |
2020 |
| dc.date.accessioned.none.fl_str_mv |
2021-10-26T22:48:27Z |
| dc.date.available.none.fl_str_mv |
2021-10-26T22:48:27Z |
| dc.type.coarversion.fl_str_mv |
http://purl.org/coar/version/c_970fb48d4fbd8a85 |
| dc.type.coar.fl_str_mv |
http://purl.org/coar/resource_type/c_2df8fbb1 |
| dc.type.driver.eng.fl_str_mv |
info:eu-repo/semantics/article |
| dc.type.spa.spa.fl_str_mv |
Artículo científico |
| dc.identifier.citation.eng.fl_str_mv |
IOP Publishing |
| dc.identifier.issn.none.fl_str_mv |
17426596 |
| dc.identifier.uri.none.fl_str_mv |
https://hdl.handle.net/20.500.12442/8802 |
| dc.identifier.doi.none.fl_str_mv |
https://doi.org/10.1088/1742-6596/1702/1/012017 |
| identifier_str_mv |
IOP Publishing 17426596 |
| url |
https://hdl.handle.net/20.500.12442/8802 https://doi.org/10.1088/1742-6596/1702/1/012017 |
| dc.language.iso.eng.fl_str_mv |
eng |
| language |
eng |
| dc.rights.*.fl_str_mv |
Attribution-NonCommercial-NoDerivatives 4.0 Internacional |
| dc.rights.coar.fl_str_mv |
http://purl.org/coar/access_right/c_abf2 |
| dc.rights.uri.*.fl_str_mv |
http://creativecommons.org/licenses/by-nc-nd/4.0/ |
| dc.rights.accessrights.eng.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
Attribution-NonCommercial-NoDerivatives 4.0 Internacional http://creativecommons.org/licenses/by-nc-nd/4.0/ http://purl.org/coar/access_right/c_abf2 |
| eu_rights_str_mv |
openAccess |
| dc.format.mimetype.spa.fl_str_mv |
pdf |
| dc.source.eng.fl_str_mv |
Journal of Physics: Conference Series |
| dc.source.none.fl_str_mv |
Vol. 1702 (2020) |
| institution |
Universidad Simón Bolívar |
| bitstream.url.fl_str_mv |
https://bonga.unisimon.edu.co/bitstreams/956588a3-5f3f-4d4c-a9c1-75451ae6a2d6/download https://bonga.unisimon.edu.co/bitstreams/27c4a79d-b34d-4c7f-bf8c-8c176c027a9c/download https://bonga.unisimon.edu.co/bitstreams/85631d67-8f77-4548-a680-2cbb5311a1c8/download https://bonga.unisimon.edu.co/bitstreams/d10a28a6-668a-42ac-b8ae-d6e5b1b2ccb0/download https://bonga.unisimon.edu.co/bitstreams/90e2fc35-7992-4a6b-a0c1-d52e97ebd6aa/download https://bonga.unisimon.edu.co/bitstreams/02deeb10-e929-4915-9622-36e65e35c5a4/download https://bonga.unisimon.edu.co/bitstreams/42954562-1a4a-4fe0-9c32-d7a0d291a109/download |
| bitstream.checksum.fl_str_mv |
2ad8d58c9414253d196c8bb05b171fe6 4460e5956bc1d1639be9ae6146a50347 733bec43a0bf5ade4d97db708e29b185 032e9c6191f67e27b72c6e9d985ad91e 8808f75403fff28ad36d90739be5d967 e2dc3d439bed8a9c9655c5c8c46ad00b 54fa99990cf78ddff99f25cb916d0a77 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 MD5 MD5 MD5 |
| repository.name.fl_str_mv |
Repositorio Digital Universidad Simón Bolívar |
| repository.mail.fl_str_mv |
repositorio.digital@unisimon.edu.co |
| _version_ |
1814076112539484160 |
| spelling |
Gelvez-Almeida, E55062614-d175-4da1-834a-d7e54dcc92deBaldera-Moreno, Yacfe1c46-3708-4d52-a3e8-bf9bea2b3f9cHuérfano, Y001cc35e-75ac-48b8-9fd0-3c22464ff80fVera, M847eada8-99d3-4ff1-a613-ae3f62c30f9eMora, M630644e5-97cc-482b-b5d0-8f65851e3399Barrientos, R0ec1b4a9-94bb-4ae1-9931-e8fcc85a9dc32021-10-26T22:48:27Z2021-10-26T22:48:27Z2020IOP Publishing17426596https://hdl.handle.net/20.500.12442/8802https://doi.org/10.1088/1742-6596/1702/1/012017This paper aims to present an updated review of parallel algorithms for solving square and rectangular single and double precision matrix linear systems using multi-core central processing units and graphic processing units. A brief description of the methods for the solution of linear systems based on operations, factorization and iterations was made. The methodology implemented, in this article, is a documentary and it was based on the review of about 17 papers reported in the literature during the last five years (2016-2020). The disclosed findings demonstrate the potential of parallelism to significantly decrease extreme learning machines training times for problems with large amounts of data given the calculation of the Moore Penrose pseudo inverse. The implementation of parallel algorithms in the calculation of the pseudo-inverse will allow to contribute significantly in the applications of diversifying areas, since it can accelerate the training time of the extreme learning machines with optimal results.pdfengAttribution-NonCommercial-NoDerivatives 4.0 Internacionalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2Journal of Physics: Conference SeriesVol. 1702 (2020)Multilayer perceptronSupport vector machinesAlgorithmsMoore-PenroseParallel methods for linear systems solution in extreme learning machines: an overviewinfo:eu-repo/semantics/articleArtículo científicohttp://purl.org/coar/version/c_970fb48d4fbd8a85http://purl.org/coar/resource_type/c_2df8fbb1Te invitamos a seguirnos a través de nuestras redes sociales instagram: @bibliounisimon y Facebook: sistema de Bibliotecas - Universidad Simón Bolívar, de esta manera podrá mantenerse informado de todos nuestros servicios y las novedades relacionadas con Biblioteca Estimado (a) usuario (a) le invitamos a consultar AteneaLab una plataforma diseñada para brindar apoyo a toda la comunidad académica para el fortalecimiento de su formación. Videos, infografías, presentaciones, diagramas, gráficos, calendarios, flujogramas y demás piezas gráficas le ayudarán a proyectar sus ideas de manera profesional y de alta calidad. Ingrese a https://atenealab.unisimon.edu.co y descubre un mundo de herramientas que hemos colocado disponible para ti. Estimado(a) usuario(a), agradecemos realizar la Evaluación del Servicio a través del siguiente enlace: https://n9.cl/whe0z Señor agente: Compartir con los usuarios el enlace anterior para que hagan la respectiva evaluación del servicio.Lin C F and Wang S D 2002 Fuzzy support vector machines IEEE Transactions on Neural Networks 13(2) 464–471Lu S, Wang X, Zhang G and Zhou X 2015 Effective algorithms of the moore-penrose inverse matrices for extreme learning machine Intelligent Data Analysis 19(4) 743–760Rauber T and R¨unger G 2013 Performance analysis of parallel programs Parallel Programming (Berlin: Springer) pp 169–226He Q, Shang T, Zhuang F and Shi Z 2013 Parallel extreme learning machine for regression based on mapreduce Neurocomputing 102 52–58Alaba P A, Popoola S I, Olatomiwa L, Akanle M B, Ohunakin O S, Adetiba E, Alex O D, Atayero A A and Daud W M A W 2019 Towards a more efficient and cost-sensitive extreme learning machine: A state-of-the-art review of recent trend Neurocomputing 350 70–90Parkavi R M, Shanthi M and Bhuvaneshwari M C 2017 Recent trends in elm and mlelm : A review Advances in Science, Technology and Engineering Systems Journal 2(1) 69–75Lyche T 2020 Numerical Linear Algebra and Matrix Factorizations (Oslo: Springer)Hornik K, Stinchcombe M, White H et al. 1989 Multilayer feedforward networks are universal approximators. Neural networks 2(5) 359–366Huang G B, Zhu Q Y and Siew C K 2004 Extreme learning machine: a new learning scheme of feedforward neural networks IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) (Budapest: IEEE)Salazar E, Mora M, V´asquez A and Gelvez E 2020 Conditioning of extreme learning machine for noisy data using heuristic optimization Journal of Physics: Conference Series 1514 012007:1Tang J, Deng C, Huang G 2016 Extreme learning machine for multilayer perceptron IEEE Transactions on Neural Networks and Learning Systems 27(4) 809–821Kasun L, Zhou H, Huang G and Chi M 2013 Representational learning with elms for big data. intell. syst IEEE Intelligent Systems 28(6) 31–34Yi H B, Nie Z and Li B 2018 Efficient implementations of gaussian elimination in finite fields on asics for mq cryptographic systems Journal of Discrete Mathematical Sciences and Cryptography 21(3) 797–802Pan V Y and Zhao L 2017 Numerically safe gaussian elimination with no pivoting Linear Algebra and its Applications 527 349–383Abouelfarag A A, Nouh N M, ElShenawy M 2016 Scalable parallel approach for dense linear algebra International Conference on High Performance Computing & Simulation (HPCS) (Innsbruck: IEEE)Liu Y, Xiong R and Xiao Y 2016 A MPI+ OpenMP+ CUDA hybrid parallel scheme for MT occam inversion International Journal of Grid and Distributed Computing 9(9) 67–82Dumas J G, Gautier T, Pernet C, Roch J L, Sultan Z 2016 Recursion based parallelization of exact dense linear algebra routines for gaussian elimination Parallel Computing 57 235–249Zhang S, Baharlouei E and Wu P 2020 High accuracy matrix computations on neural engines: A study of qr factorization and its applications Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing (New York: Association for Computing Machinery) pp 17–28Lu Y, Yamazaki I, Ino F, Matsushita Y, Tomov S and Dongarra J 2020 Reducing the amount of out-of-core data access for gpu-accelerated randomized svd Concurrency and Computation: Practice and Experience 32(19) e5754Tom´as A E, Rodr´ıguez-S´anchez R, Catal´an S, Carratal´a-S´aez R, Quintana-Ort´ı E S 2019 Dynamic look-ahead in the reduction to band form for the singular value decomposition Parallel Computing 81 22–31Wu R 2019 Dynamic scheduling strategy for block parallel cholesky factorization based on activity on edge network IEEE Access 7 66317–66324Wu R 2018 A heterogeneous parallel cholesky block factorization algorithm IEEE Access 6 14071–14077Tapia-Romero M, Meneses-Viveros A, Hern´andez-Rubio E 2020 Parallel qr factorization using givens rotations in mpi-cuda for multi-gpu (IJACSA) International Journal of Advanced Computer Science and Applications 11(5) 636–645Islam M S and Wang Q 2020 Hierarchical jacobi iteration for structured matrices on gpus using shared memory arXiv 2006.16465 1Yang X, Wang X, Sheng J, Li Y and Luo P 2018 Parallelization and performance optimization of the jacobi stencil algorithm International Conference on Sensing,Diagnostics, Prognostics, and Control (SDPC) (Xi’an: IEEE)Aslam M, Riaz O, Mumtaz S and Asif A D 2020 Performance comparison of gpu-based jacobi solvers using cuda provided synchronization methods IEEE Access 8 31792–31812Naik T U and Guinde N 2017 Implementing the gauss seidel algorithm for solving eigenvalues of symmetric matrices with cuda International Conference on Computing Methodologies and Communication (ICCMC) (Erode: IEEE) pp 922–925Wu Z, Xue Y, You X and Zhang C 2017 Hardware efficient detection for massive mimo uplink with parallel gauss-seidel method 22nd International Conference on Digital Signal Processing (DSP) (London: IEEE)Huang G H, Xu Y Z, Yi X W, Xia M, Jiao Y Y and Zhang S 2020 Highly efficient iterative methods for solving linear equations of three-dimensional sphere discontinuous deformation analysis International Journal for Numerical Analytical Methods Geomechanics 44(9) 1301–1314ORIGINALPDF.pdfPDF.pdfPDFapplication/pdf745791https://bonga.unisimon.edu.co/bitstreams/956588a3-5f3f-4d4c-a9c1-75451ae6a2d6/download2ad8d58c9414253d196c8bb05b171fe6MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805https://bonga.unisimon.edu.co/bitstreams/27c4a79d-b34d-4c7f-bf8c-8c176c027a9c/download4460e5956bc1d1639be9ae6146a50347MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-8381https://bonga.unisimon.edu.co/bitstreams/85631d67-8f77-4548-a680-2cbb5311a1c8/download733bec43a0bf5ade4d97db708e29b185MD53TEXT2020_J.Phys._Parallel_methods.pdf.txt2020_J.Phys._Parallel_methods.pdf.txtExtracted texttext/plain26211https://bonga.unisimon.edu.co/bitstreams/d10a28a6-668a-42ac-b8ae-d6e5b1b2ccb0/download032e9c6191f67e27b72c6e9d985ad91eMD54PDF.pdf.txtPDF.pdf.txtExtracted texttext/plain27393https://bonga.unisimon.edu.co/bitstreams/90e2fc35-7992-4a6b-a0c1-d52e97ebd6aa/download8808f75403fff28ad36d90739be5d967MD56THUMBNAIL2020_J.Phys._Parallel_methods.pdf.jpg2020_J.Phys._Parallel_methods.pdf.jpgGenerated Thumbnailimage/jpeg10023https://bonga.unisimon.edu.co/bitstreams/02deeb10-e929-4915-9622-36e65e35c5a4/downloade2dc3d439bed8a9c9655c5c8c46ad00bMD55PDF.pdf.jpgPDF.pdf.jpgGenerated Thumbnailimage/jpeg3926https://bonga.unisimon.edu.co/bitstreams/42954562-1a4a-4fe0-9c32-d7a0d291a109/download54fa99990cf78ddff99f25cb916d0a77MD5720.500.12442/8802oai:bonga.unisimon.edu.co:20.500.12442/88022024-08-14 21:52:38.676http://creativecommons.org/licenses/by-nc-nd/4.0/Attribution-NonCommercial-NoDerivatives 4.0 Internacionalopen.accesshttps://bonga.unisimon.edu.coRepositorio Digital Universidad Simón Bolívarrepositorio.digital@unisimon.edu.coPGEgcmVsPSJsaWNlbnNlIiBocmVmPSJodHRwOi8vY3JlYXRpdmVjb21tb25zLm9yZy9saWNlbnNlcy9ieS1uYy80LjAvIj48aW1nIGFsdD0iTGljZW5jaWEgQ3JlYXRpdmUgQ29tbW9ucyIgc3R5bGU9ImJvcmRlci13aWR0aDowO3dpZHRoOjEwMHB4OyIgc3JjPSJodHRwczovL2kuY3JlYXRpdmVjb21tb25zLm9yZy9sL2J5LW5jLzQuMC84OHgzMS5wbmciIC8+PC9hPjxici8+RXN0YSBvYnJhIGVzdMOhIGJham8gdW5hIDxhIHJlbD0ibGljZW5zZSIgaHJlZj0iaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnktbmMvNC4wLyI+TGljZW5jaWEgQ3JlYXRpdmUgQ29tbW9ucyBBdHJpYnVjacOzbi1Ob0NvbWVyY2lhbCA0LjAgSW50ZXJuYWNpb25hbDwvYT4u |