Functional programming paradigms in reinforcement learning problems

Machine learning, and more specifically, Reinforcement learning, has been one of the areas of computer science with the most promise and has advanced at an accelerated rate since its inception. However, these advancements have come at the cost of sacrificing best practices, especially in the librari...

Full description

Autores:
Ehrlich, Pietro
Tipo de recurso:
Trabajo de grado de pregrado
Fecha de publicación:
2022
Institución:
Universidad de los Andes
Repositorio:
Séneca: repositorio Uniandes
Idioma:
eng
OAI Identifier:
oai:repositorio.uniandes.edu.co:1992/58829
Acceso en línea:
http://hdl.handle.net/1992/58829
Palabra clave:
Reinforcement learning
Functional programming
Racket
Ingeniería
Rights
openAccess
License
Atribución 4.0 Internacional
id UNIANDES2_be3644affb2ce227c2be092a251a9567
oai_identifier_str oai:repositorio.uniandes.edu.co:1992/58829
network_acronym_str UNIANDES2
network_name_str Séneca: repositorio Uniandes
repository_id_str
dc.title.none.fl_str_mv Functional programming paradigms in reinforcement learning problems
title Functional programming paradigms in reinforcement learning problems
spellingShingle Functional programming paradigms in reinforcement learning problems
Reinforcement learning
Functional programming
Racket
Ingeniería
title_short Functional programming paradigms in reinforcement learning problems
title_full Functional programming paradigms in reinforcement learning problems
title_fullStr Functional programming paradigms in reinforcement learning problems
title_full_unstemmed Functional programming paradigms in reinforcement learning problems
title_sort Functional programming paradigms in reinforcement learning problems
dc.creator.fl_str_mv Ehrlich, Pietro
dc.contributor.advisor.none.fl_str_mv Cardozo Álvarez, Nicolás
dc.contributor.author.none.fl_str_mv Ehrlich, Pietro
dc.subject.keyword.none.fl_str_mv Reinforcement learning
Functional programming
Racket
topic Reinforcement learning
Functional programming
Racket
Ingeniería
dc.subject.themes.es_CO.fl_str_mv Ingeniería
description Machine learning, and more specifically, Reinforcement learning, has been one of the areas of computer science with the most promise and has advanced at an accelerated rate since its inception. However, these advancements have come at the cost of sacrificing best practices, especially in the libraries that compromise standards to gear them towards practical use. One such fact can be noticed in the use of Object-Oriented Programming in the development of Machine learning algorithms since stateful programs tend to be harder to test and grow efficiently and have an ever-growing amount of side effects in every process. This is why this thesis attempts to create a Reinforcement learning library that is purely functional using Racket.
publishDate 2022
dc.date.accessioned.none.fl_str_mv 2022-07-14T16:46:05Z
dc.date.available.none.fl_str_mv 2022-07-14T16:46:05Z
dc.date.issued.none.fl_str_mv 2022-07-11
dc.type.es_CO.fl_str_mv Trabajo de grado - Pregrado
dc.type.driver.none.fl_str_mv info:eu-repo/semantics/bachelorThesis
dc.type.version.none.fl_str_mv info:eu-repo/semantics/acceptedVersion
dc.type.coar.none.fl_str_mv http://purl.org/coar/resource_type/c_7a1f
dc.type.content.es_CO.fl_str_mv Text
dc.type.redcol.none.fl_str_mv http://purl.org/redcol/resource_type/TP
format http://purl.org/coar/resource_type/c_7a1f
status_str acceptedVersion
dc.identifier.uri.none.fl_str_mv http://hdl.handle.net/1992/58829
dc.identifier.instname.es_CO.fl_str_mv instname:Universidad de los Andes
dc.identifier.reponame.es_CO.fl_str_mv reponame:Repositorio Institucional Séneca
dc.identifier.repourl.es_CO.fl_str_mv repourl:https://repositorio.uniandes.edu.co/
url http://hdl.handle.net/1992/58829
identifier_str_mv instname:Universidad de los Andes
reponame:Repositorio Institucional Séneca
repourl:https://repositorio.uniandes.edu.co/
dc.language.iso.es_CO.fl_str_mv eng
language eng
dc.relation.references.es_CO.fl_str_mv Amershi, S. (n.d.). Software Engineering for Machine Learning: A Case study. https:// doi.org/https://www.microsoft.com/en-us/research/uploads/prod/2019/03/amershi- icse-2019_Software_Engineering_for_Machine_Learning.pdf
Butterick, M. (n.d.). Beautiful racket: an introduction to language-oriented programming using racket. Retrieved from https://beautifulracket.com/.
dc.rights.license.spa.fl_str_mv Atribución 4.0 Internacional
dc.rights.uri.*.fl_str_mv http://creativecommons.org/licenses/by/4.0/
dc.rights.accessrights.spa.fl_str_mv info:eu-repo/semantics/openAccess
dc.rights.coar.spa.fl_str_mv http://purl.org/coar/access_right/c_abf2
rights_invalid_str_mv Atribución 4.0 Internacional
http://creativecommons.org/licenses/by/4.0/
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.extent.es_CO.fl_str_mv 27 páginas
dc.format.mimetype.es_CO.fl_str_mv application/pdf
dc.publisher.es_CO.fl_str_mv Universidad de los Andes
dc.publisher.program.es_CO.fl_str_mv Ingeniería de Sistemas y Computación
dc.publisher.faculty.es_CO.fl_str_mv Facultad de Ingeniería
dc.publisher.department.es_CO.fl_str_mv Departamento de Ingeniería Sistemas y Computación
institution Universidad de los Andes
bitstream.url.fl_str_mv https://repositorio.uniandes.edu.co/bitstreams/f5786066-7cfe-4fc5-b5d4-6c29953e902a/download
https://repositorio.uniandes.edu.co/bitstreams/bd515c81-410c-4eba-ad1c-2567ee6f3bc2/download
https://repositorio.uniandes.edu.co/bitstreams/9845ce8a-f59d-4929-bb51-1a8e65c9d299/download
https://repositorio.uniandes.edu.co/bitstreams/bfdb9f81-a47c-450d-a125-1bfc0b2d42de/download
https://repositorio.uniandes.edu.co/bitstreams/7c256c48-53aa-4475-8e52-40bbde92692d/download
https://repositorio.uniandes.edu.co/bitstreams/9170db2a-decd-49f7-9ee3-3f7ba4766377/download
https://repositorio.uniandes.edu.co/bitstreams/86b46cc9-7be3-48c3-a5b2-9d6c0d5d0fbd/download
https://repositorio.uniandes.edu.co/bitstreams/aba6b435-cdeb-466a-8b7a-88990782871e/download
bitstream.checksum.fl_str_mv 0175ea4a2d4caec4bbcc37e300941108
1767148a454561bfe0dc50906a9d69b9
a19fc31e246edb0a724b0f3cf179fcc8
9c6f7ed00895c5d0f4c14415a0ea7785
4491fe1afb58beaaef41a73cf7ff2e27
51a5af9e83b0036fb5d5deb5439bf236
70021e6ebdb8c09a99da8fb36c30c131
5aa5c691a1ffe97abd12c2966efcb8d6
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio institucional Séneca
repository.mail.fl_str_mv adminrepositorio@uniandes.edu.co
_version_ 1818111743828688896
spelling Atribución 4.0 Internacionalhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2Cardozo Álvarez, Nicolásvirtual::4018-1Ehrlich, Pietrodef84421-8fa0-4546-97a2-ddb4354db52f6002022-07-14T16:46:05Z2022-07-14T16:46:05Z2022-07-11http://hdl.handle.net/1992/58829instname:Universidad de los Andesreponame:Repositorio Institucional Sénecarepourl:https://repositorio.uniandes.edu.co/Machine learning, and more specifically, Reinforcement learning, has been one of the areas of computer science with the most promise and has advanced at an accelerated rate since its inception. However, these advancements have come at the cost of sacrificing best practices, especially in the libraries that compromise standards to gear them towards practical use. One such fact can be noticed in the use of Object-Oriented Programming in the development of Machine learning algorithms since stateful programs tend to be harder to test and grow efficiently and have an ever-growing amount of side effects in every process. This is why this thesis attempts to create a Reinforcement learning library that is purely functional using Racket.Ingeniero de Sistemas y ComputaciónPregrado27 páginasapplication/pdfengUniversidad de los AndesIngeniería de Sistemas y ComputaciónFacultad de IngenieríaDepartamento de Ingeniería Sistemas y ComputaciónFunctional programming paradigms in reinforcement learning problemsTrabajo de grado - Pregradoinfo:eu-repo/semantics/bachelorThesisinfo:eu-repo/semantics/acceptedVersionhttp://purl.org/coar/resource_type/c_7a1fTexthttp://purl.org/redcol/resource_type/TPReinforcement learningFunctional programmingRacketIngenieríaAmershi, S. (n.d.). Software Engineering for Machine Learning: A Case study. https:// doi.org/https://www.microsoft.com/en-us/research/uploads/prod/2019/03/amershi- icse-2019_Software_Engineering_for_Machine_Learning.pdfButterick, M. (n.d.). Beautiful racket: an introduction to language-oriented programming using racket. Retrieved from https://beautifulracket.com/.201729443Publicationhttps://scholar.google.es/citations?user=3iTzjQsAAAAJvirtual::4018-10000-0002-1094-9952virtual::4018-1a77ff528-fc33-44d6-9022-814f81ef407avirtual::4018-1a77ff528-fc33-44d6-9022-814f81ef407avirtual::4018-1CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8908https://repositorio.uniandes.edu.co/bitstreams/f5786066-7cfe-4fc5-b5d4-6c29953e902a/download0175ea4a2d4caec4bbcc37e300941108MD52ORIGINALPietro Ehrlich Thesis.pdfPietro Ehrlich Thesis.pdfTrabajo de Gradoapplication/pdf238914https://repositorio.uniandes.edu.co/bitstreams/bd515c81-410c-4eba-ad1c-2567ee6f3bc2/download1767148a454561bfe0dc50906a9d69b9MD53formatoDeAutorizacionYEntregaDeTesis copy.pdfformatoDeAutorizacionYEntregaDeTesis copy.pdfHIDEapplication/pdf331121https://repositorio.uniandes.edu.co/bitstreams/9845ce8a-f59d-4929-bb51-1a8e65c9d299/downloada19fc31e246edb0a724b0f3cf179fcc8MD54TEXTPietro Ehrlich Thesis.pdf.txtPietro Ehrlich Thesis.pdf.txtExtracted texttext/plain36673https://repositorio.uniandes.edu.co/bitstreams/bfdb9f81-a47c-450d-a125-1bfc0b2d42de/download9c6f7ed00895c5d0f4c14415a0ea7785MD55formatoDeAutorizacionYEntregaDeTesis copy.pdf.txtformatoDeAutorizacionYEntregaDeTesis copy.pdf.txtExtracted texttext/plain1163https://repositorio.uniandes.edu.co/bitstreams/7c256c48-53aa-4475-8e52-40bbde92692d/download4491fe1afb58beaaef41a73cf7ff2e27MD57THUMBNAILPietro Ehrlich Thesis.pdf.jpgPietro Ehrlich Thesis.pdf.jpgIM Thumbnailimage/jpeg3092https://repositorio.uniandes.edu.co/bitstreams/9170db2a-decd-49f7-9ee3-3f7ba4766377/download51a5af9e83b0036fb5d5deb5439bf236MD56formatoDeAutorizacionYEntregaDeTesis copy.pdf.jpgformatoDeAutorizacionYEntregaDeTesis copy.pdf.jpgIM Thumbnailimage/jpeg16142https://repositorio.uniandes.edu.co/bitstreams/86b46cc9-7be3-48c3-a5b2-9d6c0d5d0fbd/download70021e6ebdb8c09a99da8fb36c30c131MD58LICENSElicense.txtlicense.txttext/plain; charset=utf-81810https://repositorio.uniandes.edu.co/bitstreams/aba6b435-cdeb-466a-8b7a-88990782871e/download5aa5c691a1ffe97abd12c2966efcb8d6MD511992/58829oai:repositorio.uniandes.edu.co:1992/588292024-03-13 12:34:45.325http://creativecommons.org/licenses/by/4.0/open.accesshttps://repositorio.uniandes.edu.coRepositorio institucional Sénecaadminrepositorio@uniandes.edu.coWW8sIGVuIG1pIGNhbGlkYWQgZGUgYXV0b3IgZGVsIHRyYWJham8gZGUgdGVzaXMsIG1vbm9ncmFmw61hIG8gdHJhYmFqbyBkZSBncmFkbywgaGFnbyBlbnRyZWdhIGRlbCBlamVtcGxhciByZXNwZWN0aXZvIHkgZGUgc3VzIGFuZXhvcyBkZSBzZXIgZWwgY2FzbywgZW4gZm9ybWF0byBkaWdpdGFsIHkvbyBlbGVjdHLDs25pY28geSBhdXRvcml6byBhIGxhIFVuaXZlcnNpZGFkIGRlIGxvcyBBbmRlcyBwYXJhIHF1ZSByZWFsaWNlIGxhIHB1YmxpY2FjacOzbiBlbiBlbCBTaXN0ZW1hIGRlIEJpYmxpb3RlY2FzIG8gZW4gY3VhbHF1aWVyIG90cm8gc2lzdGVtYSBvIGJhc2UgZGUgZGF0b3MgcHJvcGlvIG8gYWplbm8gYSBsYSBVbml2ZXJzaWRhZCB5IHBhcmEgcXVlIGVuIGxvcyB0w6lybWlub3MgZXN0YWJsZWNpZG9zIGVuIGxhIExleSAyMyBkZSAxOTgyLCBMZXkgNDQgZGUgMTk5MywgRGVjaXNpw7NuIEFuZGluYSAzNTEgZGUgMTk5MywgRGVjcmV0byA0NjAgZGUgMTk5NSB5IGRlbcOhcyBub3JtYXMgZ2VuZXJhbGVzIHNvYnJlIGxhIG1hdGVyaWEsIHV0aWxpY2UgZW4gdG9kYXMgc3VzIGZvcm1hcywgbG9zIGRlcmVjaG9zIHBhdHJpbW9uaWFsZXMgZGUgcmVwcm9kdWNjacOzbiwgY29tdW5pY2FjacOzbiBww7pibGljYSwgdHJhbnNmb3JtYWNpw7NuIHkgZGlzdHJpYnVjacOzbiAoYWxxdWlsZXIsIHByw6lzdGFtbyBww7pibGljbyBlIGltcG9ydGFjacOzbikgcXVlIG1lIGNvcnJlc3BvbmRlbiBjb21vIGNyZWFkb3IgZGUgbGEgb2JyYSBvYmpldG8gZGVsIHByZXNlbnRlIGRvY3VtZW50by4gIAoKCkxhIHByZXNlbnRlIGF1dG9yaXphY2nDs24gc2UgZW1pdGUgZW4gY2FsaWRhZCBkZSBhdXRvciBkZSBsYSBvYnJhIG9iamV0byBkZWwgcHJlc2VudGUgZG9jdW1lbnRvIHkgbm8gY29ycmVzcG9uZGUgYSBjZXNpw7NuIGRlIGRlcmVjaG9zLCBzaW5vIGEgbGEgYXV0b3JpemFjacOzbiBkZSB1c28gYWNhZMOpbWljbyBkZSBjb25mb3JtaWRhZCBjb24gbG8gYW50ZXJpb3JtZW50ZSBzZcOxYWxhZG8uIExhIHByZXNlbnRlIGF1dG9yaXphY2nDs24gc2UgaGFjZSBleHRlbnNpdmEgbm8gc29sbyBhIGxhcyBmYWN1bHRhZGVzIHkgZGVyZWNob3MgZGUgdXNvIHNvYnJlIGxhIG9icmEgZW4gZm9ybWF0byBvIHNvcG9ydGUgbWF0ZXJpYWwsIHNpbm8gdGFtYmnDqW4gcGFyYSBmb3JtYXRvIGVsZWN0csOzbmljbywgeSBlbiBnZW5lcmFsIHBhcmEgY3VhbHF1aWVyIGZvcm1hdG8gY29ub2NpZG8gbyBwb3IgY29ub2Nlci4gCgoKRWwgYXV0b3IsIG1hbmlmaWVzdGEgcXVlIGxhIG9icmEgb2JqZXRvIGRlIGxhIHByZXNlbnRlIGF1dG9yaXphY2nDs24gZXMgb3JpZ2luYWwgeSBsYSByZWFsaXrDsyBzaW4gdmlvbGFyIG8gdXN1cnBhciBkZXJlY2hvcyBkZSBhdXRvciBkZSB0ZXJjZXJvcywgcG9yIGxvIHRhbnRvLCBsYSBvYnJhIGVzIGRlIHN1IGV4Y2x1c2l2YSBhdXRvcsOtYSB5IHRpZW5lIGxhIHRpdHVsYXJpZGFkIHNvYnJlIGxhIG1pc21hLiAKCgpFbiBjYXNvIGRlIHByZXNlbnRhcnNlIGN1YWxxdWllciByZWNsYW1hY2nDs24gbyBhY2Npw7NuIHBvciBwYXJ0ZSBkZSB1biB0ZXJjZXJvIGVuIGN1YW50byBhIGxvcyBkZXJlY2hvcyBkZSBhdXRvciBzb2JyZSBsYSBvYnJhIGVuIGN1ZXN0acOzbiwgZWwgYXV0b3IgYXN1bWlyw6EgdG9kYSBsYSByZXNwb25zYWJpbGlkYWQsIHkgc2FsZHLDoSBkZSBkZWZlbnNhIGRlIGxvcyBkZXJlY2hvcyBhcXXDrSBhdXRvcml6YWRvcywgcGFyYSB0b2RvcyBsb3MgZWZlY3RvcyBsYSBVbml2ZXJzaWRhZCBhY3TDumEgY29tbyB1biB0ZXJjZXJvIGRlIGJ1ZW5hIGZlLiAKCg==