R package for estimating parameters of some regression models with or without covariates using TensorFlow

ilustraciones, diagramas, tablas

Autores:
Garcés Céspedes, Sara
Tipo de recurso:
Fecha de publicación:
2021
Institución:
Universidad Nacional de Colombia
Repositorio:
Universidad Nacional de Colombia
Idioma:
eng
OAI Identifier:
oai:repositorio.unal.edu.co:unal/80677
Acceso en línea:
https://repositorio.unal.edu.co/handle/unal/80677
https://repositorio.unal.edu.co/
Palabra clave:
510 - Matemáticas::519 - Probabilidades y matemáticas aplicadas
Estimación de parámetros
Parameter estimation
TensorFlow
Estimation of parameters
Maximum likelihood
Optimization algorithms
Estimación de parámetros
Máxima verosimilitud
Algoritmos de optimización
Rights
openAccess
License
Atribución-NoComercial 4.0 Internacional
id UNACIONAL2_0145fd5c77bf70ba02f248704bb1ba35
oai_identifier_str oai:repositorio.unal.edu.co:unal/80677
network_acronym_str UNACIONAL2
network_name_str Universidad Nacional de Colombia
repository_id_str
dc.title.eng.fl_str_mv R package for estimating parameters of some regression models with or without covariates using TensorFlow
dc.title.translated.spa.fl_str_mv Propuesta de un paquete en R para la estimación de parámetros de algunos modelos de regresión con y sin covariables usando TensorFlow
title R package for estimating parameters of some regression models with or without covariates using TensorFlow
spellingShingle R package for estimating parameters of some regression models with or without covariates using TensorFlow
510 - Matemáticas::519 - Probabilidades y matemáticas aplicadas
Estimación de parámetros
Parameter estimation
TensorFlow
Estimation of parameters
Maximum likelihood
Optimization algorithms
Estimación de parámetros
Máxima verosimilitud
Algoritmos de optimización
title_short R package for estimating parameters of some regression models with or without covariates using TensorFlow
title_full R package for estimating parameters of some regression models with or without covariates using TensorFlow
title_fullStr R package for estimating parameters of some regression models with or without covariates using TensorFlow
title_full_unstemmed R package for estimating parameters of some regression models with or without covariates using TensorFlow
title_sort R package for estimating parameters of some regression models with or without covariates using TensorFlow
dc.creator.fl_str_mv Garcés Céspedes, Sara
dc.contributor.advisor.none.fl_str_mv Hernández Barajas, Freddy
dc.contributor.author.none.fl_str_mv Garcés Céspedes, Sara
dc.subject.ddc.spa.fl_str_mv 510 - Matemáticas::519 - Probabilidades y matemáticas aplicadas
topic 510 - Matemáticas::519 - Probabilidades y matemáticas aplicadas
Estimación de parámetros
Parameter estimation
TensorFlow
Estimation of parameters
Maximum likelihood
Optimization algorithms
Estimación de parámetros
Máxima verosimilitud
Algoritmos de optimización
dc.subject.lemb.none.fl_str_mv Estimación de parámetros
Parameter estimation
dc.subject.proposal.eng.fl_str_mv TensorFlow
Estimation of parameters
Maximum likelihood
Optimization algorithms
dc.subject.proposal.spa.fl_str_mv Estimación de parámetros
Máxima verosimilitud
Algoritmos de optimización
description ilustraciones, diagramas, tablas
publishDate 2021
dc.date.accessioned.none.fl_str_mv 2021-11-11T14:49:45Z
dc.date.available.none.fl_str_mv 2021-11-11T14:49:45Z
dc.date.issued.none.fl_str_mv 2021-11-10
dc.type.spa.fl_str_mv Trabajo de grado - Maestría
dc.type.driver.spa.fl_str_mv info:eu-repo/semantics/masterThesis
dc.type.version.spa.fl_str_mv info:eu-repo/semantics/acceptedVersion
dc.type.content.spa.fl_str_mv Text
dc.type.redcol.spa.fl_str_mv http://purl.org/redcol/resource_type/TM
status_str acceptedVersion
dc.identifier.uri.none.fl_str_mv https://repositorio.unal.edu.co/handle/unal/80677
dc.identifier.instname.spa.fl_str_mv Universidad Nacional de Colombia
dc.identifier.reponame.spa.fl_str_mv Repositorio Institucional Universidad Nacional de Colombia
dc.identifier.repourl.spa.fl_str_mv https://repositorio.unal.edu.co/
url https://repositorio.unal.edu.co/handle/unal/80677
https://repositorio.unal.edu.co/
identifier_str_mv Universidad Nacional de Colombia
Repositorio Institucional Universidad Nacional de Colombia
dc.language.iso.spa.fl_str_mv eng
language eng
dc.relation.references.spa.fl_str_mv Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, M., J. Isard, . . . Zheng, X. (2016). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation.
Adamidis, K., Dimitrakopoulou, T., & Loukas, S. (2005). On an extension of the exponentialgeometric distribution. Statistics Probability Letters, 73 , 259-269.
Agresti, A. (2015). Foundations of linear and generalized linear models. Wiley
Allaire, J., & Tang, Y. (2021). tensorflow: R interface to “tensorflow” [Computer software manual]. Retrieved from https://github.com/rstudio/tensorflow (R package version 2.2.0.9000)
Bebbington, M., Lai, C.-D., & Zitikis, R. (2007). A flexible weibull extension. Reliability Engineering System Safety, 92 (6), 719-726.
Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures.
Bolker, B., & R Development Core Team. (2020). bbmle: Tools for general maximum likelihood estimation [Computer software manual]. Retrieved from https://CRAN.R -project.org/package=bbmle (R package version 1.0.23.1)
Bottou, L. (2010). Large-scale machine learning with stochastic gradient descent. Proc. of COMPSTAT.
Boyd, S., & Vandenberghe, L. (2004). Convex optimization. Cambridge University Press.
Byrd, R., Lu, P., Nocedal, J., & Zhu, C. (1995). A limited memory algorithm for bound constrained optimization. SIAM Journal of Scientific Computing, 16 , 1190–1208.
Commenges, D., Jacqmin-Gadda, H., Proust-Lima, C., & Guedj, J. (2006). A newton-like algorithm for likelihood maximization: The robust-variance scoring algorithm. Arxiv math/0610402 .
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39 (1), 1–38
Do, Q., Son, T., & Chaudri, J. (2017). Classification of asthma severity and medication using tensorflow and multilevel databases. Procedia Computer Science, 113 , 344-351.
Duchi, J., Hazan, E., & Singer, Y. (2011). Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12 , 2121-2159.
Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London, A, 222 , 309–368.
Fox, P. A., Hall, A. P., & Schryer, N. L. (1978). The port mathematical subroutine library. ACM Trans. Math. Softw., 4 (2), 104–126.
Galeone, P. (2019). Hands-on neural networks with tensorflow 2.0: understand tensorflow, from static graph to eager execution, and design neural networks (1st ed.). Packt Publishing.
Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press. (http:// www.deeplearningbook.org)
Henningsen, A., & Toomet, O. (2011). maxlik: A package for maximum likelihood estimation in R. Computational Statistics, 26 (3), 443-458.
Garcés, S., & Hernández, F. (2021). estimtf: Estimation of distributional and regression parameters using tensorflow [Computer software manual]. Retrieved from https:// github.com/SaraGarcesCespedes/estimtf (R package version 0.1.0)
Hernandez, F., Usuga, O., Patino, C., Mosquera, J., & Urrea, A. (2021). Reldists: Estimation for some reliability distributions within gamlss framework [Computer software manual]
Hernández, F., & Usuga, O. (2019). Manual de R [Computer software manual]. Retrieved from https://fhernanb.github.io/Manual-de-R/
Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5 (3), 299–314.
Karlis, D., & Xekalaki, E. (2003). Choosing initial values for the em algorithm for finite mixtures. In Comput. stat. data anal.
Keydana, S. (2020). tfprobability: Interface to “tensorflow probability” [Computer software manual]. Retrieved from https://CRAN.R-project.org/package=tfprobability (R package version 0.11.0.0)
Kingma, D., & Ba, J. (2014). Adam: A method for stochastic optimization. International Conference on Learning Representations.
Kissell, R., & Poserina, J. (2017). Chapter 4 - advanced math and statistics. In R. Kissell & J. Poserina (Eds.), Optimal sports math, statistics, and fantasy (p. 103-135). Academic Press. Retrieved from https://www.sciencedirect.com/science/article/pii/B9780128051634000049
Devore, J. (2016). Probability and statistics for engineering and the sciences. Cengage Learning. Retrieved from https://books.google.com.co/books?id=UouECwAAQBAJ
Bakouch, H., Dey, S., Ramos, P., & Louzada, F. (2017). Binomial-exponential 2 Distribution: Different Estimation Methods with Weather Applications. TEMA (Sao Carlos), 18 , 233 - 251.
Bélisle, C. J. (1992). Convergence theorems for a class of simulated annealing algorithms on Rd. Journal of Applied Probability, 885–895.
Legendre, A. M. A. M. (1805). Nouvelles méthodes pour la détermination des orbites des cometes [microform] / par a.m. legendre. Paris: F. Didot.
Ling, M. (2018). A comparison of estimation methods for generalized gamma distribution with one-shot device testing data.
Little, T. (2014). The oxford handbook of quantitative methods (No. v. 1). Oxford University Press.
Louzada, F., Ramos, P. L., & Perdoná, G. (2016). Different estimation procedures for the parameters of the extended exponential geometric distribution for medical data. Computational and Mathematical Methods in Medicine, 2016 .
Mai Anh, T., Bastin, F., & Frejinger, E. (2014). On optimization algorithms for maximum likelihood estimation
Merovci, F. (2013). Transmuted rayleigh distribution. Austrian Journal of Statistics, 42 (1), 21-31. Retrieved from https://www.ajs.or.at/index.php/ajs/article/view/vol42%2C%20no1-2
Millar, R. (2011). Maximum likelihood estimation and inference: With examples in R, SAS and ADMB. Wiley.
Mosquera, J., & Hernandez, F. (2019). Estimationtools: Maximum likelihood estimation for probability functions from data sets [Computer software manual]. Retrieved from https://CRAN.R-project.org/package=EstimationTools (R package version 1.2.1)
Mullen, K., Ardia, D., Gil, D., Windover, D., & Cline, J. (2011). DEoptim: An R package for global optimization by differential evolution. Journal of Statistical Software, 40 (6), 1–26. Retrieved from http://www.jstatsoft.org/v40/i06/
Muralidharan, K., & Khabia, A. (2014). Some statistical inferences on inlier(s) models. International Journal of System Assurance Engineering and Management, 8 .
Nash, J. C. (2014). Nonlinear parameter optimization using R tools..
Nelder, J., & Mead, R. (1965). A simplex method for function minimization. Comput. J., 7 , 308-313.
Nelder, J. A., & Wedderburn, R. W. M. (1972). Generalized linear models. Journal of the Royal Statistical Society. Series A (General), 135 (3), 370–384
Nesterov, Y. (2014). Introductory lectures on convex optimization: A basic course (1st ed.). Springer Publishing Company, Incorporated.
Nocedal, J., & Wright, S. (2006). Numerical optimization. Springer New York. Retrieved from https://books.google.at/books?id=VbHYoSyelFcC
Pawitan, Y. (2013). In all likelihood: Statistical modelling and inference using likelihood. OUP Oxford.
Pearson, K. (1936). Method of moments and method of maximum likelihood. Biometrika, 28 (1/2), 34–59.
Qian, N. (1999). On the momentum term in gradient descent learning algorithms. Neural Networks, 12 (1), 145 - 151.
Ramos, P., & Louzada, F. (2019). A distribution for instantaneous failures. Stats, 2 , 247-258.
R Core Team. (2021). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from https://www.R-project.org/
Rigby, R. A., & Stasinopoulos, D. M. (2005). Generalized additive models for location, scale and shape. Journal of the Royal Statistical Society. Series C (Applied Statistics), 54 (3), 507–554. Retrieved from http://www.jstor.org/stable/3592732
Rizzo, M. (2007). Statistical computing with R. Chapman & Hall/CRC.
Ross, S. M. (2006). Simulation, fourth edition. USA: Academic Press, Inc.
RStudio. (2020). Tensorflow for R. Retrieved 24-06-2020, from https://tensorflow .rstudio.com/
Ruder, S. (2016). An overview of gradient descent optimization algorithms.
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323 , 533-536.
Sawant, A., Bhandari, M., Yadav, R., Yele, R., & Bendale, S. (2018). Brain cancer detection from mri: a machine learning approach (tensorflow). International Research Journal of Engineering and Technology (IRJET), 5 (4).
Schnabel, R. B., Koonatz, J. E., & Weiss, B. E. (1985). A modular system of algorithms for unconstrained minimization. ACM Trans. Math. Softw., 11 (4), 419–440.
Stasinopoulos, D., Rigby, R., Heller, G., Voudouris, V., & De Bastiani, F. (2017). Flexible regression and smoothing: Using gamlss in R.
Stigler, S. M. (1981). Gauss and the invention of least squares. The Annals of Statistics, 9 (3), 465–474.
Storvik, G. (2011). Numerical optimization of likelihoods : Additional literature for stk 2120.
Sweeting, T. J. (1980). Uniform asymptotic normality of the maximum likelihood estimator. The Annals of Statistics, 8 (6), 1375–1381.
TensorFlow. (2020). Tensorflow core v2.2.0. Retrieved 11-06-2020, from https://www.tensorflow.org/
Variani, E., Bagby, T., McDermott, E., & Bacchiani, M. (2017). End-to-end training of acoustic models for large vocabulary continuous speech recognition with tensorflow. In Interspeech.
Wickham, H. (2015). R packages (1st ed.). OReilly Media, Inc
Wilks, D. S. (2019). Chapter 4 - parametric probability distributions. In D. S. Wilks (Ed.), Statistical methods in the atmospheric sciences (fourth edition) (Fourth Edition ed., p. 77-141). Elsevier.
Yang, X.-S. (2021). Chapter 1 - introduction to algorithms. In X.-S. Yang (Ed.), Natureinspired optimization algorithms (second edition) (Second Edition ed., p. 1-22). Academic Press. Retrieved from https://www.sciencedirect.com/science/article/pii/B9780128219867000081
Zakerzadeh, H., & Dolati, A. (2009). Generalized lindley distribution. Journal of Mathematical Extension, 3 , 1-17.
Zeiler, M. (2012). Adadelta: An adaptive learning rate method. , 1212
Dey, S., Raheem, E., & Mukherjee, S. (2017). Statistical properties and different methods of estimation of transmuted rayleigh distribution. Revista Colombiana de Estadística, 40 , 165 - 203. Retrieved from http://www.scielo.org.co/scielo.phpscript=sci_arttext&pid=S0120-17512017000100008&nrm=iso
dc.rights.coar.fl_str_mv http://purl.org/coar/access_right/c_abf2
dc.rights.license.spa.fl_str_mv Atribución-NoComercial 4.0 Internacional
dc.rights.uri.spa.fl_str_mv http://creativecommons.org/licenses/by-nc/4.0/
dc.rights.accessrights.spa.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv Atribución-NoComercial 4.0 Internacional
http://creativecommons.org/licenses/by-nc/4.0/
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.extent.spa.fl_str_mv xv, 106 páginas
dc.format.mimetype.spa.fl_str_mv application/pdf
dc.publisher.spa.fl_str_mv Universidad Nacional de Colombia
dc.publisher.program.spa.fl_str_mv Medellín - Ciencias - Maestría en Ciencias - Estadística
dc.publisher.department.spa.fl_str_mv Escuela de estadística
dc.publisher.faculty.spa.fl_str_mv Facultad de Ciencias
dc.publisher.place.spa.fl_str_mv Medellín, Colombia
dc.publisher.branch.spa.fl_str_mv Universidad Nacional de Colombia - Sede Medellín
institution Universidad Nacional de Colombia
bitstream.url.fl_str_mv https://repositorio.unal.edu.co/bitstream/unal/80677/1/license.txt
https://repositorio.unal.edu.co/bitstream/unal/80677/2/1037643159.2021.pdf
https://repositorio.unal.edu.co/bitstream/unal/80677/3/1037643159.2021.pdf.jpg
bitstream.checksum.fl_str_mv 8153f7789df02f0a4c9e079953658ab2
faa3c6ecef45458d4a61130f66409995
c4e2dfb8c1927a320018a8a323e90024
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Repositorio Institucional Universidad Nacional de Colombia
repository.mail.fl_str_mv repositorio_nal@unal.edu.co
_version_ 1806886526000300032
spelling Atribución-NoComercial 4.0 Internacionalhttp://creativecommons.org/licenses/by-nc/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2Hernández Barajas, Freddy8f13a4bdeae69cce0e056df70ac12d77Garcés Céspedes, Sara9984f34e26a3913e46ed7be82b4827822021-11-11T14:49:45Z2021-11-11T14:49:45Z2021-11-10https://repositorio.unal.edu.co/handle/unal/80677Universidad Nacional de ColombiaRepositorio Institucional Universidad Nacional de Colombiahttps://repositorio.unal.edu.co/ilustraciones, diagramas, tablasLa tarea de estimar parámetros es muy importante tanto en aplicaciones científicas como de industria. El lenguaje de programación R provee una amplia variedad de funciones creadas para encontrar los estimadores de máxima verosimilitud de parámetros de distribuciones y de modelos de regresión. En este trabajo se presenta el paquete estimtf junto con sus principales funciones mle_tf y mlereg_tf. Este paquete fue diseñado con el objetivo de encontrar los estimadores de máxima verosimilitud de parámetros distribucionales y de regresión usando TensorFlow, una librería de código abierto para computación numérica creada por Google. Para alcanzar este objetivo se diseñó un proceso de estimación iterativo en el cual se utilizan los optimizadores incluidos en esta librería para maximizar la función de verosimilitud. Para ilustrar el uso del paquete estimtf y evaluar el desempeño del proceso de estimación, se llevó a cabo un estudio de simulación y se presentaron algunas aplicaciones usando bases de datos reales. A partir del estudio de simulación se observó que el tamaño de muestra, el optimizador seleccionado y el valor inicial de la tasa de aprendizaje afectan las estimaciones obtenidas con las funciones mle_tf y mlereg_tf. Adicionalmente, las estimaciones obtenidas con ambas funciones resultaron muy cercanas a los verdaderos valores de los parámetros y muy similares a las estimaciones obtenidas con otras funciones de R, las cuales son muy populares y comúnmente usadas para la estimación de parámetros. (Texto tomado de la fuente)The task of estimating parameters is very important in both scientific and industrial applications. The R programming language provides a wide variety of functions created to find the maximum likelihood estimates of parameters from distributions and regression models. In this work the estimtf package with its main functions mle_tf and mlereg_tf are presented. This package was design with the aim of finding the maximum likelihood estimates of distributional and regression parameters using TensorFlow, an open-source library for numerical computation created by Google. To achieve this goal an iterative estimation process was design in which the TensorFlow optimizers are used to maximize the likelihood function. To illustrate the use of the \pkg{estimtf} package and evaluate the performance of the estimation process, a simulation study was performed as well as some applications using real datasets. From the simulation study, an impact of the sample size, the selected optimizer, and the initial value of the learning rate on the estimates obtained with the mle_tf and the mlereg_tf functions was observed. Additionally, the estimates obtained with both functions were very close to the real value of the parameters and very similar to the estimates obtained with other R functions that are very popular and widely used for estimating parameters.MaestríaMagíster en Ciencias - EstadísticaÁrea Curricular Estadísticaxv, 106 páginasapplication/pdfengUniversidad Nacional de ColombiaMedellín - Ciencias - Maestría en Ciencias - EstadísticaEscuela de estadísticaFacultad de CienciasMedellín, ColombiaUniversidad Nacional de Colombia - Sede Medellín510 - Matemáticas::519 - Probabilidades y matemáticas aplicadasEstimación de parámetrosParameter estimationTensorFlowEstimation of parametersMaximum likelihoodOptimization algorithmsEstimación de parámetrosMáxima verosimilitudAlgoritmos de optimizaciónR package for estimating parameters of some regression models with or without covariates using TensorFlowPropuesta de un paquete en R para la estimación de parámetros de algunos modelos de regresión con y sin covariables usando TensorFlowTrabajo de grado - Maestríainfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/acceptedVersionTexthttp://purl.org/redcol/resource_type/TMAbadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, M., J. Isard, . . . Zheng, X. (2016). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation.Adamidis, K., Dimitrakopoulou, T., & Loukas, S. (2005). On an extension of the exponentialgeometric distribution. Statistics Probability Letters, 73 , 259-269.Agresti, A. (2015). Foundations of linear and generalized linear models. WileyAllaire, J., & Tang, Y. (2021). tensorflow: R interface to “tensorflow” [Computer software manual]. Retrieved from https://github.com/rstudio/tensorflow (R package version 2.2.0.9000)Bebbington, M., Lai, C.-D., & Zitikis, R. (2007). A flexible weibull extension. Reliability Engineering System Safety, 92 (6), 719-726.Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures.Bolker, B., & R Development Core Team. (2020). bbmle: Tools for general maximum likelihood estimation [Computer software manual]. Retrieved from https://CRAN.R -project.org/package=bbmle (R package version 1.0.23.1)Bottou, L. (2010). Large-scale machine learning with stochastic gradient descent. Proc. of COMPSTAT.Boyd, S., & Vandenberghe, L. (2004). Convex optimization. Cambridge University Press.Byrd, R., Lu, P., Nocedal, J., & Zhu, C. (1995). A limited memory algorithm for bound constrained optimization. SIAM Journal of Scientific Computing, 16 , 1190–1208.Commenges, D., Jacqmin-Gadda, H., Proust-Lima, C., & Guedj, J. (2006). A newton-like algorithm for likelihood maximization: The robust-variance scoring algorithm. Arxiv math/0610402 .Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39 (1), 1–38Do, Q., Son, T., & Chaudri, J. (2017). Classification of asthma severity and medication using tensorflow and multilevel databases. Procedia Computer Science, 113 , 344-351.Duchi, J., Hazan, E., & Singer, Y. (2011). Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12 , 2121-2159.Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London, A, 222 , 309–368.Fox, P. A., Hall, A. P., & Schryer, N. L. (1978). The port mathematical subroutine library. ACM Trans. Math. Softw., 4 (2), 104–126.Galeone, P. (2019). Hands-on neural networks with tensorflow 2.0: understand tensorflow, from static graph to eager execution, and design neural networks (1st ed.). Packt Publishing.Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press. (http:// www.deeplearningbook.org)Henningsen, A., & Toomet, O. (2011). maxlik: A package for maximum likelihood estimation in R. Computational Statistics, 26 (3), 443-458.Garcés, S., & Hernández, F. (2021). estimtf: Estimation of distributional and regression parameters using tensorflow [Computer software manual]. Retrieved from https:// github.com/SaraGarcesCespedes/estimtf (R package version 0.1.0)Hernandez, F., Usuga, O., Patino, C., Mosquera, J., & Urrea, A. (2021). Reldists: Estimation for some reliability distributions within gamlss framework [Computer software manual]Hernández, F., & Usuga, O. (2019). Manual de R [Computer software manual]. Retrieved from https://fhernanb.github.io/Manual-de-R/Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5 (3), 299–314.Karlis, D., & Xekalaki, E. (2003). Choosing initial values for the em algorithm for finite mixtures. In Comput. stat. data anal.Keydana, S. (2020). tfprobability: Interface to “tensorflow probability” [Computer software manual]. Retrieved from https://CRAN.R-project.org/package=tfprobability (R package version 0.11.0.0)Kingma, D., & Ba, J. (2014). Adam: A method for stochastic optimization. International Conference on Learning Representations.Kissell, R., & Poserina, J. (2017). Chapter 4 - advanced math and statistics. In R. Kissell & J. Poserina (Eds.), Optimal sports math, statistics, and fantasy (p. 103-135). Academic Press. Retrieved from https://www.sciencedirect.com/science/article/pii/B9780128051634000049Devore, J. (2016). Probability and statistics for engineering and the sciences. Cengage Learning. Retrieved from https://books.google.com.co/books?id=UouECwAAQBAJBakouch, H., Dey, S., Ramos, P., & Louzada, F. (2017). Binomial-exponential 2 Distribution: Different Estimation Methods with Weather Applications. TEMA (Sao Carlos), 18 , 233 - 251.Bélisle, C. J. (1992). Convergence theorems for a class of simulated annealing algorithms on Rd. Journal of Applied Probability, 885–895.Legendre, A. M. A. M. (1805). Nouvelles méthodes pour la détermination des orbites des cometes [microform] / par a.m. legendre. Paris: F. Didot.Ling, M. (2018). A comparison of estimation methods for generalized gamma distribution with one-shot device testing data.Little, T. (2014). The oxford handbook of quantitative methods (No. v. 1). Oxford University Press.Louzada, F., Ramos, P. L., & Perdoná, G. (2016). Different estimation procedures for the parameters of the extended exponential geometric distribution for medical data. Computational and Mathematical Methods in Medicine, 2016 .Mai Anh, T., Bastin, F., & Frejinger, E. (2014). On optimization algorithms for maximum likelihood estimationMerovci, F. (2013). Transmuted rayleigh distribution. Austrian Journal of Statistics, 42 (1), 21-31. Retrieved from https://www.ajs.or.at/index.php/ajs/article/view/vol42%2C%20no1-2Millar, R. (2011). Maximum likelihood estimation and inference: With examples in R, SAS and ADMB. Wiley.Mosquera, J., & Hernandez, F. (2019). Estimationtools: Maximum likelihood estimation for probability functions from data sets [Computer software manual]. Retrieved from https://CRAN.R-project.org/package=EstimationTools (R package version 1.2.1)Mullen, K., Ardia, D., Gil, D., Windover, D., & Cline, J. (2011). DEoptim: An R package for global optimization by differential evolution. Journal of Statistical Software, 40 (6), 1–26. Retrieved from http://www.jstatsoft.org/v40/i06/Muralidharan, K., & Khabia, A. (2014). Some statistical inferences on inlier(s) models. International Journal of System Assurance Engineering and Management, 8 .Nash, J. C. (2014). Nonlinear parameter optimization using R tools..Nelder, J., & Mead, R. (1965). A simplex method for function minimization. Comput. J., 7 , 308-313.Nelder, J. A., & Wedderburn, R. W. M. (1972). Generalized linear models. Journal of the Royal Statistical Society. Series A (General), 135 (3), 370–384Nesterov, Y. (2014). Introductory lectures on convex optimization: A basic course (1st ed.). Springer Publishing Company, Incorporated.Nocedal, J., & Wright, S. (2006). Numerical optimization. Springer New York. Retrieved from https://books.google.at/books?id=VbHYoSyelFcCPawitan, Y. (2013). In all likelihood: Statistical modelling and inference using likelihood. OUP Oxford.Pearson, K. (1936). Method of moments and method of maximum likelihood. Biometrika, 28 (1/2), 34–59.Qian, N. (1999). On the momentum term in gradient descent learning algorithms. Neural Networks, 12 (1), 145 - 151.Ramos, P., & Louzada, F. (2019). A distribution for instantaneous failures. Stats, 2 , 247-258.R Core Team. (2021). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from https://www.R-project.org/Rigby, R. A., & Stasinopoulos, D. M. (2005). Generalized additive models for location, scale and shape. Journal of the Royal Statistical Society. Series C (Applied Statistics), 54 (3), 507–554. Retrieved from http://www.jstor.org/stable/3592732Rizzo, M. (2007). Statistical computing with R. Chapman & Hall/CRC.Ross, S. M. (2006). Simulation, fourth edition. USA: Academic Press, Inc.RStudio. (2020). Tensorflow for R. Retrieved 24-06-2020, from https://tensorflow .rstudio.com/Ruder, S. (2016). An overview of gradient descent optimization algorithms.Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323 , 533-536.Sawant, A., Bhandari, M., Yadav, R., Yele, R., & Bendale, S. (2018). Brain cancer detection from mri: a machine learning approach (tensorflow). International Research Journal of Engineering and Technology (IRJET), 5 (4).Schnabel, R. B., Koonatz, J. E., & Weiss, B. E. (1985). A modular system of algorithms for unconstrained minimization. ACM Trans. Math. Softw., 11 (4), 419–440.Stasinopoulos, D., Rigby, R., Heller, G., Voudouris, V., & De Bastiani, F. (2017). Flexible regression and smoothing: Using gamlss in R.Stigler, S. M. (1981). Gauss and the invention of least squares. The Annals of Statistics, 9 (3), 465–474.Storvik, G. (2011). Numerical optimization of likelihoods : Additional literature for stk 2120.Sweeting, T. J. (1980). Uniform asymptotic normality of the maximum likelihood estimator. The Annals of Statistics, 8 (6), 1375–1381.TensorFlow. (2020). Tensorflow core v2.2.0. Retrieved 11-06-2020, from https://www.tensorflow.org/Variani, E., Bagby, T., McDermott, E., & Bacchiani, M. (2017). End-to-end training of acoustic models for large vocabulary continuous speech recognition with tensorflow. In Interspeech.Wickham, H. (2015). R packages (1st ed.). OReilly Media, IncWilks, D. S. (2019). Chapter 4 - parametric probability distributions. In D. S. Wilks (Ed.), Statistical methods in the atmospheric sciences (fourth edition) (Fourth Edition ed., p. 77-141). Elsevier.Yang, X.-S. (2021). Chapter 1 - introduction to algorithms. In X.-S. Yang (Ed.), Natureinspired optimization algorithms (second edition) (Second Edition ed., p. 1-22). Academic Press. Retrieved from https://www.sciencedirect.com/science/article/pii/B9780128219867000081Zakerzadeh, H., & Dolati, A. (2009). Generalized lindley distribution. Journal of Mathematical Extension, 3 , 1-17.Zeiler, M. (2012). Adadelta: An adaptive learning rate method. , 1212Dey, S., Raheem, E., & Mukherjee, S. (2017). Statistical properties and different methods of estimation of transmuted rayleigh distribution. Revista Colombiana de Estadística, 40 , 165 - 203. Retrieved from http://www.scielo.org.co/scielo.phpscript=sci_arttext&pid=S0120-17512017000100008&nrm=isoInvestigadoresLICENSElicense.txtlicense.txttext/plain; charset=utf-84074https://repositorio.unal.edu.co/bitstream/unal/80677/1/license.txt8153f7789df02f0a4c9e079953658ab2MD51ORIGINAL1037643159.2021.pdf1037643159.2021.pdfTesis de Maestría en Ciencias-Estadísticaapplication/pdf1098621https://repositorio.unal.edu.co/bitstream/unal/80677/2/1037643159.2021.pdffaa3c6ecef45458d4a61130f66409995MD52THUMBNAIL1037643159.2021.pdf.jpg1037643159.2021.pdf.jpgGenerated Thumbnailimage/jpeg4387https://repositorio.unal.edu.co/bitstream/unal/80677/3/1037643159.2021.pdf.jpgc4e2dfb8c1927a320018a8a323e90024MD53unal/80677oai:repositorio.unal.edu.co:unal/806772023-07-30 23:04:35.782Repositorio Institucional Universidad Nacional de Colombiarepositorio_nal@unal.edu.coUExBTlRJTExBIERFUMOTU0lUTwoKQ29tbyBlZGl0b3IgZGUgZXN0ZSDDrXRlbSwgdXN0ZWQgcHVlZGUgbW92ZXJsbyBhIHJldmlzacOzbiBzaW4gYW50ZXMgcmVzb2x2ZXIgbG9zIHByb2JsZW1hcyBpZGVudGlmaWNhZG9zLCBkZSBsbyBjb250cmFyaW8sIGhhZ2EgY2xpYyBlbiBHdWFyZGFyIHBhcmEgZ3VhcmRhciBlbCDDrXRlbSB5IHNvbHVjaW9uYXIgZXN0b3MgcHJvYmxlbWFzIG1hcyB0YXJkZS4KClBhcmEgdHJhYmFqb3MgZGVwb3NpdGFkb3MgcG9yIHN1IHByb3BpbyBhdXRvcjoKIApBbCBhdXRvYXJjaGl2YXIgZXN0ZSBncnVwbyBkZSBhcmNoaXZvcyBkaWdpdGFsZXMgeSBzdXMgbWV0YWRhdG9zLCB5byBnYXJhbnRpem8gYWwgUmVwb3NpdG9yaW8gSW5zdGl0dWNpb25hbCBVbmFsIGVsIGRlcmVjaG8gYSBhbG1hY2VuYXJsb3MgeSBtYW50ZW5lcmxvcyBkaXNwb25pYmxlcyBlbiBsw61uZWEgZGUgbWFuZXJhIGdyYXR1aXRhLiBEZWNsYXJvIHF1ZSBsYSBvYnJhIGVzIGRlIG1pIHByb3BpZWRhZCBpbnRlbGVjdHVhbCB5IHF1ZSBlbCBSZXBvc2l0b3JpbyBJbnN0aXR1Y2lvbmFsIFVuYWwgbm8gYXN1bWUgbmluZ3VuYSByZXNwb25zYWJpbGlkYWQgc2kgaGF5IGFsZ3VuYSB2aW9sYWNpw7NuIGEgbG9zIGRlcmVjaG9zIGRlIGF1dG9yIGFsIGRpc3RyaWJ1aXIgZXN0b3MgYXJjaGl2b3MgeSBtZXRhZGF0b3MuIChTZSByZWNvbWllbmRhIGEgdG9kb3MgbG9zIGF1dG9yZXMgYSBpbmRpY2FyIHN1cyBkZXJlY2hvcyBkZSBhdXRvciBlbiBsYSBww6FnaW5hIGRlIHTDrXR1bG8gZGUgc3UgZG9jdW1lbnRvLikgRGUgbGEgbWlzbWEgbWFuZXJhLCBhY2VwdG8gbG9zIHTDqXJtaW5vcyBkZSBsYSBzaWd1aWVudGUgbGljZW5jaWE6IExvcyBhdXRvcmVzIG8gdGl0dWxhcmVzIGRlbCBkZXJlY2hvIGRlIGF1dG9yIGRlbCBwcmVzZW50ZSBkb2N1bWVudG8gY29uZmllcmVuIGEgbGEgVW5pdmVyc2lkYWQgTmFjaW9uYWwgZGUgQ29sb21iaWEgdW5hIGxpY2VuY2lhIG5vIGV4Y2x1c2l2YSwgbGltaXRhZGEgeSBncmF0dWl0YSBzb2JyZSBsYSBvYnJhIHF1ZSBzZSBpbnRlZ3JhIGVuIGVsIFJlcG9zaXRvcmlvIEluc3RpdHVjaW9uYWwsIHF1ZSBzZSBhanVzdGEgYSBsYXMgc2lndWllbnRlcyBjYXJhY3RlcsOtc3RpY2FzOiBhKSBFc3RhcsOhIHZpZ2VudGUgYSBwYXJ0aXIgZGUgbGEgZmVjaGEgZW4gcXVlIHNlIGluY2x1eWUgZW4gZWwgcmVwb3NpdG9yaW8sIHF1ZSBzZXLDoW4gcHJvcnJvZ2FibGVzIGluZGVmaW5pZGFtZW50ZSBwb3IgZWwgdGllbXBvIHF1ZSBkdXJlIGVsIGRlcmVjaG8gcGF0cmltb25pYWwgZGVsIGF1dG9yLiBFbCBhdXRvciBwb2Ryw6EgZGFyIHBvciB0ZXJtaW5hZGEgbGEgbGljZW5jaWEgc29saWNpdMOhbmRvbG8gYSBsYSBVbml2ZXJzaWRhZC4gYikgTG9zIGF1dG9yZXMgYXV0b3JpemFuIGEgbGEgVW5pdmVyc2lkYWQgTmFjaW9uYWwgZGUgQ29sb21iaWEgcGFyYSBwdWJsaWNhciBsYSBvYnJhIGVuIGVsIGZvcm1hdG8gcXVlIGVsIHJlcG9zaXRvcmlvIGxvIHJlcXVpZXJhIChpbXByZXNvLCBkaWdpdGFsLCBlbGVjdHLDs25pY28gbyBjdWFscXVpZXIgb3RybyBjb25vY2lkbyBvIHBvciBjb25vY2VyKSB5IGNvbm9jZW4gcXVlIGRhZG8gcXVlIHNlIHB1YmxpY2EgZW4gSW50ZXJuZXQgcG9yIGVzdGUgaGVjaG8gY2lyY3VsYSBjb24gYWxjYW5jZSBtdW5kaWFsLiBjKSBMb3MgYXV0b3JlcyBhY2VwdGFuIHF1ZSBsYSBhdXRvcml6YWNpw7NuIHNlIGhhY2UgYSB0w610dWxvIGdyYXR1aXRvLCBwb3IgbG8gdGFudG8sIHJlbnVuY2lhbiBhIHJlY2liaXIgZW1vbHVtZW50byBhbGd1bm8gcG9yIGxhIHB1YmxpY2FjacOzbiwgZGlzdHJpYnVjacOzbiwgY29tdW5pY2FjacOzbiBww7pibGljYSB5IGN1YWxxdWllciBvdHJvIHVzbyBxdWUgc2UgaGFnYSBlbiBsb3MgdMOpcm1pbm9zIGRlIGxhIHByZXNlbnRlIGxpY2VuY2lhIHkgZGUgbGEgbGljZW5jaWEgQ3JlYXRpdmUgQ29tbW9ucyBjb24gcXVlIHNlIHB1YmxpY2EuIGQpIExvcyBhdXRvcmVzIG1hbmlmaWVzdGFuIHF1ZSBzZSB0cmF0YSBkZSB1bmEgb2JyYSBvcmlnaW5hbCBzb2JyZSBsYSBxdWUgdGllbmVuIGxvcyBkZXJlY2hvcyBxdWUgYXV0b3JpemFuIHkgcXVlIHNvbiBlbGxvcyBxdWllbmVzIGFzdW1lbiB0b3RhbCByZXNwb25zYWJpbGlkYWQgcG9yIGVsIGNvbnRlbmlkbyBkZSBzdSBvYnJhIGFudGUgbGEgVW5pdmVyc2lkYWQgTmFjaW9uYWwgeSBhbnRlIHRlcmNlcm9zLiBFbiB0b2RvIGNhc28gbGEgVW5pdmVyc2lkYWQgTmFjaW9uYWwgZGUgQ29sb21iaWEgc2UgY29tcHJvbWV0ZSBhIGluZGljYXIgc2llbXByZSBsYSBhdXRvcsOtYSBpbmNsdXllbmRvIGVsIG5vbWJyZSBkZWwgYXV0b3IgeSBsYSBmZWNoYSBkZSBwdWJsaWNhY2nDs24uIGUpIExvcyBhdXRvcmVzIGF1dG9yaXphbiBhIGxhIFVuaXZlcnNpZGFkIHBhcmEgaW5jbHVpciBsYSBvYnJhIGVuIGxvcyBhZ3JlZ2Fkb3JlcywgaW5kaWNlc3MgeSBidXNjYWRvcmVzIHF1ZSBzZSBlc3RpbWVuIG5lY2VzYXJpb3MgcGFyYSBwcm9tb3ZlciBzdSBkaWZ1c2nDs24uIGYpIExvcyBhdXRvcmVzIGFjZXB0YW4gcXVlIGxhIFVuaXZlcnNpZGFkIE5hY2lvbmFsIGRlIENvbG9tYmlhIHB1ZWRhIGNvbnZlcnRpciBlbCBkb2N1bWVudG8gYSBjdWFscXVpZXIgbWVkaW8gbyBmb3JtYXRvIHBhcmEgcHJvcMOzc2l0b3MgZGUgcHJlc2VydmFjacOzbiBkaWdpdGFsLiBTSSBFTCBET0NVTUVOVE8gU0UgQkFTQSBFTiBVTiBUUkFCQUpPIFFVRSBIQSBTSURPIFBBVFJPQ0lOQURPIE8gQVBPWUFETyBQT1IgVU5BIEFHRU5DSUEgTyBVTkEgT1JHQU5JWkFDScOTTiwgQ09OIEVYQ0VQQ0nDk04gREUgTEEgVU5JVkVSU0lEQUQgTkFDSU9OQUwgREUgQ09MT01CSUEsIExPUyBBVVRPUkVTIEdBUkFOVElaQU4gUVVFIFNFIEhBIENVTVBMSURPIENPTiBMT1MgREVSRUNIT1MgWSBPQkxJR0FDSU9ORVMgUkVRVUVSSURPUyBQT1IgRUwgUkVTUEVDVElWTyBDT05UUkFUTyBPIEFDVUVSRE8uIAoKUGFyYSB0cmFiYWpvcyBkZXBvc2l0YWRvcyBwb3Igb3RyYXMgcGVyc29uYXMgZGlzdGludGFzIGEgc3UgYXV0b3I6IAoKRGVjbGFybyBxdWUgZWwgZ3J1cG8gZGUgYXJjaGl2b3MgZGlnaXRhbGVzIHkgbWV0YWRhdG9zIGFzb2NpYWRvcyBxdWUgZXN0b3kgYXJjaGl2YW5kbyBlbiBlbCBSZXBvc2l0b3JpbyBJbnN0aXR1Y2lvbmFsIFVOKSBlcyBkZSBkb21pbmlvIHDDumJsaWNvLiBTaSBubyBmdWVzZSBlbCBjYXNvLCBhY2VwdG8gdG9kYSBsYSByZXNwb25zYWJpbGlkYWQgcG9yIGN1YWxxdWllciBpbmZyYWNjacOzbiBkZSBkZXJlY2hvcyBkZSBhdXRvciBxdWUgY29ubGxldmUgbGEgZGlzdHJpYnVjacOzbiBkZSBlc3RvcyBhcmNoaXZvcyB5IG1ldGFkYXRvcy4KTk9UQTogU0kgTEEgVEVTSVMgQSBQVUJMSUNBUiBBRFFVSVJJw5MgQ09NUFJPTUlTT1MgREUgQ09ORklERU5DSUFMSURBRCBFTiBFTCBERVNBUlJPTExPIE8gUEFSVEVTIERFTCBET0NVTUVOVE8uIFNJR0EgTEEgRElSRUNUUklaIERFIExBIFJFU09MVUNJw5NOIDAyMyBERSAyMDE1LCBQT1IgTEEgQ1VBTCBTRSBFU1RBQkxFQ0UgRUwgUFJPQ0VESU1JRU5UTyBQQVJBIExBIFBVQkxJQ0FDScOTTiBERSBURVNJUyBERSBNQUVTVFLDjUEgWSBET0NUT1JBRE8gREUgTE9TIEVTVFVESUFOVEVTIERFIExBIFVOSVZFUlNJREFEIE5BQ0lPTkFMIERFIENPTE9NQklBIEVOIEVMIFJFUE9TSVRPUklPIElOU1RJVFVDSU9OQUwgVU4sIEVYUEVESURBIFBPUiBMQSBTRUNSRVRBUsONQSBHRU5FUkFMLiAqTEEgVEVTSVMgQSBQVUJMSUNBUiBERUJFIFNFUiBMQSBWRVJTScOTTiBGSU5BTCBBUFJPQkFEQS4gCgpBbCBoYWNlciBjbGljIGVuIGVsIHNpZ3VpZW50ZSBib3TDs24sIHVzdGVkIGluZGljYSBxdWUgZXN0w6EgZGUgYWN1ZXJkbyBjb24gZXN0b3MgdMOpcm1pbm9zLiBTaSB0aWVuZSBhbGd1bmEgZHVkYSBzb2JyZSBsYSBsaWNlbmNpYSwgcG9yIGZhdm9yLCBjb250YWN0ZSBjb24gZWwgYWRtaW5pc3RyYWRvciBkZWwgc2lzdGVtYS4KClVOSVZFUlNJREFEIE5BQ0lPTkFMIERFIENPTE9NQklBIC0gw5psdGltYSBtb2RpZmljYWNpw7NuIDE5LzEwLzIwMjEK