Impact of class imbalance on convolutional neural network training in multi-class problems

Image classification is the process of assigning an image one or multiple tags that describe its content. To perform the classification, a model must be designed for learning the labels to be assigned to a given image. The assignment is made through a learning process that uses a set of previously l...

Full description

Autores:
Ilham, Ahmad
Silva, Jesús
Mercado Caruso, Nohora Nubia
Tapias, Donato
Pineda, Omar
Tipo de recurso:
http://purl.org/coar/resource_type/c_816b
Fecha de publicación:
2020
Institución:
Corporación Universidad de la Costa
Repositorio:
REDICUC - Repositorio CUC
Idioma:
eng
OAI Identifier:
oai:repositorio.cuc.edu.co:11323/7258
Acceso en línea:
https://hdl.handle.net/11323/7258
https://repositorio.cuc.edu.co/
Palabra clave:
Convolutional neural network
Impact of class imbalance
Multi-class problems
Rights
closedAccess
License
Attribution-NonCommercial-NoDerivatives 4.0 International
id RCUC2_6415b96c51a331cdd0d20ca814223639
oai_identifier_str oai:repositorio.cuc.edu.co:11323/7258
network_acronym_str RCUC2
network_name_str REDICUC - Repositorio CUC
repository_id_str
dc.title.spa.fl_str_mv Impact of class imbalance on convolutional neural network training in multi-class problems
title Impact of class imbalance on convolutional neural network training in multi-class problems
spellingShingle Impact of class imbalance on convolutional neural network training in multi-class problems
Convolutional neural network
Impact of class imbalance
Multi-class problems
title_short Impact of class imbalance on convolutional neural network training in multi-class problems
title_full Impact of class imbalance on convolutional neural network training in multi-class problems
title_fullStr Impact of class imbalance on convolutional neural network training in multi-class problems
title_full_unstemmed Impact of class imbalance on convolutional neural network training in multi-class problems
title_sort Impact of class imbalance on convolutional neural network training in multi-class problems
dc.creator.fl_str_mv Ilham, Ahmad
Silva, Jesús
Mercado Caruso, Nohora Nubia
Tapias, Donato
Pineda, Omar
dc.contributor.author.spa.fl_str_mv Ilham, Ahmad
Silva, Jesús
Mercado Caruso, Nohora Nubia
Tapias, Donato
Pineda, Omar
dc.subject.spa.fl_str_mv Convolutional neural network
Impact of class imbalance
Multi-class problems
topic Convolutional neural network
Impact of class imbalance
Multi-class problems
description Image classification is the process of assigning an image one or multiple tags that describe its content. To perform the classification, a model must be designed for learning the labels to be assigned to a given image. The assignment is made through a learning process that uses a set of previously labeled training images, which must be large enough to guarantee efficient training. Many approaches have been researched to find optimal solutions to classification problems, however, databases with large amounts of images and the increased processing power of GPUs have made convolutional neural networks (CNNs) the best choice, as they outperform traditional algorithms. This paper presents a systematic analysis aimed at understanding how the issue of class inequality affects the efficiency of a convolutionary neural network trained for a task of image classification, and presents a technique for correcting the overtraining and that the network generalization.
publishDate 2020
dc.date.accessioned.none.fl_str_mv 2020-11-11T16:45:08Z
dc.date.available.none.fl_str_mv 2020-11-11T16:45:08Z
dc.date.issued.none.fl_str_mv 2020
dc.date.embargoEnd.none.fl_str_mv 2021-05-07
dc.type.spa.fl_str_mv Pre-Publicación
dc.type.coar.spa.fl_str_mv http://purl.org/coar/resource_type/c_816b
dc.type.content.spa.fl_str_mv Text
dc.type.driver.spa.fl_str_mv info:eu-repo/semantics/preprint
dc.type.redcol.spa.fl_str_mv http://purl.org/redcol/resource_type/ARTOTR
dc.type.version.spa.fl_str_mv info:eu-repo/semantics/acceptedVersion
format http://purl.org/coar/resource_type/c_816b
status_str acceptedVersion
dc.identifier.issn.spa.fl_str_mv 2194-5357
dc.identifier.uri.spa.fl_str_mv https://hdl.handle.net/11323/7258
dc.identifier.instname.spa.fl_str_mv Corporación Universidad de la Costa
dc.identifier.reponame.spa.fl_str_mv REDICUC - Repositorio CUC
dc.identifier.repourl.spa.fl_str_mv https://repositorio.cuc.edu.co/
identifier_str_mv 2194-5357
Corporación Universidad de la Costa
REDICUC - Repositorio CUC
url https://hdl.handle.net/11323/7258
https://repositorio.cuc.edu.co/
dc.language.iso.none.fl_str_mv eng
language eng
dc.relation.references.spa.fl_str_mv Khan, S.H., Hayat, M., Bennamoun, M., Sohel, F.A., Togneri, R.: Cost-sensitive learning of deep feature representations from imbalanced data. IEEE Trans. Neural Netw. Learn. Syst. 29(8), 3573–3587 (2017)
Kalinin, A.A., Iglovikov, V.I., Rakhlin, A., Shvets, A. A.: Medical image segmentation using deep neural networks with pre-trained encoders. In: Deep Learning Applications, pp. 39–52. Springer, Singapore (2020)
Buda, M., Maki, A., Mazurowski, M.A.: A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 106, 249–259 (2018)
Dong, Q., Zhu, X., Gong, S.: Single-label multi-class image classification by deep logistic regression. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3486–3493, July 2019
Talo, M., Yildirim, O., Baloglu, U.B., Aydin, G., Acharya, U.R.: Convolutional neural networks for multi-class brain disease detection using MRI images. Comput. Med. Imaging Graph. 78, 101673 (2019)
Nguyen, T.D., Kasmarik, K.E., Abbass, H.A.: An exact transformation from deep neural networks to multi-class multivariate decision trees. arXiv preprint arXiv:2003.04675 (2020)
Varela, N., Silva, J., Gonzalez, F.M., Palencia, P., Palma, H.H., Pineda, O.B.: Method for the recovery of images in databases of rice grains from visual content. Procedia Comput. Sci. 170, 983–988 (2020)
Raghu, S., Sriraam, N., Temel, Y., Rao, S.V., Kubben, P.L.: EEG based multi-class seizure type classification using convolutional neural network and transfer learning. Neural Netw. 124, 202–212 (2020)
Fidon, L., Li, W., Garcia-Peraza-Herrera, L. C., Ekanayake, J., Kitchen, N., Ourselin, S., Vercauteren, T.: Generalised wasserstein dice score for imbalanced multi-class segmentation using holistic convolutional networks. In: International MICCAI Brainlesion Workshop, pp. 64–76. Springer, Cham, September 2017
Benegui, C., Ionescu, R.T.: Convolutional neural networks for user identification based on motion sensors represented as images. IEEE Access 8(6), 61255–61266 (2020)
Talo, M.: Convolutional neural networks for multi-class histopathology image classification. arXiv preprint arXiv:1903.10035 (2019)
Shahtalebi, S., Asif, A., Mohammadi, A.: Siamese Neural networks for EEG-based Brain-computer Interfaces. arXiv preprint arXiv:2002.00904 (2020)
Zhang, S., Wen, L., Bian, X., Lei, Z., Li, S.Z.: Single-shot refinement neural network for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4203–4212 (2018)
Jmour, N., Zayen, S., Abdelkrim, A.: Convolutional neural networks for image classification. In: 2018 International Conference on Advanced Systems and Electric Technologies (IC_ASET), pp. 397–402. IEEE, March 2018
Park, T., Lee, T.: Musical instrument sound classification with deep convolutional neural network using feature fusion approach. arXiv preprint arXiv:1512.07370 (2015)
Zhong, Z., Jin, L., Xie, Z.: High performance offline handwritten chinese character recognition using googlenet and directional feature maps. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 846–850. IEEE, August 2015
Viloria, A., Acuña, G.C., Franco, D.J.A., Hernández-Palma, H., Fuentes, J.P., Rambal, E.P.: Integration of data mining techniques to PostgreSQL database manager system. Procedia Comput. Sci. 155, 575–580 (2019)
Zhang, Y., Zhou, D., Chen, S., Gao, S., Ma, Y.: Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 589–597 (2016)
Jacob, I.J.: Capsule network based biometric recognition system. J. Artif. Intell. 1(02) 83–94 (2019)
McDonnell, M.D., Vladusich, T.: Enhanced image classification with a fast-learning shallow convolutional neural network. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE, July 2015
Du, J., Zhai, J.F., Hu, J.S., Zhu, B., Wei, S., Dai, L.R.: Writer adaptive feature extraction based on convolutional neural networks for online handwritten Chinese character recognition. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 841–845. IEEE, August 2015
Viloria, A., Lezama, O.B.P.: Improvements for determining the number of clusters in k-means for innovation databases in SMEs, pp. 1201–1206, ANT/EDI40 (2019)
Wang, H., Ding, S., Wu, D., Zhang, Y., Yang, S.: Smart connected electronic gastroscope system for gastric cancer screening using multi-column convolutional neural networks. Int. J. Prod. Res. 57(21), 6795–6806 (2019)
Sharma, N., Jain, V., Mishra, A.: An analysis of convolutional neural networks for image classification. Procedia Comput. Sci. 132, 377–384 (2018)
Yim, J., Sohn, K.A.: Enhancing the performance of convolutional neural networks on quality degraded datasets. In: 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–8. IEEE, November 2017
Silva, J., Palma, H.H., Núñez, W.N., Ruiz-Lazaro, A., Varela, N.: Neural networks for tea leaf classification. J. Phys: Conf. Ser. 1432(1), 012075 (2020)
Zeng, Y., Xu, X., Fang, Y., Zhao, K.: Traffic sign recognition using extreme learning classifier with deep convolutional features. In: The 2015 International Conference on Intelligence Science and Big Data Engineering (IScIDE 2015), vol. 9242, pp. 272–280, Suzhou, June 2015
Ciregan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649. IEEE, June 2012
Ariza, P., Piñeres, M., Santiago, L., Mercado, N., De la Hoz, A.: Implementation of MOPROSOFT level I and II in software development companies in the colombian caribbean, a commitment to the software product quality region. In: 2014 IEEE Central America and Panama Convention (CONCAPAN XXXIV), pp. 1–5, Panama City (2014). https://ezproxy.cuc.edu.co:2067/10.1109/CONCAPAN.2014.7000402
dc.rights.spa.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.uri.spa.fl_str_mv http://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.accessrights.spa.fl_str_mv info:eu-repo/semantics/closedAccess
dc.rights.coar.spa.fl_str_mv http://purl.org/coar/access_right/c_14cb
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
http://purl.org/coar/access_right/c_14cb
eu_rights_str_mv closedAccess
dc.format.mimetype.spa.fl_str_mv application/pdf
dc.publisher.spa.fl_str_mv Corporación Universidad de la Costa
dc.source.spa.fl_str_mv Advances in Intelligent Systems and Computing
institution Corporación Universidad de la Costa
dc.source.url.spa.fl_str_mv https://www.scopus.com/inward/record.uri?eid=2-s2.0-85089228091&doi=10.1007%2f978-3-030-51859-2_28&partnerID=40&md5=ac05fd947220584bbc26c8914f14071e
bitstream.url.fl_str_mv https://repositorio.cuc.edu.co/bitstreams/577a1d5f-35fa-4d14-ba44-b87fc546f9cf/download
https://repositorio.cuc.edu.co/bitstreams/5fe9f6f4-60b7-42b4-8ced-cefa3fc91cd2/download
https://repositorio.cuc.edu.co/bitstreams/836a6428-0a5b-4072-8e2a-6238f5e8d5e5/download
https://repositorio.cuc.edu.co/bitstreams/dbf405ce-3497-4e29-bc36-72714c5f0cae/download
https://repositorio.cuc.edu.co/bitstreams/db7cc541-6bed-4a86-a813-fd1874ba0d7a/download
bitstream.checksum.fl_str_mv 7f584e30ad9188540913f4665a56d2a9
4460e5956bc1d1639be9ae6146a50347
e30e9215131d99561d40d6b0abbe9bad
715d04379c12fc1e737f76e45270ce41
2d1f354c98de29d38c5dfc7a11799034
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio de la Universidad de la Costa CUC
repository.mail.fl_str_mv repdigital@cuc.edu.co
_version_ 1811760727391731712
spelling Ilham, AhmadSilva, JesúsMercado Caruso, Nohora NubiaTapias, DonatoPineda, Omar2020-11-11T16:45:08Z2020-11-11T16:45:08Z20202021-05-072194-5357https://hdl.handle.net/11323/7258Corporación Universidad de la CostaREDICUC - Repositorio CUChttps://repositorio.cuc.edu.co/Image classification is the process of assigning an image one or multiple tags that describe its content. To perform the classification, a model must be designed for learning the labels to be assigned to a given image. The assignment is made through a learning process that uses a set of previously labeled training images, which must be large enough to guarantee efficient training. Many approaches have been researched to find optimal solutions to classification problems, however, databases with large amounts of images and the increased processing power of GPUs have made convolutional neural networks (CNNs) the best choice, as they outperform traditional algorithms. This paper presents a systematic analysis aimed at understanding how the issue of class inequality affects the efficiency of a convolutionary neural network trained for a task of image classification, and presents a technique for correcting the overtraining and that the network generalization.Ilham, Ahmad-will be generated-orcid-0000-0003-0211-2682-600Silva, JesúsMercado Caruso, Nohora Nubia-will be generated-orcid-0000-0001-9261-8331-600Tapias, Donato-will be generated-orcid-0000-0003-3838-4225-600Pineda, Omar-will be generated-orcid-0000-0002-8239-3906-600application/pdfengCorporación Universidad de la CostaAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/closedAccesshttp://purl.org/coar/access_right/c_14cbAdvances in Intelligent Systems and Computinghttps://www.scopus.com/inward/record.uri?eid=2-s2.0-85089228091&doi=10.1007%2f978-3-030-51859-2_28&partnerID=40&md5=ac05fd947220584bbc26c8914f14071eConvolutional neural networkImpact of class imbalanceMulti-class problemsImpact of class imbalance on convolutional neural network training in multi-class problemsPre-Publicaciónhttp://purl.org/coar/resource_type/c_816bTextinfo:eu-repo/semantics/preprinthttp://purl.org/redcol/resource_type/ARTOTRinfo:eu-repo/semantics/acceptedVersionKhan, S.H., Hayat, M., Bennamoun, M., Sohel, F.A., Togneri, R.: Cost-sensitive learning of deep feature representations from imbalanced data. IEEE Trans. Neural Netw. Learn. Syst. 29(8), 3573–3587 (2017)Kalinin, A.A., Iglovikov, V.I., Rakhlin, A., Shvets, A. A.: Medical image segmentation using deep neural networks with pre-trained encoders. In: Deep Learning Applications, pp. 39–52. Springer, Singapore (2020)Buda, M., Maki, A., Mazurowski, M.A.: A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 106, 249–259 (2018)Dong, Q., Zhu, X., Gong, S.: Single-label multi-class image classification by deep logistic regression. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3486–3493, July 2019Talo, M., Yildirim, O., Baloglu, U.B., Aydin, G., Acharya, U.R.: Convolutional neural networks for multi-class brain disease detection using MRI images. Comput. Med. Imaging Graph. 78, 101673 (2019)Nguyen, T.D., Kasmarik, K.E., Abbass, H.A.: An exact transformation from deep neural networks to multi-class multivariate decision trees. arXiv preprint arXiv:2003.04675 (2020)Varela, N., Silva, J., Gonzalez, F.M., Palencia, P., Palma, H.H., Pineda, O.B.: Method for the recovery of images in databases of rice grains from visual content. Procedia Comput. Sci. 170, 983–988 (2020)Raghu, S., Sriraam, N., Temel, Y., Rao, S.V., Kubben, P.L.: EEG based multi-class seizure type classification using convolutional neural network and transfer learning. Neural Netw. 124, 202–212 (2020)Fidon, L., Li, W., Garcia-Peraza-Herrera, L. C., Ekanayake, J., Kitchen, N., Ourselin, S., Vercauteren, T.: Generalised wasserstein dice score for imbalanced multi-class segmentation using holistic convolutional networks. In: International MICCAI Brainlesion Workshop, pp. 64–76. Springer, Cham, September 2017Benegui, C., Ionescu, R.T.: Convolutional neural networks for user identification based on motion sensors represented as images. IEEE Access 8(6), 61255–61266 (2020)Talo, M.: Convolutional neural networks for multi-class histopathology image classification. arXiv preprint arXiv:1903.10035 (2019)Shahtalebi, S., Asif, A., Mohammadi, A.: Siamese Neural networks for EEG-based Brain-computer Interfaces. arXiv preprint arXiv:2002.00904 (2020)Zhang, S., Wen, L., Bian, X., Lei, Z., Li, S.Z.: Single-shot refinement neural network for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4203–4212 (2018)Jmour, N., Zayen, S., Abdelkrim, A.: Convolutional neural networks for image classification. In: 2018 International Conference on Advanced Systems and Electric Technologies (IC_ASET), pp. 397–402. IEEE, March 2018Park, T., Lee, T.: Musical instrument sound classification with deep convolutional neural network using feature fusion approach. arXiv preprint arXiv:1512.07370 (2015)Zhong, Z., Jin, L., Xie, Z.: High performance offline handwritten chinese character recognition using googlenet and directional feature maps. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 846–850. IEEE, August 2015Viloria, A., Acuña, G.C., Franco, D.J.A., Hernández-Palma, H., Fuentes, J.P., Rambal, E.P.: Integration of data mining techniques to PostgreSQL database manager system. Procedia Comput. Sci. 155, 575–580 (2019)Zhang, Y., Zhou, D., Chen, S., Gao, S., Ma, Y.: Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 589–597 (2016)Jacob, I.J.: Capsule network based biometric recognition system. J. Artif. Intell. 1(02) 83–94 (2019)McDonnell, M.D., Vladusich, T.: Enhanced image classification with a fast-learning shallow convolutional neural network. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE, July 2015Du, J., Zhai, J.F., Hu, J.S., Zhu, B., Wei, S., Dai, L.R.: Writer adaptive feature extraction based on convolutional neural networks for online handwritten Chinese character recognition. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 841–845. IEEE, August 2015Viloria, A., Lezama, O.B.P.: Improvements for determining the number of clusters in k-means for innovation databases in SMEs, pp. 1201–1206, ANT/EDI40 (2019)Wang, H., Ding, S., Wu, D., Zhang, Y., Yang, S.: Smart connected electronic gastroscope system for gastric cancer screening using multi-column convolutional neural networks. Int. J. Prod. Res. 57(21), 6795–6806 (2019)Sharma, N., Jain, V., Mishra, A.: An analysis of convolutional neural networks for image classification. Procedia Comput. Sci. 132, 377–384 (2018)Yim, J., Sohn, K.A.: Enhancing the performance of convolutional neural networks on quality degraded datasets. In: 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–8. IEEE, November 2017Silva, J., Palma, H.H., Núñez, W.N., Ruiz-Lazaro, A., Varela, N.: Neural networks for tea leaf classification. J. Phys: Conf. Ser. 1432(1), 012075 (2020)Zeng, Y., Xu, X., Fang, Y., Zhao, K.: Traffic sign recognition using extreme learning classifier with deep convolutional features. In: The 2015 International Conference on Intelligence Science and Big Data Engineering (IScIDE 2015), vol. 9242, pp. 272–280, Suzhou, June 2015Ciregan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649. IEEE, June 2012Ariza, P., Piñeres, M., Santiago, L., Mercado, N., De la Hoz, A.: Implementation of MOPROSOFT level I and II in software development companies in the colombian caribbean, a commitment to the software product quality region. In: 2014 IEEE Central America and Panama Convention (CONCAPAN XXXIV), pp. 1–5, Panama City (2014). https://ezproxy.cuc.edu.co:2067/10.1109/CONCAPAN.2014.7000402PublicationORIGINALIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdfIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdfapplication/pdf179626https://repositorio.cuc.edu.co/bitstreams/577a1d5f-35fa-4d14-ba44-b87fc546f9cf/download7f584e30ad9188540913f4665a56d2a9MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805https://repositorio.cuc.edu.co/bitstreams/5fe9f6f4-60b7-42b4-8ced-cefa3fc91cd2/download4460e5956bc1d1639be9ae6146a50347MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-83196https://repositorio.cuc.edu.co/bitstreams/836a6428-0a5b-4072-8e2a-6238f5e8d5e5/downloade30e9215131d99561d40d6b0abbe9badMD53THUMBNAILIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdf.jpgIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdf.jpgimage/jpeg44658https://repositorio.cuc.edu.co/bitstreams/dbf405ce-3497-4e29-bc36-72714c5f0cae/download715d04379c12fc1e737f76e45270ce41MD54TEXTIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdf.txtIMPACT OF CLASS IMBALANCE ON CONVOLUTIONAL NEURAL NETWORK TRAINING IN MULTI-CLASS PROBLEMS.pdf.txttext/plain1287https://repositorio.cuc.edu.co/bitstreams/db7cc541-6bed-4a86-a813-fd1874ba0d7a/download2d1f354c98de29d38c5dfc7a11799034MD5511323/7258oai:repositorio.cuc.edu.co:11323/72582024-09-17 10:50:23.132http://creativecommons.org/licenses/by-nc-nd/4.0/Attribution-NonCommercial-NoDerivatives 4.0 Internationalopen.accesshttps://repositorio.cuc.edu.coRepositorio de la Universidad de la Costa CUCrepdigital@cuc.edu.coQXV0b3Jpem8gKGF1dG9yaXphbW9zKSBhIGxhIEJpYmxpb3RlY2EgZGUgbGEgSW5zdGl0dWNpw7NuIHBhcmEgcXVlIGluY2x1eWEgdW5hIGNvcGlhLCBpbmRleGUgeSBkaXZ1bGd1ZSBlbiBlbCBSZXBvc2l0b3JpbyBJbnN0aXR1Y2lvbmFsLCBsYSBvYnJhIG1lbmNpb25hZGEgY29uIGVsIGZpbiBkZSBmYWNpbGl0YXIgbG9zIHByb2Nlc29zIGRlIHZpc2liaWxpZGFkIGUgaW1wYWN0byBkZSBsYSBtaXNtYSwgY29uZm9ybWUgYSBsb3MgZGVyZWNob3MgcGF0cmltb25pYWxlcyBxdWUgbWUobm9zKSBjb3JyZXNwb25kZShuKSB5IHF1ZSBpbmNsdXllbjogbGEgcmVwcm9kdWNjacOzbiwgY29tdW5pY2FjacOzbiBww7pibGljYSwgZGlzdHJpYnVjacOzbiBhbCBww7pibGljbywgdHJhbnNmb3JtYWNpw7NuLCBkZSBjb25mb3JtaWRhZCBjb24gbGEgbm9ybWF0aXZpZGFkIHZpZ2VudGUgc29icmUgZGVyZWNob3MgZGUgYXV0b3IgeSBkZXJlY2hvcyBjb25leG9zIHJlZmVyaWRvcyBlbiBhcnQuIDIsIDEyLCAzMCAobW9kaWZpY2FkbyBwb3IgZWwgYXJ0IDUgZGUgbGEgbGV5IDE1MjAvMjAxMiksIHkgNzIgZGUgbGEgbGV5IDIzIGRlIGRlIDE5ODIsIExleSA0NCBkZSAxOTkzLCBhcnQuIDQgeSAxMSBEZWNpc2nDs24gQW5kaW5hIDM1MSBkZSAxOTkzIGFydC4gMTEsIERlY3JldG8gNDYwIGRlIDE5OTUsIENpcmN1bGFyIE5vIDA2LzIwMDIgZGUgbGEgRGlyZWNjacOzbiBOYWNpb25hbCBkZSBEZXJlY2hvcyBkZSBhdXRvciwgYXJ0LiAxNSBMZXkgMTUyMCBkZSAyMDEyLCBsYSBMZXkgMTkxNSBkZSAyMDE4IHkgZGVtw6FzIG5vcm1hcyBzb2JyZSBsYSBtYXRlcmlhLg0KDQpBbCByZXNwZWN0byBjb21vIEF1dG9yKGVzKSBtYW5pZmVzdGFtb3MgY29ub2NlciBxdWU6DQoNCi0gTGEgYXV0b3JpemFjacOzbiBlcyBkZSBjYXLDoWN0ZXIgbm8gZXhjbHVzaXZhIHkgbGltaXRhZGEsIGVzdG8gaW1wbGljYSBxdWUgbGEgbGljZW5jaWEgdGllbmUgdW5hIHZpZ2VuY2lhLCBxdWUgbm8gZXMgcGVycGV0dWEgeSBxdWUgZWwgYXV0b3IgcHVlZGUgcHVibGljYXIgbyBkaWZ1bmRpciBzdSBvYnJhIGVuIGN1YWxxdWllciBvdHJvIG1lZGlvLCBhc8OtIGNvbW8gbGxldmFyIGEgY2FibyBjdWFscXVpZXIgdGlwbyBkZSBhY2Npw7NuIHNvYnJlIGVsIGRvY3VtZW50by4NCg0KLSBMYSBhdXRvcml6YWNpw7NuIHRlbmRyw6EgdW5hIHZpZ2VuY2lhIGRlIGNpbmNvIGHDsW9zIGEgcGFydGlyIGRlbCBtb21lbnRvIGRlIGxhIGluY2x1c2nDs24gZGUgbGEgb2JyYSBlbiBlbCByZXBvc2l0b3JpbywgcHJvcnJvZ2FibGUgaW5kZWZpbmlkYW1lbnRlIHBvciBlbCB0aWVtcG8gZGUgZHVyYWNpw7NuIGRlIGxvcyBkZXJlY2hvcyBwYXRyaW1vbmlhbGVzIGRlbCBhdXRvciB5IHBvZHLDoSBkYXJzZSBwb3IgdGVybWluYWRhIHVuYSB2ZXogZWwgYXV0b3IgbG8gbWFuaWZpZXN0ZSBwb3IgZXNjcml0byBhIGxhIGluc3RpdHVjacOzbiwgY29uIGxhIHNhbHZlZGFkIGRlIHF1ZSBsYSBvYnJhIGVzIGRpZnVuZGlkYSBnbG9iYWxtZW50ZSB5IGNvc2VjaGFkYSBwb3IgZGlmZXJlbnRlcyBidXNjYWRvcmVzIHkvbyByZXBvc2l0b3Jpb3MgZW4gSW50ZXJuZXQgbG8gcXVlIG5vIGdhcmFudGl6YSBxdWUgbGEgb2JyYSBwdWVkYSBzZXIgcmV0aXJhZGEgZGUgbWFuZXJhIGlubWVkaWF0YSBkZSBvdHJvcyBzaXN0ZW1hcyBkZSBpbmZvcm1hY2nDs24gZW4gbG9zIHF1ZSBzZSBoYXlhIGluZGV4YWRvLCBkaWZlcmVudGVzIGFsIHJlcG9zaXRvcmlvIGluc3RpdHVjaW9uYWwgZGUgbGEgSW5zdGl0dWNpw7NuLCBkZSBtYW5lcmEgcXVlIGVsIGF1dG9yKHJlcykgdGVuZHLDoW4gcXVlIHNvbGljaXRhciBsYSByZXRpcmFkYSBkZSBzdSBvYnJhIGRpcmVjdGFtZW50ZSBhIG90cm9zIHNpc3RlbWFzIGRlIGluZm9ybWFjacOzbiBkaXN0aW50b3MgYWwgZGUgbGEgSW5zdGl0dWNpw7NuIHNpIGRlc2VhIHF1ZSBzdSBvYnJhIHNlYSByZXRpcmFkYSBkZSBpbm1lZGlhdG8uDQoNCi0gTGEgYXV0b3JpemFjacOzbiBkZSBwdWJsaWNhY2nDs24gY29tcHJlbmRlIGVsIGZvcm1hdG8gb3JpZ2luYWwgZGUgbGEgb2JyYSB5IHRvZG9zIGxvcyBkZW3DoXMgcXVlIHNlIHJlcXVpZXJhIHBhcmEgc3UgcHVibGljYWNpw7NuIGVuIGVsIHJlcG9zaXRvcmlvLiBJZ3VhbG1lbnRlLCBsYSBhdXRvcml6YWNpw7NuIHBlcm1pdGUgYSBsYSBpbnN0aXR1Y2nDs24gZWwgY2FtYmlvIGRlIHNvcG9ydGUgZGUgbGEgb2JyYSBjb24gZmluZXMgZGUgcHJlc2VydmFjacOzbiAoaW1wcmVzbywgZWxlY3Ryw7NuaWNvLCBkaWdpdGFsLCBJbnRlcm5ldCwgaW50cmFuZXQsIG8gY3VhbHF1aWVyIG90cm8gZm9ybWF0byBjb25vY2lkbyBvIHBvciBjb25vY2VyKS4NCg0KLSBMYSBhdXRvcml6YWNpw7NuIGVzIGdyYXR1aXRhIHkgc2UgcmVudW5jaWEgYSByZWNpYmlyIGN1YWxxdWllciByZW11bmVyYWNpw7NuIHBvciBsb3MgdXNvcyBkZSBsYSBvYnJhLCBkZSBhY3VlcmRvIGNvbiBsYSBsaWNlbmNpYSBlc3RhYmxlY2lkYSBlbiBlc3RhIGF1dG9yaXphY2nDs24uDQoNCi0gQWwgZmlybWFyIGVzdGEgYXV0b3JpemFjacOzbiwgc2UgbWFuaWZpZXN0YSBxdWUgbGEgb2JyYSBlcyBvcmlnaW5hbCB5IG5vIGV4aXN0ZSBlbiBlbGxhIG5pbmd1bmEgdmlvbGFjacOzbiBhIGxvcyBkZXJlY2hvcyBkZSBhdXRvciBkZSB0ZXJjZXJvcy4gRW4gY2FzbyBkZSBxdWUgZWwgdHJhYmFqbyBoYXlhIHNpZG8gZmluYW5jaWFkbyBwb3IgdGVyY2Vyb3MgZWwgbyBsb3MgYXV0b3JlcyBhc3VtZW4gbGEgcmVzcG9uc2FiaWxpZGFkIGRlbCBjdW1wbGltaWVudG8gZGUgbG9zIGFjdWVyZG9zIGVzdGFibGVjaWRvcyBzb2JyZSBsb3MgZGVyZWNob3MgcGF0cmltb25pYWxlcyBkZSBsYSBvYnJhIGNvbiBkaWNobyB0ZXJjZXJvLg0KDQotIEZyZW50ZSBhIGN1YWxxdWllciByZWNsYW1hY2nDs24gcG9yIHRlcmNlcm9zLCBlbCBvIGxvcyBhdXRvcmVzIHNlcsOhbiByZXNwb25zYWJsZXMsIGVuIG5pbmfDum4gY2FzbyBsYSByZXNwb25zYWJpbGlkYWQgc2Vyw6EgYXN1bWlkYSBwb3IgbGEgaW5zdGl0dWNpw7NuLg0KDQotIENvbiBsYSBhdXRvcml6YWNpw7NuLCBsYSBpbnN0aXR1Y2nDs24gcHVlZGUgZGlmdW5kaXIgbGEgb2JyYSBlbiDDrW5kaWNlcywgYnVzY2Fkb3JlcyB5IG90cm9zIHNpc3RlbWFzIGRlIGluZm9ybWFjacOzbiBxdWUgZmF2b3JlemNhbiBzdSB2aXNpYmlsaWRhZA==