VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays

Software testing can exceed 50% of the total cost of a software project, which is why companies need an alternative to reduce their cost and time of implementation. This research proposes the use of combinatorial structures known as Covering Arrays (CA) and Mixed Covering Arrays (MCA), which guarant...

Full description

Autores:
Meneses Ruiz, Jaime Herney
Peña Velasco, Eduar Alexis
Cobos Lozada, Carlos Alberto
Timaná Peña, Jimena Adriana
Torres-Jimenez, Jose
Tipo de recurso:
Article of journal
Fecha de publicación:
2018
Institución:
Universidad de Medellín
Repositorio:
Repositorio UDEM
Idioma:
spa
OAI Identifier:
oai:repository.udem.edu.co:11407/5507
Acceso en línea:
http://hdl.handle.net/11407/5507
https://doi.org/10.22395/rium.v17n33a6
Palabra clave:
Test cases
Combinatorial tests
Covering arrays
Mixed covering arrays
Simulated annealing
.Net complement
Casos de teste
Provas combinatórias
Covering arrays
Mixed covering arrays
Recozimento simulado
Complemento de .Net.
Casos de prueba
Pruebas combinatorias
Arreglos de cubrimiento
Arreglos de cubrimiento mixtos
recocido simulado
Complemento de .Net
Rights
License
http://creativecommons.org/licenses/by-nc-sa/4.0/
id REPOUDEM2_2b047a980225b4d449be988756ccdcab
oai_identifier_str oai:repository.udem.edu.co:11407/5507
network_acronym_str REPOUDEM2
network_name_str Repositorio UDEM
repository_id_str
dc.title.eng.fl_str_mv VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
dc.title.por.fl_str_mv Complemento de VS.Net para a definição ideal de testes de software de caixa-preta por meio de covering arrays
dc.title.spa.fl_str_mv Complemento de VS.NET para la definición óptima de pruebas de software de caja negra mediante arreglos de cobertura
title VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
spellingShingle VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
Test cases
Combinatorial tests
Covering arrays
Mixed covering arrays
Simulated annealing
.Net complement
Casos de teste
Provas combinatórias
Covering arrays
Mixed covering arrays
Recozimento simulado
Complemento de .Net.
Casos de prueba
Pruebas combinatorias
Arreglos de cubrimiento
Arreglos de cubrimiento mixtos
recocido simulado
Complemento de .Net
title_short VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
title_full VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
title_fullStr VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
title_full_unstemmed VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
title_sort VS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering Arrays
dc.creator.fl_str_mv Meneses Ruiz, Jaime Herney
Peña Velasco, Eduar Alexis
Cobos Lozada, Carlos Alberto
Timaná Peña, Jimena Adriana
Torres-Jimenez, Jose
dc.contributor.author.none.fl_str_mv Meneses Ruiz, Jaime Herney
Peña Velasco, Eduar Alexis
Cobos Lozada, Carlos Alberto
Timaná Peña, Jimena Adriana
Torres-Jimenez, Jose
dc.subject.eng.fl_str_mv Test cases
Combinatorial tests
Covering arrays
Mixed covering arrays
Simulated annealing
.Net complement
topic Test cases
Combinatorial tests
Covering arrays
Mixed covering arrays
Simulated annealing
.Net complement
Casos de teste
Provas combinatórias
Covering arrays
Mixed covering arrays
Recozimento simulado
Complemento de .Net.
Casos de prueba
Pruebas combinatorias
Arreglos de cubrimiento
Arreglos de cubrimiento mixtos
recocido simulado
Complemento de .Net
dc.subject.por.fl_str_mv Casos de teste
Provas combinatórias
Covering arrays
Mixed covering arrays
Recozimento simulado
Complemento de .Net.
dc.subject.spa.fl_str_mv Casos de prueba
Pruebas combinatorias
Arreglos de cubrimiento
Arreglos de cubrimiento mixtos
recocido simulado
Complemento de .Net
description Software testing can exceed 50% of the total cost of a software project, which is why companies need an alternative to reduce their cost and time of implementation. This research proposes the use of combinatorial structures known as Covering Arrays (CA) and Mixed Covering Arrays (MCA), which guarantee the detection up to 100% of errors with a minimum amount of testing. With this approach, a Visual Studio.NET add-on was developed for the optimization of the tests and its use was evaluated with students of last academic term of Computer Science Engineering and of a software company. The results obtained are promising and motivate the research group to disseminate its work at the national level. The research project was funded by the Vice-Principal Office of Research of the Universidad del Cauca.
publishDate 2018
dc.date.created.none.fl_str_mv 2018-03-16
dc.date.accessioned.none.fl_str_mv 2019-11-07T15:03:02Z
dc.date.available.none.fl_str_mv 2019-11-07T15:03:02Z
dc.type.eng.fl_str_mv Article
dc.type.coar.fl_str_mv http://purl.org/coar/resource_type/c_2df8fbb1
dc.type.coarversion.fl_str_mv http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.coar.none.fl_str_mv http://purl.org/coar/resource_type/c_6501
dc.type.local.spa.fl_str_mv Artículo científico
dc.type.driver.none.fl_str_mv info:eu-repo/semantics/article
format http://purl.org/coar/resource_type/c_6501
dc.identifier.issn.none.fl_str_mv 1692-3324
dc.identifier.uri.none.fl_str_mv http://hdl.handle.net/11407/5507
dc.identifier.doi.none.fl_str_mv https://doi.org/10.22395/rium.v17n33a6
dc.identifier.eissn.none.fl_str_mv 2248-4094
dc.identifier.reponame.spa.fl_str_mv reponame:Repositorio Institucional Universidad de Medellín
dc.identifier.repourl.none.fl_str_mv repourl:https://repository.udem.edu.co/
dc.identifier.instname.spa.fl_str_mv instname:Universidad de Medellín
identifier_str_mv 1692-3324
2248-4094
reponame:Repositorio Institucional Universidad de Medellín
repourl:https://repository.udem.edu.co/
instname:Universidad de Medellín
url http://hdl.handle.net/11407/5507
https://doi.org/10.22395/rium.v17n33a6
dc.language.iso.none.fl_str_mv spa
language spa
dc.relation.uri.none.fl_str_mv https://revistas.udem.edu.co/index.php/ingenierias/article/view/1646
dc.relation.citationvolume.none.fl_str_mv 17
dc.relation.citationissue.none.fl_str_mv 33
dc.relation.citationstartpage.none.fl_str_mv 121
dc.relation.citationendpage.none.fl_str_mv 137
dc.relation.references.spa.fl_str_mv [1] I. Burnstein, Practical software testing: a process-oriented approach, Luxemburgo: Springer Science & Business Media, 2006.
[2] J. Tuya, et al., Técnicas cuantitativas para la gestión en la ingeniería del software, As Somozas: Netbiblo, 2007.
[3] A. Mili y F. Tchier, Software Testing: Concepts and Operations, Nueva Jersey:Wiley Publishing, 2015.
[4] S. Nidhra y J. Dondeti, “Black Box and White Box Testing Techniques ‒A Literature Review,” International Journal of Embedded Systems and Applications (IJESA), vol. 2, pp. 29-50, 2012.
[5] S. Anand, et al., “An orchestrated survey of methodologies for automated software test case generation,” Journal of Systems and Software, vol. 86, pp. 1978-2001, 2013.
6] C. P. Jayaswal y T. U. o. T. a. Arlington, Automated Software Testing Using Covering Arrays, Texas: University of Texas at Arlington, 2006.
[7] B. S. Ahmed, et al., “The development of a particle swarm based optimization strategy for pairwise testing,” Journal of Artificial Intelligence, vol. 4, pp. 156-165, 2011.
[8] A. Arcuri y X. Yao, “Search based software testing of object-oriented containers,” Information Sciences, vol. 178, pp. 3075-3095, 2008.
[9] G. J. B. T. S. C. Myers, The art of software testing, third edition. Hoboken, Nueva Jersey: John Wiley & Sons, 2012.
[10] N. Changhai y H. Leung, “A Survey of Combinatorial Testing,” ACM Computing Surveys, vol. 43, pp. 11-29, 2011.
[11] S. A. Bestoun yK. Z. Zamli, “A review of covering arrays and their application to software testing,” Journal of Computer Science, vol. 7, pp. 1375-1385, 2011.
[12] H. Avila-George, et al., Verificación de Covering Arrays: aplicando la supercomputación y la computación grid. Nueva York: Lambert Academic Publishing, 2010.
[13] H. Avila-George y J. Torres-Jiménez, Construction of Test-Suites: Omniscriptum Gmbh & Company Kg., 2015.
[14] F. J. Pino, et al., “Using Scrum to guide the execution of software process improvement in small organizations,” Journal of Systems and Software, vol. 83, pp. 1662-1677, 2010.
[15] D. R. Kuhn, et al., “Software fault interactions and implications for software testing,” Software Engineering, IEEE Transactions on, vol. 30, pp. 418-421, 2004.
[16] M. Brčić y D. Kalpić, “Combinatorial testing in software projects,” presentado en Proceedings of the 35th International Convention MIPRO, 2012, pp. 1508-1513.
[17] I. I. Márquez, Construcción de Torres de Covering Arrays. [En línea], Disponible: http://www.tamps.cinvestav.mx/defensa_2013_7, 2013.
[18] M. B. Cohen, et al., “Constructing test suites for interaction testing,” presentado en the Proceedings of the 25th International Conference on Software Engineering, Portland, Oregon, 2003.
[19] M. B. Cohen, et al., “Constructing strength three covering arrays with augmented annealing,” Discrete Mathematics, vol. 308, pp. 2709-2722, 2008.
[20] A. Rodríguez-Cristerna and J. Torres-Jiménez, “A Simulated Annealing with Variable Neighborhood Search Approach to Construct Mixed Covering Arrays,” Electronic Notes in Discrete Mathematics, vol. 39, pp. 249-256, 2012.
dc.relation.ispartofjournal.spa.fl_str_mv Revista Ingenierías Universidad de Medellín
dc.rights.coar.fl_str_mv http://purl.org/coar/access_right/c_abf2
dc.rights.uri.*.fl_str_mv http://creativecommons.org/licenses/by-nc-sa/4.0/
dc.rights.creativecommons.*.fl_str_mv Attribution-NonCommercial-ShareAlike 4.0 International
rights_invalid_str_mv http://creativecommons.org/licenses/by-nc-sa/4.0/
Attribution-NonCommercial-ShareAlike 4.0 International
http://purl.org/coar/access_right/c_abf2
dc.format.extent.spa.fl_str_mv p. 121-137
dc.format.medium.spa.fl_str_mv Electrónico
dc.format.mimetype.none.fl_str_mv application/pdf
dc.coverage.none.fl_str_mv Lat: 06 15 00 N  degrees minutes  Lat: 6.2500  decimal degreesLong: 075 36 00 W  degrees minutes  Long: -75.6000  decimal degrees
dc.publisher.spa.fl_str_mv Universidad de Medellín
dc.publisher.faculty.spa.fl_str_mv Facultad de Ingenierías
dc.publisher.place.spa.fl_str_mv Medellín
dc.source.spa.fl_str_mv Revista Ingenierías Universidad de Medellín; Vol. 17 Núm. 33 (2018): Julio-Diciembre; 121-137
institution Universidad de Medellín
repository.name.fl_str_mv Repositorio Institucional Universidad de Medellin
repository.mail.fl_str_mv repositorio@udem.edu.co
_version_ 1814159198964940800
spelling Meneses Ruiz, Jaime HerneyPeña Velasco, Eduar AlexisCobos Lozada, Carlos AlbertoTimaná Peña, Jimena AdrianaTorres-Jimenez, JoseMeneses Ruiz, Jaime Herney; ASMET Salud EPSPeña Velasco, Eduar Alexis; ASMET Salud EPSCobos Lozada, Carlos Alberto; Universidad del CaucaTimaná Peña, Jimena Adriana; Universidad del CaucaTorres-Jimenez, Jose; Instituto Politécnico Nacional de México CINVESTAV2019-11-07T15:03:02Z2019-11-07T15:03:02Z2018-03-161692-3324http://hdl.handle.net/11407/5507https://doi.org/10.22395/rium.v17n33a62248-4094reponame:Repositorio Institucional Universidad de Medellínrepourl:https://repository.udem.edu.co/instname:Universidad de MedellínSoftware testing can exceed 50% of the total cost of a software project, which is why companies need an alternative to reduce their cost and time of implementation. This research proposes the use of combinatorial structures known as Covering Arrays (CA) and Mixed Covering Arrays (MCA), which guarantee the detection up to 100% of errors with a minimum amount of testing. With this approach, a Visual Studio.NET add-on was developed for the optimization of the tests and its use was evaluated with students of last academic term of Computer Science Engineering and of a software company. The results obtained are promising and motivate the research group to disseminate its work at the national level. The research project was funded by the Vice-Principal Office of Research of the Universidad del Cauca.Os testes de software podem superar 50% do custo total de um projeto de software, motivo pelo qual as empresas precisam de uma alternativa que permita reduzir seu custo e o tempo de sua realização. Esta pesquisa propõe o uso de algumas estruturas combinatórias conhecidas como covering arrays (CA) e mixed covering arrays (MCA), que garantem a detecção de até 100% dos erros com uma quantidade mínima de testes. Com esse enfoque, desenvolveu-se um complemento de Visual Studio.NET para a otimização dos testes e avaliou-se seu uso com estudantes do último semestre de Engenharia de Sistemas e de uma empresa de software. Os resultados obtidos são prometedores e motivam o grupo de pesquisa a divulgar seu trabalho nacionalmente. O projeto de pesquisa foi financiado pela Vice-reitoria de Pesquisas da Universidad del Cauca.Las pruebas de software pueden llegar a superar el 50 % del costo total de un proyecto de software, motivo por el cual las empresas necesitan una alternativa que permita reducir su costo y el tiempo de su realización. Esta investigación propone el uso de unas estructuras combinatoriales conocidas como arreglos de cubrimiento (CA) y arreglos de cubrimiento mixtos (MCA), que garantizan la detección hasta del 100 % de los errores con una mínima cantidad de pruebas. Con este enfoque, se desarrolló un complemento de Visual Studio.NET para la optimización de las pruebas y se evaluó su uso con estudiantes de último semestre de Ingeniería de Sistemas y de una empresa de software. Los resultados obtenidos son prometedores y motivan al grupo de investigación a divulgar su trabajo en el nivel nacional. El proyecto de investigación fue financiado por la Vicerrectoría de Investigaciones de la Universidad del Cauca.p. 121-137Electrónicoapplication/pdfspaUniversidad de MedellínFacultad de IngenieríasMedellínhttps://revistas.udem.edu.co/index.php/ingenierias/article/view/16461733121137[1] I. Burnstein, Practical software testing: a process-oriented approach, Luxemburgo: Springer Science & Business Media, 2006.[2] J. Tuya, et al., Técnicas cuantitativas para la gestión en la ingeniería del software, As Somozas: Netbiblo, 2007.[3] A. Mili y F. Tchier, Software Testing: Concepts and Operations, Nueva Jersey:Wiley Publishing, 2015.[4] S. Nidhra y J. Dondeti, “Black Box and White Box Testing Techniques ‒A Literature Review,” International Journal of Embedded Systems and Applications (IJESA), vol. 2, pp. 29-50, 2012.[5] S. Anand, et al., “An orchestrated survey of methodologies for automated software test case generation,” Journal of Systems and Software, vol. 86, pp. 1978-2001, 2013.6] C. P. Jayaswal y T. U. o. T. a. Arlington, Automated Software Testing Using Covering Arrays, Texas: University of Texas at Arlington, 2006.[7] B. S. Ahmed, et al., “The development of a particle swarm based optimization strategy for pairwise testing,” Journal of Artificial Intelligence, vol. 4, pp. 156-165, 2011.[8] A. Arcuri y X. Yao, “Search based software testing of object-oriented containers,” Information Sciences, vol. 178, pp. 3075-3095, 2008.[9] G. J. B. T. S. C. Myers, The art of software testing, third edition. Hoboken, Nueva Jersey: John Wiley & Sons, 2012.[10] N. Changhai y H. Leung, “A Survey of Combinatorial Testing,” ACM Computing Surveys, vol. 43, pp. 11-29, 2011.[11] S. A. Bestoun yK. Z. Zamli, “A review of covering arrays and their application to software testing,” Journal of Computer Science, vol. 7, pp. 1375-1385, 2011.[12] H. Avila-George, et al., Verificación de Covering Arrays: aplicando la supercomputación y la computación grid. Nueva York: Lambert Academic Publishing, 2010.[13] H. Avila-George y J. Torres-Jiménez, Construction of Test-Suites: Omniscriptum Gmbh & Company Kg., 2015.[14] F. J. Pino, et al., “Using Scrum to guide the execution of software process improvement in small organizations,” Journal of Systems and Software, vol. 83, pp. 1662-1677, 2010.[15] D. R. Kuhn, et al., “Software fault interactions and implications for software testing,” Software Engineering, IEEE Transactions on, vol. 30, pp. 418-421, 2004.[16] M. Brčić y D. Kalpić, “Combinatorial testing in software projects,” presentado en Proceedings of the 35th International Convention MIPRO, 2012, pp. 1508-1513.[17] I. I. Márquez, Construcción de Torres de Covering Arrays. [En línea], Disponible: http://www.tamps.cinvestav.mx/defensa_2013_7, 2013.[18] M. B. Cohen, et al., “Constructing test suites for interaction testing,” presentado en the Proceedings of the 25th International Conference on Software Engineering, Portland, Oregon, 2003.[19] M. B. Cohen, et al., “Constructing strength three covering arrays with augmented annealing,” Discrete Mathematics, vol. 308, pp. 2709-2722, 2008.[20] A. Rodríguez-Cristerna and J. Torres-Jiménez, “A Simulated Annealing with Variable Neighborhood Search Approach to Construct Mixed Covering Arrays,” Electronic Notes in Discrete Mathematics, vol. 39, pp. 249-256, 2012.Revista Ingenierías Universidad de Medellínhttp://creativecommons.org/licenses/by-nc-sa/4.0/Attribution-NonCommercial-ShareAlike 4.0 Internationalhttp://purl.org/coar/access_right/c_abf2Revista Ingenierías Universidad de Medellín; Vol. 17 Núm. 33 (2018): Julio-Diciembre; 121-137Test casesCombinatorial testsCovering arraysMixed covering arraysSimulated annealing.Net complementCasos de testeProvas combinatóriasCovering arraysMixed covering arraysRecozimento simuladoComplemento de .Net.Casos de pruebaPruebas combinatoriasArreglos de cubrimientoArreglos de cubrimiento mixtosrecocido simuladoComplemento de .NetVS.Net Add-on for Optimal Definition of Black Box Software Testing Using Covering ArraysComplemento de VS.Net para a definição ideal de testes de software de caixa-preta por meio de covering arraysComplemento de VS.NET para la definición óptima de pruebas de software de caja negra mediante arreglos de coberturaArticlehttp://purl.org/coar/resource_type/c_6501http://purl.org/coar/resource_type/c_2df8fbb1Artículo científicoinfo:eu-repo/semantics/articlehttp://purl.org/coar/version/c_970fb48d4fbd8a85Comunidad Universidad de MedellínLat: 06 15 00 N  degrees minutes  Lat: 6.2500  decimal degreesLong: 075 36 00 W  degrees minutes  Long: -75.6000  decimal degrees11407/5507oai:repository.udem.edu.co:11407/55072021-05-14 14:29:47.757Repositorio Institucional Universidad de Medellinrepositorio@udem.edu.co

Publicaciones similares