The impact of the Covid-19 pandemic on the national saber 11 English test : results from a private school in Cali

The Covid-19 pandemic has impacted education, teachers and students in different ways. Previous studies focused on the impact of the pandemic on teaching and learning; however, few have focused on students’ performance in high-stakes tests. Notably, the effect of the pandemic on EFL students’ perfor...

Full description

Autores:
Viafara Idrobo, Edwin Nel
Tipo de recurso:
Trabajo de grado de pregrado
Fecha de publicación:
2023
Institución:
Universidad del Valle
Repositorio:
Repositorio Digital Univalle
Idioma:
eng
OAI Identifier:
oai:bibliotecadigital.univalle.edu.co:10893/30327
Acceso en línea:
https://hdl.handle.net/10893/30327
Palabra clave:
Covid-19
Pruebas Saber 11
Métodos mixtos
Inglés (Lengua)
Escuelas privadas
Validez predictiva
Rights
openAccess
License
https://creativecommons.org/licenses/by-nc-nd/4.0/
Description
Summary:The Covid-19 pandemic has impacted education, teachers and students in different ways. Previous studies focused on the impact of the pandemic on teaching and learning; however, few have focused on students’ performance in high-stakes tests. Notably, the effect of the pandemic on EFL students’ performance in the national Saber 11 English test in Colombia has not been fully explored. Investigating this matter is crucial to understanding the pandemic's effects on education and identifying possible solutions to improve student outcomes. Further research is necessary to determine the long-term consequences of the pandemic on education and devise effective strategies to mitigate its impact. This study investigated the impact of the Covid-19 pandemic on eleventh graders’ performance in the national Saber 11 English test and the school’s internal test results and their perceptions of performance during and after the pandemic in a private school in Cali. The study aimed to identify whether eleventh graders’ performance was affected or not by the pandemic in this important test. The study employed a mixed-methods approach. Quantitative data comprised the national Saber 11 English test scores from 2017 to 2022 to identify statistically significant differences in the performance of six cohorts before, during, and after the pandemic. Internal school test scores from 2020 to 2022 were used to compare students' performance during and after the pandemic and identify a relationship between the Saber 11 test and the school’s internal test results. The internal test is used to evaluate eleventh-grade students' English proficiency. Quantitative data were analyzed using a one-way independent measures ANOVA for the six cohorts (N = 166) and the three cohorts (N = 71) in the tests. Correlations were used to identify if the performance of three cohorts (2020-2022) on the national test was related to the internal test and if the latter had predictive validity (i.e. if the test predicts students' performance on a similar standardized test). Qualitative data consisted of a perception survey administered to a cohort of students who experienced learning during and after the pandemic. Qualitative data were analyzed using content analysis. All these data provide solid evidence of Covid-19's impact on students' English performance and perceptions. Results showed no statistically significant differences in the Saber 11 English test scores of eleventh graders before, during and after the pandemic, indicating no significant impact of Covid-19 on students’ performance on the test overall. In contrast, there were statistically significant differences in the students’ performance in the internal test. The 2022 cohort (after Covid) performed better than the 2020 and 2021 cohorts (during Covid). This result was attributed to the familiarity of 2 the 2022 students with the internal test. Correlations identified that the internal test does not have a strong predictive validity overall. Although the internal test is similar to the Saber 11 English test, it seems that students’ familiarity with the internal test makes them perform better than in the Saber 11 test, in which they do not have experience and whose conditions and stakes are different from the internal test. Although the internal test can help students familiarize with the national test, it does not predict students’ performance in this high-stakes test. The qualitative results revealed that the students perceived improvements in all language skills and preferences for face-to-face learning because social interaction and motivation are important factors in language learning. The students’ perceptions of improved performance are confirmed in the higher averages obtained in 2022, although this improvement was not statistically significant. The study highlights the need for institutions to better understand the influence of Covid-19 on students’ performance by analysing the students’ test results and taking action to deal with the phenomenon of virtuality in future emergencies. Some recommendations include improving infrastructure, access to digital resources, and reviewing curricula, contents and methodology to the needs and realities of students. From a methodological perspective, this research emphasizes the significance of exploring the impact of Covid-19 on eleventh-graders' performance through quantitative and qualitative approaches. This kind of research might enable language teachers and educational institutions to implement effective strategies for enhancing teaching and learning based on the students' experiences, perceptions, and performance.