EyeNav: a novel accessibility-driven system for interaction and automated test generation using eyetracking and natural language processing

EyeNav is a novel system that combines eye tracking and natural language processing (NLP) to enhance accessibility and enable automated test generation. This research demonstrates the integration of these technologies for intuitive web interaction, enabling pointer control via gaze and natural langu...

Full description

Autores:
Yepes Parra, Juan Diego
Tipo de recurso:
Trabajo de grado de pregrado
Fecha de publicación:
2025
Institución:
Universidad de los Andes
Repositorio:
Séneca: repositorio Uniandes
Idioma:
eng
OAI Identifier:
oai:repositorio.uniandes.edu.co:1992/75385
Acceso en línea:
https://hdl.handle.net/1992/75385
Palabra clave:
Eye-tracking
Automated test generation
Assistive technology
Natural language processing
Web applications
Accessibility
Ingeniería
Rights
openAccess
License
Attribution 4.0 International
Description
Summary:EyeNav is a novel system that combines eye tracking and natural language processing (NLP) to enhance accessibility and enable automated test generation. This research demonstrates the integration of these technologies for intuitive web interaction, enabling pointer control via gaze and natural language processing for interpreting user intentions. Additionally, it presents a record-and-replay module for generating automated test scripts. Preliminary user evaluations yielded positive results in terms of usability. The ultimate goal is to demonstrate that eye tracking combined with NLP can be effectively used not only as a possible assistive technology but also as an innovative approach to software testing.