Algoritmos para seleção de metodologias de avaliação de softwares educacionais

Abstract

In order to assist the teaching-learning processes, many teachers have decided to use Educational Software (ES) in their classrooms. However, to choose a ES as a teaching resource it is essential to endorse the methodology used by the teacher, once it needs to be pedagogically and functionally appropriate to meet the needs and objectives present in the classroom. Also, it is necessary to use mechanisms that the ES endorses to verify its adequacy to the professor’s objectives. Currently, it is verified that there are various techniques and methodologies available in the literature for ES assessment, but there is still no solution for decision making and selection of a ES that fully addresses the profiles of users and their different needs to be met by certain methodological application, or that arises from demand originating from the development of solutions based on demand and with a low capacity for generalization in terms of practical application. In this way, solutions are available without standardization and that several times do not take into consideration criteria relating to quality, measurement scales and verification procedures of the ES. This heterogeneity makes the evaluation of an ES very difficult, since the subjectivity in the selection of ES evaluation methodology can produce inconclusive results. Given this context, this work created a quality model that considers 24 ES assessment methodologies available in the literature and aims to automate the selection of ES assessment methodology based on the application of artificial intelligence (AI) algorithms, reducing the possibility of subjectivity in the screening process. During the investigation we used Natural Language Processing (NLP), Random Forest, k-Nearest Neighbors and Artificiais Neurais Networks. In all research scenarios, the natural language algorithm was combined with other algorithms, offering a solution based on the application of hybrid and loosely coupled AI algorithms, with excellent results. In this way, simulations were carried out considering NLP+Random Forest, NLP+k-Nearest Neighbors and NLP+Artificial Neurais Networks. After the simulations, the results indicate that it is possible to determine the best ES assessment methodology using AI algorithms, with the best results obtained with the combination of NLP+Random Forest.