Deep learning in education 5.0: proposing 3d geometric shapes classification model to improve learning on a metaverse application

Abstract

The Brazilian educational system faces significant challenges, as evidenced by low educational development assessment scores. Due to the traditional educational model employed in the country, there are difficulties in the effective transmission of complex content, leading to high rates of academic failure and subsequent school dropout. The lack of innovation, especially in basic education settings, contributes to a scenario of low mathematical proficiency among Brazilian students. In this context, this work arises as a result of an innovation built to enhance the Geometa application, developed by the Inteceleri company, through the integration of Metaverse and Artificial Intelligence technologies to create an immersive and interactive educational environment. The intention is to train Artificial Intelligence for real-time three-dimensional geometric shape recognition from real-world object images. The proposal aims to mitigate challenges faced in Brazilian basic Mathematics education by adopting innovative technological approaches aligned with Education 5.0, which can be replicated for similar technologies involving the Metaverse. Furthermore, it is also intended to create a dynamic and sustainable educational environment that not only facilitates the mathematical concepts understanding but also promotes active student participation, encouraging their creativity and autonomy in the learning process. The method used relies on the ObjectNet dataset image reclassification from objects to three-dimensional geometric shapes. The reclassified images are used to train CNN, MobileNet, ResNet, ResNeXt, ViT and BEiT Deep Learning models, which are subsequently evalua ted through Machine Learning, inference time and dimension performance measures. Thus, the best-performance Artificial Intelligence model is selected for future integration into Geometa. As contributions of this work, the following were accomplished: (i) the defined models were trained for the three-dimensional geometric shapes recognition; (ii) the models were evaluated through Machine Learning, inference time and dimension performance measures; and (iii) the best-performance model was selected considering the highest assertiveness and smoothness based on models performances analysis. Concerning the obtained results, the ResNet surpassed BEiT, which was the second better performance model, in 5% Precision and 5 Inference Per Second. Finally, the ResNet model reached 84% Precision and 9 Inferences Per Second, being observed as the best-performance Artificial Intelligence for Geometa application integration flow.