Navegação, reconhecimento de gestos e controle de interface no sistema ITV utilizando o dispositivo kinect

Abstract

This work presents the implementation of navigation in the virtual environment, gesture recognition and interface control, able through the Kinect device, in the ITV System: a system for training operators and maintainers of hydroelectrics and electrical substations. In addition, it shows some recent improvements, such as conversion of a ITV on a video file, audio and visual alarms, ambience sound in three dimensions and narration of the process. Besides presenting the ITV System, are exposed to the Kinect device and the algorithm used to compare patterns of movement, the DTW. Then, this work explains in detail the design and the implementation of the navigation, the interface control and the gesture recognition. As a case study, it displays a Virtual Technical Instruction (ITV), designed especially to test and evaluate the new proposed interface. Subsequently, this work presents satisfactory results, obtained through the analysis of qualitative questionnaires applied to the students of the Federal University of Pará. Finally, considerations for this study and ideas for future work are made.