Students’ actual learning engagement in class, which we call learning attention, is a major indicator used to measure learning outcomes. Obtaining and analyzing students’ attention accurately in offline classes is important empirical research that can improve teachers’ teaching methods. This paper proposes a method to obtain and measure students’ attention in class by applying a variety of deep-learning models and initiatively divides a whole class into a series of time durations, which are categorized into four states: lecturing, interaction, practice, and transcription. After video and audio information is taken with Internet of Things (IoT) technology in class, Retinaface and the Vision Transformer (ViT) model is used to detect faces and extract students’ head-pose parameters. Automatic speech recognition (ASR) models are used to divide a class into a series of four states. Combining the class-state sequence and each student’s head-pose parameters, the learning attention of each student can be accurately calculated. Finally, individual and statistical learning attention analyses are conducted that can help teachers to improve their teaching methods. This method shows potential application value and can be deployed in schools and applied in different smart education programs.
Abstracts. In this paper, ViT deep neural network based on self-attention mechanism is used in classification for images of soybean and weeds. Firstly, the overall image is split into multiple tiles; with each tile regarded as a word, the whole image is regarded as a sentence, which can be used for image semantic recognition by natural language processing technology. We designed a ViT network with sequence length of 50, embedded dimension of 384, and self-attention module layers of 12. With soybean weed classification dataset, the network is trained, verified and tested. Experimental results showed that ViT network is superior in classification on dataset of soybean and weeds, with excellent generalization capability.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.