The Impact of Multimedia Effect on Art Learning: Eye Movement Evidence from Traditional Chinese Pattern Learning

Abstract

At the beginning of 2020, the COVID-19 epidemic continued to spread and became a global pandemic. Affected by the epidemic, online teaching has become the new normal. As the main form of online education, multimedia learning has attracted more and more attention. The study of traditional patterns has always been a particularly important element of art study in China due to cultural heritage and precious resources. Chinese traditional patterns are an important object of learning because of the heritage. This study examines students' understanding of the composition and evolution of traditional Chinese patterns in bronze mirrors by using different multimedia learning materials. A two by two factorial design is employed. The dependent variables includes (1) subjects' post-test scores and (2) the data of subjects' eye-movement behaviour. Data shows that students who use the animation with narration allocate a greater amount of visual attention than students who use animation with on-screen text. The students who use simulation with on-screen text demonstrated a greater amount of visual attention than students who use received simulation with narration. Furthermore, this empirical study confirmed a direct, positive correlation between the length of the subjects' eye fixation behaviour and the depth of learning. This result also provides evidence to prove that the use of multimedia learning materials is helpful in art education, especially in the study of the various elements of traditional Chinese art.

The role of digital interactive technology in cultural heritage learning: Evaluating a mid‐air gesture‐based interactive media of Ruihetu

“…The results of the study confirmed the positive effect of mid‐air gesture‐based interactive media on the participants' cultural learning outcomes. It is consistent with the previous study, which discovered that interactive media for cultural heritage tended to promote multimedia leaning effect more than traditional media (video or animation) 24 or modality (the monitor‐keyboard‐mouse condition) 25 . In contrast to the majority of applications that use mid‐air gesture‐based interactions for navigating spaces, examining content and information browsing, this study provides a case study of how mid‐air gesture‐based interactive technologies can be used to facilitate learning about the Chinese traditional painting cultural heritage.…”

The Impact of Puzzle-Based Game With Scaffolding-Aid on Cultural Heritage Learning: Evidence From Eye Movements

“…A digital jigsaw puzzle game, titled “the Lost Han-dynasty bronze mirrors”, was employed in this study (Ye et al, 2021). The game serves for instructing players on the recognition of art patterns through a specifically designed puzzle fitting task.…”

“…Therefore, this research selects the jigsaw puzzle, a typical representative of puzzle-based games, as the focal point for investigating the design of educational games centered around cultural heritage. This study uses a digital jigsaw puzzle made by Ye et al (2021) with scaffolding. In this game case, players engage in the process of learning art patterns featured on bronze mirrors from the Han Dynasty through fitting a digital jigsaw puzzle.…”

Cognitive differences between readers attentive and inattentive to task-related information: an eye-tracking study

“…Jian and Wu (2016) used the fixation duration proportion on a text or diagram to investigate their cognitive resource allocation strategy when reading papers consisting of explanatory pictures. Ye et al (2021) explored further the impact of multimedia effect especially on sensory modality modes and interaction modes on cognitive resource allocation. According to the allocation of cognitive resource on text, Yu et al (2017) provided skimming strategy which means readers will skip some seemingly unrelated information.…”

“…Jian and Wu (2016) used the fixation duration proportion on a text or diagram to investigate their cognitive resource allocation strategy when reading papers consisting of explanatory pictures. Ye et al. (2021) explored further the impact of multimedia effect especially on sensory modality modes and interaction modes on cognitive resource allocation.…”