Improving Learning Experience by Employing DASH-Based Mulsemedia Delivery

Abstract

This paper describes the experimental deployment of a DASH-based Multi-Sensory Media Delivery System (DASHMS) to support multi-sensorial media-enhanced learning. Multi-sensorial media (mulsemedia) combines multimedia components (video and audio) and emerging technologies targeting other human senses (e.g. touch & haptics, smell and taste). This paper studies learning experience with olfaction and haptic-based mulsemedia when employing DASHMS in a real-life subjective experiment with 40 participants. The tests performed evaluate the user-perceived quality of experience (QoE) and the effects of mulsemedia on user learning.

Improving Student Learning Satisfaction by Using an Innovative DASH-Based Multiple Sensorial Media Delivery Solution

“…For example, the Earth course pilot has investigated the use of VR and Virtual Labs when teaching STEM subjects in primary schools, the Fab Lab pilot has 3 NEWTELP platform webpage, http://newtelp.eu demonstrated that remote digital fabrication has improved students' learning experience and the Game-based learning pilots have had very positive results in terms of both learning satisfaction and outcome in third-level STEM education. Employing adaptive multimedia content and delivering multiple sensorial media content in educational contexts were reported in [29] and [30], respectively. Finally NEWTON technologies were used to deliver content to both normal development learners and users with special educational needs.…”

“…The DASHMS server stores multimedia and multi-sensorial media and metadata in order to support DASH-based adaptive content delivery. The DASH Media Presentation Description (MPD) format is employed for metadata to enable adaptive multimedia delivery and a novel multi-sensory MPD [30] for supporting adaptation of mulsemedia content distribution. Figure 1 illustrates the different multi-sensorial input streams whose segments are denoted x i n , where x indicates the sensorial stimulus type (e.g.…”

Mulsemedia in Telecommunication and Networking Education: A Novel Teaching Approach that Improves the Learning Process

“…one audiovideo scene, enhanced with wind effect, showed how wind turbines are used in the context of vehicular networks for powering road-side units). The content was delivered to 40 undergraduate engineering students from DCU and showed that the mulsemedia-based approach encouraged students' motivation and fun, producing stronger test scores and reducing students' boredom and reticence to learning [6].…”

“…A set of trailed scenarios, based on the NEWTELP platform, showed promising results for secondary schools and for tertiary education institutions -at both undergraduate and postgraduate levels. Different platform components (Adaptation, Gamification and Personalizationsee Figure 1) were tested in the context of undergraduate classes with over 100 students [6] [7].…”

Computer Programming: A Case Study of Teaching Loop Statement by Using an Interactive Educational Game

“…NEWTON project designs, develops, deploys and evaluates diverse innovative technology based educational solutions that make use of adaptive multimedia, multiple sensorial media delivery, Virtual and Augmented Reality (VR/AR) learning, Virtual Teaching and Learning Labs (Virtual Labs), Fabrication Labs (Fab Labs), personalization and gamification in the teaching and learning process [7][8][9][10][11][12]. These solutions are applied in conjunction with different pedagogical approaches including selfdirected, game-based, flipped classroom, and problem-based learning methods to different learner audiences, including students with special educational needs [13][14][15][16][17]. The NEWTON project has also created and deployed an innovative learning management platform, NEWTELP 2 , which embeds the NEWTON educational content and applications.…”