Audiovisual Descriptors for a Linguistic Educational Engine

Abstract

The media consumption has become more individualized and customized due to the development of digital media and of more efficient portable devices. Among other fields, linguistic learning may benefit greatly from this trend if new types of content are created, specifically for the requirements of this new generation of learners, suitable for individual usage, portable, customized, flexible, interactive and entertaining. In this paper we present a solution that has its roots in the Edutainment (Education and entertainment) field and consists in automatically generating language comprehension quizzes based on foreign-language audiovisual content (TV series, documentaries, news). The proposed approach turns any foreign-language video into a true interactive teaching material, by combining different fields of expertise, such as video analysis and meta-data extraction, information search and automatic language processing.