Video annotation for immersive journalism using masking techniques

Abstract

This paper proposes an interactive annotation technique for 360 • videos that allows the use of traditional video editing techniques to add content to immersive videos. Using the case study of immersive journalism the main objective is to diminish the entry barrier for annotating 360 • video pieces, by providing a different annotation paradigm and a set of tools for annotation. The spread of virtual reality systems and immersive content has been growing substantially due to technological progress and cost reductions in equipment and software. From all the technologies employed in virtual reality systems, 360 • video is one that currently presents unique conditions to be widely used by various industries-especially for communication purposes. From the various areas that can benefit from the usage of virtual reality systems, the communication field is one that requires innovation in the way that narratives are built, especially in virtual reality systems. In the case of immersive journalism, 360 • video technology is currently one of the most used mediums by several media outlets. This kind of news content, whose innovative role should be highlighted, is still being studied in the field of journalism, needing a clearly defined set of rules and good practises. In order to improve the introduction of virtual elements in the 360 • videos this paper proposes a set of annotation paradigms for 1) Media information display and 2) Narrative and attention focusing. In this paper we present a list of possible techniques that solve the problem of immersive annotation, as well as a description of a prototype that was developed to test these concepts. The prototype implements an annotation technique based on masked videos and the extension of standard subtitle file formats. Finally a fast-track user study was developed to evaluate the acceptance of the visualisation techniques and to refine the set of tools.

Journalistic innovation: How new formats of digital journalism are perceived in the academic literature

“…Finally, we find a number of relevant studies about automated journalism, its characteristics and limitations (Kishore et al, 2018; Meira et al, 2016), the tools and technologies for its application (Jones and Jones, 2019) and the identification of fake news (Graves and Anderson, 2020; Kanozia, 2019; Lara-Navarra et al, 2020; Niblock, 2015); however, this body of research has a greater technological and conceptual weight than practical, which makes it difficult to resolve certain key questions in this area of journalism, including, for example, the new skills and the new productive routines required of the journalist and the impact of automated journalism on news media companies, etc.…”

“…Researchers in the field of communication, appreciative of the characteristics of this technological context, have undertaken a variety of studies in this regard, focusing, above all, on 360° videos, virtual reality and augmented reality. At the conceptual and theoretical level, the normative limits of the objectivity and precision of 360° journalism have been analysed (Aitamurto, 2019), interactive annotation techniques have been proposed for 360° videos that allow the use of traditional video editing techniques to add content to immersive videos (Meira et al, 2016), a model has been created to develop content analysis for 360° video news, (Benítez de García and Herrera-Damas, 2018a) and tools have been developed to improve the transmission of 360° videos (Sassatelli et al, 2020).…”