<title>Logical unit and scene detection: a comparative survey</title>

Abstract

Logical units are semantic video segments above the shot level. Depending on the common semantics within the unit and data domain, different types of logical unit extraction algorithms have been presented in literature. Topic units are typically extracted for documentaries or news broadcasts while scenes are extracted for narrative-driven video such as feature films, sitcoms, or cartoons. Other types of logical units are extracted from home video and sports. Different algorithms in literature used for the extraction of logical units are reviewed in this paper based on the categories unit type, data domain, features used, segmentation method, and thresholds applied. A detailed comparative study is presented for the case of extracting scenes from narrative-driven video. While earlier comparative studies focused on scene segmentation methods only or on complete news-story segmentation algorithms, in this paper various visual features and segmentation methods with their thresholding mechanisms and their combination into complete scene detection algorithms are investigated. The performance of the resulting large set of algorithms is then evaluated on a set of video files including feature films, sitcoms, children's shows, a detective story, and cartoons.

Um método de segmentação de vídeo em cenas baseado em aprendizagem profunda

“…Além de propor duas novas métricas, a Cobertura e o Transbordamento, realizam uma análise da eficácia de algumas das abordagens mais utilizadas à época em diversas bases de dados. Petersohn (2008) detalha diversas particularidades pertinentes a segmentação em cenas, como a escolha das características, método de detecção das transições de cenas e escolha de parâmetros de algumas técnicas populares. Mais recentemente, Fabro e Böszörmenyi (2013) ampliaram a discussão de Vendrig e Worring (2002), classificando as técnicas de acordo com as modalidades que empregam, discutindo ainda diversos aspectos da tarefa tal como a dificuldade de comparação entre técnicas, métricas de comparação geralmente adotadas, entre outros.…”