Simplifying video editing using metadata

Abstract

Digital video is becoming increasingly ubiquitous. However, editing video remains difficult for several reasons: it is a time-based medium, it has dual tracks of audio and video, and current tools force users to work at the smallest level of detail. Based on interviews with professional video editors, we developed a video editor, called Silver, that uses metadata to make digital video editing more accessible to novices. To help users visualize video, Silver provides multiple views with different semantic content and at different levels of abstraction, including storyboard, editable transcript, and timeline views. Silver offers smart editing operations that help users resolve the inconsistencies that arise because of the different boundaries in audio and video. We conducted a preliminary user study to investigate the effectiveness of the Silver smart editing. Participants successfully edited video after only a short tutorial, both with and without smart editing assistance. Our research suggests several ways in which video editing tools could use metadata to assist users in the reuse and composition of video.

A Contextual Study of Semantic Speech Editing in Radio Production

“…Previous semantic speech editing system have used manual transcription ( Berthouzoz et al, 2012;Rubin et al, 2013 ), ASR ( Sivaraman et al, 2016;Whittaker and Amento, 2004 ) and alignment of subtitles ( Casares et al, 2002;Hyperaudio Inc., 2016 ). Manual transcriptions are nearly 100% accurate, however they are expensive (about $1 per minute) and slow (typically 24 hours).…”

“…SILVER ( Casares et al, 2002;Long et al, 2003 ) is a video editor that included various 'smart editing ' features including an editable transcript window. It used ASR to align the words from subtitles to video.…”

“…ASR transcripts were used by Whittaker and Amento (2004) , Sivaraman et al (2016) , Shin et al (2016) and Yoon et al (2014) , but Berthouzoz et al (2012) and Rubin et al (2013) chose to use perfect transcripts from a crowd-sourcing service. Hyperaudio Inc. (2016) used aligned subtitles and Casares et al (2002) used a combination of subtitles and ASR.…”

“…Sivaraman et al (2016) found that for editing discussions, semantic editing is a more accessible alternative to waveform editing. Systems have been developed for audio and video production ( Berthouzoz et al, 2012;Casares et al, 2002;Rubin et al, 2013;Shin et al, 2016 ), but these were mostly designed without prior user requirements, and the studies were informal and used amateur participants. In this paper, we describe the design of our system, which is based on the results of a published pilot study ( Baume et al, 2015 ), and present our formal study, which uses real content and professional users in an uncontrolled working environment.…”

Online Content Editing System to Edit Broadcasting and Personal Contents

“…선형 [5] . 그럼에도 불구하고, 현재까지도 일반 사용자들이 편집 대상 콘텐츠를 검색하는 기술, 콘텐츠의 편집영역을 설정하는 기술 및 타임라인에 배치된 콘텐츠들에 효과를 설정하는 기술은 많은 시간과 노력이 드는 일로서, 이러한 문제점들을 해결하기위한 연구가 활발히 진행되고 있다.…”