AI Video Editing: a Survey

Abstract

Video editing is a high-required job, for it requires skilled artists or workers equipped with plentiful physical strength and multidisciplinary knowledge, such as cinematography, aesthetics. Thus gradually, more and more researches focus on proposing semi-automatical and even fully automatical solutions to reduce workloads. Since those conventional methods are usually designed to follow some simple guidelines, they lack flexibility and capability to learn complex ones. Fortunately, the advances of computer vision and machine learning make up the shortages of traditional approaches and make AI editing feasible. There is no survey to conclude those emerging researches yet. This paper summaries the development history of automatic video editing, and especially the applications of AI in partial and full workflows. We emphasizes video editing and discuss related works from multiple aspects: modality, type of input videos, methology, optimization, dataset, and evaluation metric. Besides, we also summarize the progresses in image editing domain, i.e., style transferring, retargeting, and colorization, and seek for the possibility to transfer those techniques to video domain. Finally, we give a brief conclusion about this survey and explore some open problems.

The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editing

“…Here we focus on previous works that studied cinematography patterns in film editing. For an in-depth discussion on video editing, in general, we invite the reader to [49]. Given a script and different takes of a scene, Leake et al [20] attempted to generate a scene by selecting a relevant clip for each line of dialogue in a given script.…”

ChatEdit: Towards Multi-turn Interactive Facial Image Editing via Dialogue

“…With the rise of deep generative models such as GANs (Goodfellow et al, 2020;Karras et al, 2019;Li et al, 2023a) and DDPMs (Ho et al, 2020;Sohl-Dickstein et al, 2015;Zhang et al, 2023), significant progress has been achieved in instructionbased facial image editing Patashnik et al, 2021;Li et al, 2023b). However, an emerging scenario is multi-turn interactive editing, allowing users to iteratively refine their editing instructions through system interaction (Sharma et al, 2018;Cheng et al, 2020;Kim et al, 2019;Jiang et al, 2021).…”

Pengembangan Alat Bantu Pengeditan Video Dan Multimedia Berbasis Arduino Usb Midi

“…Sehingga lambat laun semakin banyak penelitian yang berfokus pada pengusulan semi otomatis bahkan penuh solusi otomatis untuk mengurangi beban kerja. 3 Dalam mempercepat kinerja pengeditan video dan multimedia maka dibutuhkan metode pintasan yaitu menggunakan keyboard shortcut. keyboard shortcut jelas sangat membantu dalam proses pengeditan tetapi terlepas dari kenyataan bahwa biasanya dibutuhkan setengah waktu untuk mengeluarkan perintah ke aplikasi komputer menggunakan keyboard shortcut itu, kebanyakan orang mengeluarkan perintah tertentu dengan mengklik ikon pada toolbar atau dengan memilih perintah dari menu pull-down .…”