Film Directing for Computer Games and Animation

Abstract

Over the last forty years, researchers in computer graphics have proposed a large variety of theoretical models and computer implementations of a virtual film director, capable of creating movies from minimal input such as a screenplay or storyboard. The underlying film directing techniques are also in high demand to assist and automate the generation of movies in computer games and animation. The goal of this survey is to characterize the spectrum of applications that require film directing, to present a historical and up-to-date summary of research in algorithmic film directing, and to identify promising avenues and hot topics for future research.

A Proposed Meta-Reality Immersive Development Pipeline: Generative AI Models and Extended Reality (XR) Content for the Metaverse

“…The need for 3D models and virtual sets will only rise as more and more film projects are relying on this technology. As more films are also shot in virtual reality (VR), the impact of these technologies has the potential to radically change how directing in the film industry operates [21] [22].…”

Text-to-movie authoring of anatomy lessons

“…Text-to-movie (or text-to-scene) authoring is a general class of methods that have been proposed for automatically generating 3D graphics and animation from text written by a domain expert. An overview of these methods are given in [15]. Good results have been obtained in limited domains, such as generating 3D scenes from natural language accident reports [16,17] or generating cartoon 1 https://www.youtube.com/channel/UCHKlhyLLAxFA69nO0NK9wPA 2 https://docs.unrealengine.com/4.26/en-US/ProgrammingAndScripting/Blueprints/ 3 https://unity.com/unity/features/editor/art-and-design/cinemachine 4 https://hutonggames.com/ 5 https://github.com/Unity-Technologies/EditorXR animation from scripted dialogue scenes [18].…”