CAMEO - camera, audio and motion with emotion orchestration for immersive cinematography

Shim, Hyunju; Kang, Bo Gyeong

doi:10.1145/1501750.1501776

Cited by 11 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Visual and auditory elements involved in composing a virtual story scene, the construction of the 3D environment or set, scene composition, automated cinematography and the effect of genre styles are addressed in complete text-to-visual systems such as WordsEye [17], ScriptViz [19], CONFUCIUS [1] and NewsViz [20], and the scene directing system, CAMEO [22]. WordsEye depicts non-animated 3D scenes with characters, objects, actions and environments.…”

Section: Visualisation Of 3d Scenes and Virtual Theatrementioning

confidence: 99%

“…EML [18] combines multimodal character animation with film making practices based on an emotional model, but it does not consider personality types or genre. CAMEO [22] relates specific cinematic direction, for character animation, lighting and camera work, to the genre or theme of a given story, but genre types are explicitly selected by the user. SceneMaker will introduce a new approach to automatically recognise genre from script text with keyword co-occurrence, term frequency and calculation of dialogue and scene length.…”

Section: Relation To Other Workmentioning

confidence: 99%

See 1 more Smart Citation

SceneMaker: Creative Technology for Digital StoryTelling

Akser

Bridges

Campo

et al. 2017

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

View full text Add to dashboard Cite

Abstract. The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

show abstract

Section: Visualisation Of 3d Scenes and Virtual Theatrementioning

confidence: 99%

Section: Relation To Other Workmentioning

confidence: 99%

SceneMaker: Creative Technology for Digital StoryTelling

Akser

Bridges

Campo

et al. 2017

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

View full text Add to dashboard Cite

show abstract

“…The automatic 3D animation production system, CAMEO, implements distinguishable direction styles for user selected genres and automatically applies them to the scene presentation. (Shim and Kang, 2008) is an automatic animation production system which creates 3D scenes based on cinematic direction knowledge for characters, camera, light, film editing and sound. CAMEO requires three inputs, besides writing the screenplay, the story in the form of dialogues, the user selects the setting, the characters and the media style defining the theme or genre of the animation (Figure 8).…”

Section: The Effect Of Genre On Animation Stylementioning

confidence: 99%

“…An important characteristic of the fuzzy P&E engine (Su et al, 2007) is that it provides an in-depth rule system tying emotions and personality with affective bodily expression and is the only system integrating story character roles, such as protagonist/hero or villain. ScriptViz (Liu and Leung, 2006), CAMEO (Shim and Kang, 2008) and CONFUCIUS (Ma, 2006) depict the scene environment incorporating cinematic techniques such as effective camera views and, in CAMEO only, theme related lighting.…”

Section: Relation To Other Workmentioning

confidence: 99%

SceneMaker: Intelligent Multimodal Visualisation of Natural Language Scripts

Hanser

Kevitt

Lunney

et al. 2010

Artificial Intelligence and Cognitive Science

View full text Add to dashboard Cite

Performing plays or creating films and animations is a complex creative, and thus expensive, process involving various professionals and media. This research project proposes to augment this process by automatically interpreting film and play scripts and automatically generating animated scenes from them. For this purpose a web based software prototype, SceneMaker, will be developed. During the generation of the story content, special attention will be given to emotional aspects and their reflection in the execution of all types of modalities: fluency and manner of actions and behaviour, body language, facial expressions, speech, voice pitch, scene composition, timing, lighting, music and camera. The main objective of this work is to demonstrate how a scene and actor behaviour changes, when emotional states are taken into account, e.g. walking down a street in a happy versus a sad state. Consequently, more realistic and believable story visualisations are an expected outcome. Literature on related research areas is reviewed involving natural language and text, screenplay or play script, layout processing with regard to personality and emotion detection, modelling affective behaviour of embodied agents, visualisation of 3D scenes with digital cinematography and genre-based presentation, intelligent multimedia selection and mobile 3D technology.SceneMaker's architecture with a language and text analysis module, a reasoning and decision making module based on cognitive, emotional information and a multimedia module for multimodal visualisation are presented along with a development plan and test scenarios. Technologies and software relevant for the development of SceneMaker are analysed and prospective tools for text and language processing, visualisation, media allocation and mobile user interfaces are suggested. Accuracy of content animation, effectiveness of expression and usability of the interface will be evaluated in empirical tests. In relation to other work, this project will present a genre-specific text-to-animation methodology which combines all relevant expressive modalities. Emotional expressivity inspired by the OCC (Ortony, Clore and Collins) emotion model will influence all modalities to enhance believability of virtual actors as well as scene presentation. Compared to other scene production systems, SceneMaker will infer emotions from the story context, rather than relying on explicit emotion keywords, SceneMaker will automatically detect genre from the script and apply appropriate cinematic direction. Also SceneMaker will enable 3D animation editing via web-based and mobile platforms.In conclusion, SceneMaker will reduce production time, save costs and enhance communication of ideas through the development of an intelligent, multimodal animation generation system providing quick previsualisations of scenes from script text input.

show abstract

“…Genre is reflected in the detail of a production, exaggeration and fluency of movements, pace (shot length), lighting, colour and camerawork [24]. The automatic 3D animation production system, CAMEO [25], incorporates direction knowledge, like genre and cinematography, as computer algorithms and data. A system which automatically recommends music based on emotion [26] associates emotions and music features, chords, rhythm and tempo of songs, in movie scenes.…”

Section: Visualisation Of 3d Scenesmentioning

confidence: 99%

SceneMaker: Automatic Visualisation of Screenplays

Hanser

Kevitt

Lunney

et al. 2009

KI 2009: Advances in Artificial Intelligence

View full text Add to dashboard Cite

Abstract. Our proposed software system, SceneMaker, aims to facilitate the production of plays, films or animations by automatically interpreting natural language film scripts and generating multimodal, animated scenes from them. During the generation of the story content, SceneMaker will give particular attention to emotional aspects and their reflection in fluency and manner of actions, body posture, facial expressions, speech, scene composition, timing, lighting, music and camera work. Related literature and software on Natural Language Processing, in particular textual affect sensing, affective embodied agents, visualisation of 3D scenes and digital cinematography are reviewed. In relation to other work, SceneMaker will present a genre-specific text-to-animation methodology which combines all relevant expressive modalities. In conclusion, SceneMaker will enhance the communication of creative ideas providing quick pre-visualisations of scenes.

show abstract

CAMEO - camera, audio and motion with emotion orchestration for immersive cinematography

Cited by 11 publications

References 4 publications

SceneMaker: Creative Technology for Digital StoryTelling

SceneMaker: Creative Technology for Digital StoryTelling

SceneMaker: Intelligent Multimodal Visualisation of Natural Language Scripts

SceneMaker: Automatic Visualisation of Screenplays

Contact Info

Product

Resources

About