This paper describes a system which composes operetta songs fitting to adjectives representing producer’s impressions of story scenes. Inputs to the system are original theme music, story texts and adjectives representing producer’s impressions of story scenes. The system composes variations on theme music and lyrics based on impressions of story scenes using Kansei information processing in order to convey producer’s impression of a story to audiences. Evolutionary computation is also applied to generations of variations and lyrics. Subjects experiments are performed to verify the usefulness of the system usingThe Ant and the Chrysalisin Aesop’s Fables as a story. In the experiments, two types of evaluations are considered. The one is the evaluation from the viewpoint that the system generates operetta songs fitting to story scenes appropriately or not. The other is the evaluation from the viewpoint that the system generates operetta songs giving producers and listeners the same impressions of generated operetta songs or not.
This paper describes a system which generates variations on theme music fitting to story scenes represented by texts and/or pictures. Inputs to the present system are original theme music and numerical information on given story scenes. The present system varies melodies, tempos, tones, tonalities, and accompaniments of given theme music based on impressions of story scenes. Genetic algorithms (GAs) using modular neural network (MNN) models as fitness functions are applied to music generation in order to reflect user's feeling of music and stories. The present system adjusts MNN models for each user on line. This paper also describes the evaluation experiments to confirm whether the generated variations on theme music reflect impressions of story scenes appropriately or not.
University of Tsukuba, Onisawa Lab., Graduate School of Systems and Information Engineering *2 弓削商船高等専門学校 電子機械工学科 Yuge National Colledge of Maritime Technology *3 筑波大学 システム情報工学研究科 University of Tsukuba, Graduate School of Systems and Information Engineering る.一方,音楽と他のメディアを結びつけることを目 的とする研究 [6-7] では,異なる様式のメディアDB の印象に基づいた相互アクセスのための手法を提案し ている.これらの研究では,文章や画像,音楽などの メディアを入力し,入力メディアの印象を基にメディ アDBを検索し,似た印象を持つ,異なる様式のメ ディアを出力するというものである.しかし,画像, 音楽,文章を有機的に結びつける研究はまだ比較的少 ない. 本論文では画像,音楽,文章を柔軟に結びつける処 理の一例として,複数の絵から物語を生成し,テーマ 音楽をその物語の各シーンの印象に合わせて変奏する ことを考える.つまり,複数の絵から生成される物語 文章と,その印象に基づいて変奏されたテーマ音楽に よって構成される物語の Back Ground Music (以下 BGM) を有機的につなげることを目的としている.本 研究では,物語のシーンに対する解釈や音楽に対する 感じ方は,人それぞれによって異なるということを重 視している.よって,ユーザ個人の物語のシーンに対 する解釈や音楽に対する感じ方を反映したBGMを生 成する.なお本論文では,テーマ音楽の調,テンポ, コード進行,伴奏パートの伴奏パターンを変更し, テーマ音楽を編曲することで,物語の各シーンに合っ たBGMを作成している. 本論文において,テーマ音楽とは物語の登場人物や 特定の事象などを表現する,物語中で繰り返される音 楽を意味する.これは,音楽用語におけるライトモ チーフに相当する [8] .またテーマ音楽の変奏とは, 作曲・編曲の技法の一つでテーマ音楽のリズム・旋 律・和音・伴奏などを物語のシーンの状況に応じて Vol.19 No.4
Impressions of combinations of lighting patterns, lyrics and music are analyzed for designing the system which generates the theatrical effects using the three modal media based on adjectives representing producer's impressions of story scenes. Impression spaces of three modal media are constructed by factor analysis using data obtained by pre-experiments. The three modal media are generated according to the coordinates in the impression spaces of three modal media, where the coordinates are estimated using the concept of co-occurrence of inputted adjectives. In this paper, subject experiments are performed to analyze the interaction of combinations of the three modal media. The following four combinations are considered: (1) combinations based on same adjectives, (2) combinations based on counter adjectives, (3) combinations based on similar adjectives, (4) combinations based on dissimilar adjectives. Experimental results show that combinations (1),(3), and (4) are effective as theatrical effects of story scenes.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.