A Melody-Conditioned Lyrics Language Model

Watanabe, K.; Matsubayashi, Yuichiroh; Fukayama, Satoru; Goto, Masataka; Inui, Kentaro; Nakano, Takanori

doi:10.18653/v1/n18-1015

Cited by 38 publications

(39 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the quality of the lyrics transcreated by the users should be evaluated. Watanabe et al [30] performed a qualitative evaluation that used a crowdsourcing mechanism and quantitative evaluation involving a test set of perplexity and a line/block boundary replication task for measuring the consistency between the melody and boundaries in the generated lyrics. Dzogang et al [31] focused on the task of detecting emotion in texts and analyzing texts as point sets in an emotional multidimensional space.…”

Section: Discussionmentioning

confidence: 99%

Implementation and experiments for interactive lyrics transcreation system

Nishimura

Itoh

2020

Vis. Comput. Ind. Biomed. Art

View full text Add to dashboard Cite

The evolution of the Internet has enabled us to enjoy the music created in various countries. But still, it is often difficult to understand the lyrics written in foreign languages. Professional translators have published many international songs with lyrics that fit the melody so that the ordinary people can enjoy the lyrics of such international songs. This paper discusses lyrics transcreation into the Japanese language. Also, the paper presents an interactive visual lyrics transcreation system and describes the details of its implementation. This system allows users to select temporary lyrics from a set of tentative translations and then freely modify the lyrics with a real-time visualization mechanism. We also propose a lyrics translation algorithm that solves an essential problem of lyrics translation into Japanese. In this study, we interviewed two experts regarding problems with lyrics translation and received reviews of our presented system. We also conducted preliminary experiments with 19 participants to determine the best combination of user interface components for our system. We performed additional user experiments inviting 12 participants to compare lyrics transcreation using the presented system to manual lyrics transcreation. Lyrics transcreation by the presented system brought better results against those of manual transcreation.

show abstract

Section: Discussionmentioning

confidence: 99%

Implementation and experiments for interactive lyrics transcreation system

Nishimura

Itoh

2020

Vis. Comput. Ind. Biomed. Art

View full text Add to dashboard Cite

show abstract

“…• Overall (Watanabe et al 2018) What is the overall score of the melody? Results Table 3 shows the human evaluation results.…”

Section: Human Evaluationmentioning

confidence: 99%

Neural Melody Composition from Lyrics

Bao

Huang

Wei

et al. 2019

Natural Language Processing and Chinese Computing

View full text Add to dashboard Cite

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyricsconditional melody as well as the exact alignment between the generated melody and the given lyrics simultaneously. More specifically, we develop the melody composition model based on the sequence-to-sequence framework. It consists of two neural encoders to encode the current lyrics and the context melody respectively, and a hierarchical decoder to jointly produce musical notes and the corresponding alignment. Experimental results on lyrics-melody pairs of 18,451 pop songs demonstrate the effectiveness of our proposed methods. In addition, we apply a singing voice synthesizer software to synthesize the "singing" of the lyrics and melodies for human evaluation. Results indicate that our generated melodies are more melodious and tuneful compared with the baseline method. A syllable is a word or part of a word which contains a single vowel sound and that is pronounced as a unit. Chinese is a monosyllabic language which means words (Chinese characters) predominantly consist of a single syllable (https://en.wikipedia. org/wiki/Monosyllabic_language).

show abstract

“…Later, in Tra-la-Lyrics 2.0 [6], the words in the generated lyrics have higher semantic associations among them and with given seeds, while the rhythms are still matched if rhymes are present. Watanabe et al [7] used a melody-conditioned model to generate fluent lyrics while maintaining the compatibility between the boundaries of lyrics and melody structures.…”

Section: Introductionmentioning

confidence: 99%

Automated Generation of Chinese Lyrics Based on Melody Emotions

Huang

You

2021

IEEE Access

View full text Add to dashboard Cite

Natural Language Processing enables computers to understand human natural languages and assists humans to perform many tasks. Recently, language research was gradually moving towards the field of natural language generation, and lyrics generation is one of these research directions. In the past, many studies have explored how to generate lyrics using seeds or prompt words. But, they usually ignored the relationship between music and lyrics and even melody emotions when generating lyrics. In this paper, we propose the Chinese lyrics generation system based on notes and melody emotions. In the first phase, a support vector regression model is trained to detect melody emotions. In the second phase, a sequence-tosequence model is trained to generate lyrics using notes, melody emotions, and lyrics. Finally, we conduct the experiments and evaluate the detected melody emotions and the generated lyrics. Results show that the generated lyrics have fluent sentences, and the sentences are with connected semantics.

show abstract

A Melody-Conditioned Lyrics Language Model

Cited by 38 publications

References 10 publications

Implementation and experiments for interactive lyrics transcreation system

Implementation and experiments for interactive lyrics transcreation system

Neural Melody Composition from Lyrics

Automated Generation of Chinese Lyrics Based on Melody Emotions

Contact Info

Product

Resources

About