Schubert Winterreise Dataset

Abstract

This article presents a multimodal dataset comprising various representations and annotations of Franz Schubert’s song cycle Winterreise . Schubert’s seminal work constitutes an outstanding example of the Romantic song cycle—a central genre within Western classical music. Our dataset unifies several public sources and annotations carefully created by music experts, compiled in a comprehensive and consistent way. The multimodal representations comprise the singer’s lyrics, sheet music in different machine-readable formats, and audio recordings of nine performances, two of which are freely accessible for research purposes. By means of explicit musical measure positions, we establish a temporal alignment between the different representations, thus enabling a detailed comparison across different performances and modalities. Using these alignments, we provide for the different versions various musicological annotations describing tonal and structural characteristics. This metadata comprises chord annotations in different granularities, local and global annotations of musical keys, and segmentations into structural parts. From a technical perspective, the dataset allows for evaluating algorithmic approaches to tasks such as automated music transcription, cross-modal music alignment, or tonal analysis, and for testing these algorithms’ robustness across songs, performances, and modalities. From a musicological perspective, the dataset enables the systematic study of Schubert’s musical language and style in Winterreise and the comparison of annotations regarding different annotators and granularities. Beyond the research domain, the data may serve further purposes such as the didactic preparation of Schubert’s work and its presentation to a wider public by means of an interactive multimedia experience. With this article, we provide a detailed description of the dataset, indicate its potential for computational music analysis by means of several studies, and point out possibilities for future research.

Automatic Note-Level Score-to-Performance Alignments in the ASAP Dataset

“…Furthermore, anchor point-based or segment-constrained approaches have been applied to audio-to-score alignment (Müller et al, 2004). Similar measure-wise constraints have been used in the generation of The Multimodal Schubert Winterreise Dataset (Weiß et al, 2021).…”

The Harmonic Memory: a Knowledge Graph of harmonic patterns as a trustworthy framework for computational creativity

“…Dataset. We two subsets of ChoCo [16] containing cover tracks: Schubert Winterreise [69] and Chordify Annotator Subjectivity Dataset (CASD) [38]. The former provides harmonic annotations for each of the 9 different performances of the same musical piece by Schubert.…”

Useful Feedback in Asynchronous Lessons of Music Performance: A Pilot Study on Oboe Players

“…They adopt various perspectives, including performance recordings data [10], metadata (genre, composer, lyrics, etc. [11,12,13]), musical scores (MIDI [14], harmony and cadence [15], and piano notation [16,17]), information associated with fingering [18] or music analysis [19], other multimodal information [20,21], emotions [22,23], listening history [24], and performers' interpretations [25,26,27,28]. To the best of our knowledge, none have focused on human cognition, such as the experiences of playing or listening to a piece of music.…”

“…This research was approved by the Ethics Committees of Faculty of Library Information and Media Science University of Tsukuba (permission number: [20][21][22], Kunitachi College of Music (permission number: 2007), and Senzoku Gakuen College of Music. Opt-in informed consent was obtained from performers and teachers who engaged in the experiments.…”