Formal semantics for interactive music scores: a framework to design, specify properties and execute interactive scenarios

Abstract

Most interactive scenarios are based on informal specifications, so that it is not possible to formally verify properties of such systems. We advocate the need for a general and formal model aiming at ensuring safe executions of interactive multimedia scenarios. Interactive scores (is) is a formalism based on temporal constraints to describe interactive scenarios. We propose new semantics for is based on timed event structures (TES). With such a semantics, we can specify more properties of the system, in particular, properties about execution traces, which are difficult to specify as constraints. We also present an operational semantics of is based on the non-deterministic timed concurrent constraint calculus and we relate such a semantics to the TES semantics. With the operational semantics, we can describe the behaviour of scores whose timed object durations can be arbitrary integer intervals.

Real-time interactive streams and temporal objects language

“…N → R 1 sum(gain(delay1(Sinput1 / Sacq, delta)) || rl(Sinput2 / Sacq)) ds What are avail(S output1 , t), k(S output1 , t), req(S output1 , t)? Process calculi has been applied to the modeling of interactive music systems [18,17,23,28,16,27,1,24,19,4,14,11,13,15,2,22,12,20,21,10] and ecological systems [25,6,26,7]. In addition, research on algorithms [5,3,9] and software engineering [8] also contributes to this field.…”

Foundations for Reliable and Flexible Interactive Multimedia Scores

“…On the other side, our logical characterization of ReactiveIS is based on the ideas in [10] where subexponentials in linear logic were used to give logical semantics to concurrent programming languages featuring modalities. In [11,13] the authors propose a semantics for IS based on process calculi. However, no practical techniques were proposed for the verification of the score as the logical characterization presented here.…”

“…However, no practical techniques were proposed for the verification of the score as the logical characterization presented here. Moreover, the models proposed in [11,13] cannot be straightforwardly extended to deal with non-linear behavior.…”

A general overview of formal languages for individual-based modelling of ecosystems

“…Surprisingly, many formalisms developed for population modelling have been also used to model music interaction in real life performance; for instance process calculi has been used to model real-time performance in music [105], computer music improvisation [85] and interactive music scores [102]. In fact, process calculi have been extensively applied to the modeling of interactive music systems [95,94,92,88,93,87,101,90,91,86,89,85,100,106,84,105,1,102,96,55,82,79,81,83,2,99,80,97,98,78] and ecological systems [103,60,104,61]. In addition, research on algorithms [57,53,70,67,69] and software engineering [74,46] also contributes to this field.…”