Networked Performances and Natural Interaction via LOLA: Low Latency High Quality A/V Streaming System

Drioli, Carlo; Allocchio, C.; Buso, Nicola

doi:10.1007/978-3-642-40050-6_21

Cited by 49 publications

(27 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Network transmission introduces timing and latency problems which can be especially acute in music requiring tight temporal coordination between players. A number of techniques exist for compensating for delays [9] though it has equally been argued that timing discrepancies should be accepted as a natural or, indeed, desirable feature of distributed, networked performance [18]. Latency troubles can be confounded by technical heterogeneity, that is, where the network transmission capability or local audio equipment is variable in kind and quality between participants [14].…”

Section: Networked Music Performancementioning

confidence: 99%

Musical meshworks

Freeth

Bowers

Hogg

2014

Proceedings of the 2014 Conference on Designing Interactive Systems

View full text Add to dashboard Cite

There is longstanding interest in developing systems to support musical performances networked across multiple potentially geographically dispersed participants. Much past research has addressed technical problems such as latency to create simulacra of co-present performance settings. In contrast, we draw on the literature on digitally mediated performance in HCI to get a richer context for understanding networked live musical events. We describe a system, MESHWORKS, which permits the definition of varied participation roles and unusual network topologies, and explore its use to realize ArCCADE -a project to create events that support multiple overlapping musical ensembles and invite curiosity-driven exploration by the audience. Our experience with the system, the events and the interfaces we built to support engagement are discussed. In particular, we document how a musical community has emerged around our research and discuss wider implications for how we conceive the cultural meshwork new performance technologies are implicated in.

show abstract

Section: Networked Music Performancementioning

confidence: 99%

Musical meshworks

Freeth

Bowers

Hogg

2014

Proceedings of the 2014 Conference on Designing Interactive Systems

View full text Add to dashboard Cite

show abstract

“…For this reason, video and audio packets are transmitted in order to develop the technique of the student. 45,58,75,76 In these cases, high-quality video is required, but the overall end-to-end delay is higher than 60 milliseconds, which prevents for real-time music performances. In order to create a virtual environment like performing in the same room, some applications adjust the volume of the transmitted audio signal, trying to emulate the direction of arrival for the audio signal like performing in the same environment for each musician.…”

Section: State-of-the-art Nmp Approachesmentioning

confidence: 99%

“…Nevertheless, some applications adopt the peer-to-peer model for the audio transmission among the musicians. 45,57,[75][76][77][78][79][80][81]87 The alternative approach met in NMP architectures uses the client-server model. In more detail, a central server collects all the transmitted audio streams from the musicians.…”

Section: State-of-the-art Nmp Approachesmentioning

confidence: 99%

Improving networked music performance systems using application‐network collaboration

Lakiotakis

Liaskos

Dimitropoulos

2018

Concurrency and Computation

View full text Add to dashboard Cite

Summary Networked Music Performance (NMP) systems involve musicians located in different places who perform music while staying synchronized via the Internet. The maximum end‐to‐end delay in NMP applications is called Ensemble Performance Threshold (EPT) and should be less than 25 milliseconds. Due to this constraint, NMPs require ultra–low‐delay solutions for audio coding, network transmission, relaying, and decoding, each one a challenging task on its own. There are two directions for study in the related work referring to the NMP systems. From the audio perspective, researchers experiment on low‐delay encoders and transmission patterns, aiming to reduce the processing delay of the audio transmission, but they ignore the network performance. On the other hand, network‐oriented researchers try to reduce the network delay, which contributes to reduced end‐to‐end delay. In our proposed approach, we introduce an integration of dynamic audio and network configuration to satisfy the EPT constraint. The basic idea is that, the major components participating in an NMP system, the application and the network interact during the live music performance. As the network delay increases, the network tries to equalize it by modifying the routing behavior using Software‐Defined Networking principles. If the network delay exceeds a maximum affordable threshold, the network reacts by informing the application to change the audio processing pattern to overcome the delay increase, resulting in below EPT end‐to‐end delay. A full prototype of the proposed system was implemented and extensively evaluated in an emulated environment.

show abstract

“…Others have achieved distributed performances using gigabit networks 7 that mean video compression is unnecessary. This gives access to lower intrinsic roundtrip times, reducing the effective delay between venues.…”

Section: Exploiting Consumer-grade Broadbandmentioning

confidence: 99%