Harmonic Reproduction Technology between a Real Venue and Remote Audiences

Abstract

NTT Human Informatics Laboratories has been researching and developing technology to reproduce the appearance of an audience enjoying a live-streamed event online remotely from home (remote audience) at the venue where the event is being held (real venue) while harmonizing it with the situation at the real venue. At the 34th Mynavi TOKYO GIRLS COLLECTION 2022 SPRING/SUMMER held on March 21, 2022, a demonstration experiment was conducted to support the excitement of the event by using low-latency video communication and cross-modal sound search to reproduce pseudo cheers at the real venue for both real-venue and remote audience members who could not cheer due to the COVID-19 pandemic. This article introduces the activities of this demonstration experiment.

Toward the Remote World in Which Life Is Many Times More Enjoyable―From “Remote by Necessity” to “Remote by Choice”

“…The Feature Articles in this issue introduce four technologies from among these various remote application scenarios: (i) human augmentation for transmitting motor skills and embodied knowledge of experts directly to people at a distance [1], (ii) telepresence technology for supporting remote interpersonal and interactive tasks [2], and (iii) harmonic reproduction technology [3] and (iv) emotional-perception-control technology [4] for creating a sense of unity and excitement between the venue audience and remote audience, and among remote audience members.…”