A Rule-Based Virtual Director Enhancing Group Communication

Abstract

Audiovisual group communication systems deal with a large number of video streams, and, unlike less advanced videoconferencing systems, require intelligence for selecting adequate views for each of the connected rooms, in order to convey best what is happening in the other locations. Such a decision making component, in our implementation called Orchestration Engine (OE), acts as a Virtual Director. It processes lowlevel events, emitted by content analysis sensors, into editing commands. The OE has two main components: one that semantically lifts low-level events into communication events and one that associates editing decisions to communication contexts. The former has to deal with uncertain and delayed information. The latter subsumes knowledge that reflects both conversation and narrative principles. Both components include contradicting bodies of knowledge. We investigate a rule-based event processing approach and reflect the scalability of our solution regarding competing and contradicting rules.Index Termsvirtual director, semantic abstraction, decision making, rule-based behavior, videoconferencing 2012 IEEE International Conference on Multimedia and Expo Workshops 978-0-7695-4729-9/12 $26.00

The utility of social and topical factors in anticipating repliers in Twitter conversations

“…In this work we focused on features which can be computed between pairs of users rather than triples (consisting of the two users and the current message) since we are interested in integrating this work into a real-time video communication tool [9] which exploits users' social media stream as background knowledge for orchestrating the video communication. Therefore, it is necessary to be able to compute the features at the beginning of each communication session rather than re-computing them after each message or sentence.…”

Automatic orchestration of video streams to enhance group communication

“…Detailed examples of rules already incorporated into the system together with challenges and workarounds in their implementation were reported in [8].…”

“…A clear example of this situation is rule number 4 which stops other rules from being executed if no more than 2 seconds have passed after the last camera change. Careful implementation of the reasoning mechanism and rule interplay is required to achieve conflict resolution [8] but this is beyond the scope of this paper.…”

Virtual director technology for social video communication and live event broadcast production

“…While the approach is well suited for static modeling of a production domain, experiments resulted in the conclusion that available reasoning frameworks are not fast and scalable enough for the requirements envisioned -see [9]. Ultimately, a rule-based approach was selected in combination with event processing technology [10], i.e. Complex Event Processing (CEP) [3] engines.…”