Real-time selection of video streams for live TV broadcasting based on Query-by-Example using a 3D model

Abstract

The emergence of low-cost cameras with nearly professional features in the consumer market represents a new important source of video information. For example, using an increasing number of these cameras in live TV broadcastings enables obtaining varied contents without affecting the production costs. However, searching for interesting shots (e.g., a certain view of a specific car in a race) among many video sources in real-time can be difficult for a Technical Director (TD). So, TDs require a mechanism to easily and precisely represent the kind of shot they want to obtain abstracting them from the need to be aware of all the views provided by the cameras.In this paper we present our proposal to help a TD to visually define, using an interface for the definition of 3D scenes, an interesting sample view of one or more objects in the scenario. We recreate the views of the cameras in a 3D engine and apply 3D geometric computations on their virtual view, instead of analyzing the real images they provide, to enable an efficient and precise realtime selection. Specifically, our system computes a similarity measure to rank the candidate cameras. Moreover, we present a prototype of the system and an experimental evaluation that shows the interest of our proposal.

A Knowledge-Based Approach to Enhance Provision of Location-Based Services in Wireless Environments

“…In the case of services with parameters related to a location (e.g., the Fire Monitoring service) the URM offers the user a map through ADUS to select such location of interest. ADUS displays a 3DQBE (3D Query-By-Example) interface [34] (linked to the parameter through the interface property) to define the specific shot of the rowing boat to retrieve. On that interface, the user defines the kind of shot to obtain by rotating the camera view and even including other objects in the scene.…”

Guest Editorial: Content Analysis and Indexing for Advanced Multimedia Services

“…The work presented in, BReal-time selection of video streams for live TV broadcasting based on Query-by-Example using a 3D model^ [7] addresses one of the most critical aspects of multisource video production and how this can be cost-effective using consumer shooting devices. In such environments Technical Directors have the issue of being able to search for interesting shots (e.g., a certain view of a specific car in a race) among many video sources in real-time, many of which can be consumer-level cameras.…”

MultiCAMBA: a system for selecting camera views in live broadcasting of sport events using a dynamic 3D model

“…The system provides two mechanisms for that: a) the TD selects from lists the target object/s that must be part of the view and the constraints that the camera view must fulfill, or b) the TD clicks on predefined queries. Complementary, the ideas presented in [24] can be applied to enable the TD to define his/her requirements through an interface for the definition of 3D scenes. In addition, touchable 3D interfaces [25] could be helpful to improve the immersion of the TD in this process, although this is out of the scope of this paper.…”