Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras

Inamoto, Naho; Saitō, Hideo

doi:10.1109/tmm.2007.902832

Cited by 49 publications

(30 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Hayashi and Saito (Hayashi and Saito, 2006;Inamoto and Saito, 2007) employ as well a billboard representation of dynamic regions while the interpolation is performed by estimating the projective geometry among different views. A similar method has been proposed recently by Germann et al (Germann et al, 2010) that estimate the 2D pose using a database of silhouettes.…”

Section: Related Workmentioning

confidence: 99%

Real-time Video-based View Interpolation of Soccer Events using Depth-selective Plane Sweeping

Goorts¹,

Ancuti²,

Dumont³

et al. 2013

Proceedings of the International Conference on Computer Vision Theory and Applications

View full text Add to dashboard Cite

Abstract:In this paper we present a novel technique to synthesize virtual camera viewpoints for soccer events. Our real-time video-based rendering technique does not require a precise estimation of the scene geometry. We initially segment the dynamic parts of the scene to consequently estimate a depth map of the filtered foreground regions using a plane sweep strategy. The depth map is indicatively segmented to depth information per player. A consecutive plane sweep is used, where the depth sweep is limited to the depth range of each player individually, effectively removing major ghosting artifacts, such as third legs or ghost players. The background and shadows are interpolated independently. For maximum performance our technique is implemented using a combination of NVIDIA's shaders language Cg and NVIDIA's general purpose computing framework CUDA.The rendered results of an actual soccer game demonstrate the usability and accuracy of our framework.

show abstract

Section: Related Workmentioning

confidence: 99%

Real-time Video-based View Interpolation of Soccer Events using Depth-selective Plane Sweeping

Goorts¹,

Ancuti²,

Dumont³

et al. 2013

Proceedings of the International Conference on Computer Vision Theory and Applications

View full text Add to dashboard Cite

show abstract

“…More recently a number of groups have investigated volumetric [18] and imagebased interpolation techniques [7,23,28] for rendering novel views in sports. Grau et al [18] used a texture mapped visual-hull reconstruction obtained from multiple view silhouettes to render novel views of the players.…”

Section: Free-viewpoint Video In Sports and Outdoor Scenesmentioning

confidence: 99%

“…[7,23,28]. Inamoto and Saito [23] allow free-viewpoint video synthesis in football by segmenting the observed camera images into three layers: dynamic foreground (players); pitch; and background (stadium). Segmentation of dynamic foreground regions corresponding to players is performed based on motion and colour.…”

Section: Free-viewpoint Video In Sports and Outdoor Scenesmentioning

confidence: 99%

Free-Viewpoint Video for TV Sport Production

Hilton

Guillemaut

Kilner

et al. 2010

Geometry and Computing

View full text Add to dashboard Cite

Free-viewpoint video in sports TV production presents a challenging problem involving the conflicting requirements of broadcast picture quality with video-rate generation of novel views, together with practical problems in developing robust systems for cost effective deployment at live events. To date most multiple view video systems have been developed for studio applications with a fixed capture volume, controlled illumination and backgrounds. Live outdoor events such as sports present a number of additional challenges for both acquisition and processing. Multiple view capture systems in sports such as football must cover the action taking place over an entire pitch with video acquisition at sufficient resolution for analysis and production of desired virtual camera views. In this chapter we identify the requirements for broadcast production of free-viewpoint video in sports and review the state-of-the-art. We present the iview free-viewpoint video system (www.bbc.co.uk/rd/iview) which enables production of novel camera views of sports action for use in match commentary, for example the referees viewpoint. Automatic online calibration, segmentation and reconstruction is performed to allow rendering of novel viewpoints from the moving match cameras. Results are reported of production trials in football (soccer) and rugby which demonstrate free-viewpoint video with a visual quality comparable to the broadcast footage.

show abstract

“…A study that is conducted in [12] applied a method to replay a foot ball scene. The method describes that virtual view image is generated from interpolation of two and three cameras close to virtual images that are selected by the user, but it is not significantly determined by the way of choosing the used cameras.…”

Section: Introductionmentioning

confidence: 99%

Virtual View Image over Wireless Visual Sensor Network

2011

View full text Add to dashboard Cite

Abstrak Abstract In general, visual sensors are applied to build virtual view images. When number of visual sensors increases then quantity and quality of the information improves. However, the view images generation is a challenging task in Wireless Visual Sensor Network environment due to energy restriction, computation complexity, and bandwidth limitation. Hence this paper presents a new method of virtual view images generation from selected cameras on Wireless Visual Sensor Network. The aim of the paper is to meet bandwidth and energy limitations without reducing information quality. The experiment resultsshowed that this method could minimize number of transmitted imageries with sufficient information.. Keywords: wireless visual sensor network, camera selection method, virtual view IntroductionWireless Visual Sensor Network (WVSN) is a system with capability to communicate, to receive and to process signals [1]. In general WVSN architecture, as shown in Figure 1, consists of nodes that contain visual sensor that are spread in area of visual observation. Multi-cameras as visual sensors are used in WVSN to provide multi-view services, multi-resolutions, environmental monitoring, and surveillance system. In WVSN application, visual sensor nodes send captured image and video to sink for further processing suited to application purposes which are designed to meet limited resources such as energy resources and processing capability. However users are still able to get optimal information.The more sensors to reconstruct scenery, the better results will be obtained. However limitation of energy, processing capability, and transmission bandwidth on WVSNs become obstacles to received maximum information from multi-camera network. To solve those problems, we need a method of virtual sensor camera selection that can give maximum information with minimum amount of data. There are two things to minimize data transmission, i.e. reducing numbers of sensors and maximizing image compression. In other words, we need to select few cameras from all available one, with maximum information.Algorithms for automatic visual sensor selection on network were designed for any purposes. In study [2] and [3], cameras communicate one another to obtain the amount of active cameras to gain expected spaces on expected scene. Two algorithms were developed in this research, such as (1) distributed processing algorithm, a method used to conduct background and foreground segmentation process that is continued with a method for human face detection, and this method results in lower transmitted data; and (2) centered algorithm, base station uses information obtained from distributed processing to determine the shape on the scene. In this

show abstract

Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras

Cited by 49 publications

References 24 publications

Real-time Video-based View Interpolation of Soccer Events using Depth-selective Plane Sweeping

Real-time Video-based View Interpolation of Soccer Events using Depth-selective Plane Sweeping

Free-Viewpoint Video for TV Sport Production

Virtual View Image over Wireless Visual Sensor Network

Contact Info

Product

Resources

About