Trip Synopsis: 60km in 60sec

Abstract

International audienceComputerized route planning tools are widely used today by travelers all around the globe, while 3D terrain and urban models are becoming increasingly elaborate and abundant. This makes it feasible to generate a virtual 3D flyby along a planned route. Such a flyby may be useful, either as a preview of the trip, or as an after-the-fact visual summary. However, a naively generated preview is likely to contain many boring portions, while skipping too quickly over areas worthy of attention. In this paper, we introduce 3D trip synopsis: a continuous visual summary of a trip that attempts to maximize the total amount of visual interest seen by the camera. The main challenge is to generate a synopsis of a prescribed short duration, while ensuring a visually smooth camera motion. Using an application-specific visual interest metric, we measure the visual interest at a set of viewpoints along an initial camera path, and maximize the amount of visual interest seen in the synopsis by varying the speed along the route. A new camera path is then computed using optimization to simultaneously satisfy requirements, such as smoothness, focus and distance to the route. The process is repeated until convergence. The main technical contribution of this work is a new camera control method, which iteratively adjusts the camera trajectory and determines all of the camera trajectory parameters, including the camera position, altitude, heading, and tilt. Our results demonstrate the effectiveness of our trip synopses, compared to a number of alternatives

Example-driven virtual cinematography by learning camera behaviors

“…Optimization-based methods have often been used in the computation of camera paths when all the scene information is available beforehand [Galvane et al 2015a;Huang et al 2016]. To evaluate our approach, we performed a comparison with the camera-on-rails technique [Galvane et al 2015a] which is the only optimization technique to handle specifically the framing of two targets.…”

“…Different path or motion-planning techniques have been proposed to guide the design of camera trajectories mostly inspired by the robotics literature (see [Lino et al 2010;Oskam et al 2009]). Optimization has also been considered to solve high-level requirements, addressing the placement of way-points [Huang et al 2016], or parameters of curve representations [Galvane et al 2015a].…”

“…Partial answers have been proposed: retargeting low and high frequency signals from real camera trajectories to virtual environments [Kurz et al 2014]; designing dedicated camera steering behaviors using physical models [Galvane et al 2013]; performing trajectory optimization given waypoint constraints [Huang et al 2016] or designing specific camera interpolators defined in alternate camera spaces, the benefit of which is to maintain visual features over time (framing, camera angle, distance) [Galvane et al 2015a].…”

Topology-aware Camera Control for Real-time Applications

“…At run-time the roadmap is queried with an A* algorithm to compute the shorted path from the current camera position to the target position that maximises the visibility of a target. To highlight the motion of a vehicule, Huang [Huang et al 2016] rely on an interactive optimisation technique which computes a sequence of waypoints that will ensure the proper tracking of targets by the camera. Key characteristics to optimize are visibility of the target, camera smoothness, and visual load (the more objects in the scene, the slower the camera is).…”

Reducing simulator sickness with perceptual camera control

“…Their perceptual metrics quantifies factors for visually-pleasant animations. Similarly, other research has been proposed to maximize scene coverage during a fly-through [Huang et al 2016]. Those methods are, however, mainly for story-telling/entertainment and traditional display platforms.…”