Simultaneous 3D tracking and reconstruction on a mobile phone

Prisacariu, Victor Adrian; Kähler, Olaf; Murray, David; Reid, Ian

doi:10.1109/ismar.2013.6671768

Cited by 25 publications

(16 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On the left we show the depth image overlaid with the tracking result and on the right we visualise a virtual sword with the corresponding 3D pose overlaid on the RGB image recovered by evolving this embedding function. A faster approach has been linked with a 3D reconstruction stage, both without depth data by Prisacariu et al ( , 2013 and with depth by Ren et al (2013). The SDF was used by Ren and Reid (2012) to formulate different embedding functions for robust real-time 3D tracking of rigid objects using only depth data, an approach extended by Ren et al (2013) to leverage RGB data in addition.…”

Section: Related Workmentioning

confidence: 99%

Real-Time Tracking of Single and Multiple Objects from Depth-Colour Imagery Using 3D Signed Distance Functions

et al. 2017

View full text Add to dashboard Cite

We describe a novel probabilistic framework for real-time tracking of multiple objects from combined depthcolour imagery. Object shape is represented implicitly using 3D signed distance functions. Probabilistic generative models based on these functions are developed to account for the observed RGB-D imagery, and tracking is posed as a maximum a posteriori problem. We present first a method suited to tracking a single rigid 3D object, and then generalise this to multiple objects by combining distance functions into a shape union in the frame of the camera. This second model accounts for similarity and proximity between objects, and leads to robust real-time tracking without recourse to bolt-on or ad-hoc collision detection.

show abstract

Section: Related Workmentioning

confidence: 99%

Real-Time Tracking of Single and Multiple Objects from Depth-Colour Imagery Using 3D Signed Distance Functions

et al. 2017

View full text Add to dashboard Cite

show abstract

“…(9) is derived by substituting arctangent function for θ in Eq. (8). Where r u is the height of the projection on the image plane (the subscript u being used to denote the undistorted projection) [73].…”

Section: Smartphones From An Applied Research Perspective 36mentioning

confidence: 99%

“…Object-wise 3D reconstruction is a cardinal problem in computer vision, with much work being dedicated to it throughout recent years. Unlike other approaches, some approaches use global computation, whereas Prisacariu et al [8] adopt a local computation method related with signed distance transformation and its derivatives. By this method, 3D renderings are quickly obtained by hierarchical ray casting.…”

Section: Introductionmentioning

confidence: 99%

“…By this method, 3D renderings are quickly obtained by hierarchical ray casting. Real-time mobile phone performances and speeds faster than 100 fps on PC are achieved by the tracker and GPU acceleration is not required [8]. Tanskanen et al [9] propose the first dense stereo-based system for live interactive 3D reconstruction on mobile phones.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The Geometry and Usage of the Supplementary Fisheye Lenses in Smartphones

Sahin¹

2017

Smartphones From an Applied Research Perspective

View full text Add to dashboard Cite

Nowadays, mobile phones are more than a device that can only satisfy the communication need between people. Since fisheye lenses integrated with mobile phones are lightweight and easy to use, they are advantageous. In addition to this advantage, it is experimented whether fisheye lens and mobile phone combination can be used in a photogrammetric way, and if so, what will be the result. Fisheye lens equipment used with mobile phones was tested in this study. For this, standard calibration of 'Olloclip 3 in one' fisheye lens used with iPhone 4S mobile phone and 'Nikon FC-E9' fisheye lens used with Nikon Coolpix8700 are compared based on equidistant model. This experimental study shows that Olloclip 3 in one fisheye lens developed for mobile phones has at least the similar characteristics with classic fisheye lenses. The dimensions of fisheye lenses used with smart phones are getting smaller and the prices are reducing. Moreover, as verified in this study, the accuracy of fisheye lenses used in smartphones is better than conventional fisheye lenses. The use of smartphones with fisheye lenses will give the possibility of practical applications to ordinary users in the near future.

show abstract

“…However, they do not attempt to estimate the surface shape beyond a cloud of points. Another similar approach is the work of Prisacariu et al [26] who use level-set techniques for 3D modelling. The approach is however not online, as it processes the video-sequence as a batch, which significantly limits possible applications of such a "tracker".…”

Section: Related Workmentioning

confidence: 99%

TMAGIC: A Model-Free 3D Tracker

Lebeda

Hadfield

Bowden

2017

IEEE Trans. on Image Process.

View full text Add to dashboard Cite

Abstract-Significant effort has been devoted within the visual tracking community to rapid learning of object properties on the fly. However, state-of-the-art approaches still often fail in cases such as rapid out-of-plane rotation, when the appearance changes suddenly. One of the major contributions of this work is a radical rethinking of the traditional wisdom of modelling 3D motion as appearance change during tracking. Instead, 3D motion is modelled as 3D motion. This intuitive but previously unexplored approach provides new possibilities in visual tracking research.Firstly, 3D tracking is more general, as large out-of-plane motion is often fatal for 2D trackers, but helps 3D trackers to build better models. Secondly, the tracker's internal model of the object can be used in many different applications and it could even become the main motivation, with tracking supporting reconstruction rather than vice versa. This effectively bridges the gap between visual tracking and Structure from Motion.A new benchmark dataset of sequences with extreme out-ofplane rotation is presented and an online leader-board offered to stimulate new research in the relatively underdeveloped area of 3D tracking. The proposed method, provided as a baseline, is capable of successfully tracking these sequences, all of which pose a considerable challenge to 2D trackers (error reduced by 46 %).

show abstract

Simultaneous 3D tracking and reconstruction on a mobile phone

Cited by 25 publications

References 18 publications

Real-Time Tracking of Single and Multiple Objects from Depth-Colour Imagery Using 3D Signed Distance Functions

Real-Time Tracking of Single and Multiple Objects from Depth-Colour Imagery Using 3D Signed Distance Functions

The Geometry and Usage of the Supplementary Fisheye Lenses in Smartphones

TMAGIC: A Model-Free 3D Tracker

Contact Info

Product

Resources

About