Localization and tracking in known large environments using portable real-time 3D sensors

Abstract

a b s t r a c tEgo-motion estimation and localization in large environments are key components in any assistive technology for real-time user orientation and navigation. We consider the case where a large known environment is explored without a priori assumptions on the initial location. In particular we propose a framework that uses a single portable 3D sensor to solve the place recognition problem and continuously tracks its position even when leaving the known area or when significant changes occur in the observed environment.We cast the place recognition step as a classification problem and propose an efficient search space reduction considering only navigable areas where the user can be localized. Classification hypotheses are then discarded exploiting temporal consistency w.r.t. a relative tracker that exploits only the sensor input data. The solution uses a compact classifier whose representation scales well with the map size. After being localized, the user is continuously tracked exploiting the known environment using an efficient data structure that provides constant access time for nearest neighbor searches and that can be streamed to keep only the local region close to the last known position in memory. Robust results are achieved by performing a geometrically stable selection of points, efficiently filtering outliers and integrating the relative tracker based on previous observations. We experimentally show that such a framework provides good localization results and that it scales well with the environment map size yielding real-time performance for both place recognition and tracking.

Expanding the Detection of Traversable Area with RealSense for the Visually Impaired

“…The navigation system extracts ground plane to reduce drift imposed by the head-mounted RGB-D sensor and the paper demonstrated that the traversability map works more robustly with a light-coding sensor than with a stereo pair in low-textured environments. As for another indoor localization application, Sánchez detected floor and navigable areas to efficiently reduce the search space and thereby yielded real-time performance of both place recognition and tracking [39]. …”

Geospatial Information and Technologies for International Safeguards Verification

“…Mobile laser scanning systems significantly increase the efficiency of 3D laser scanning applied to nuclear safeguards verification. They also allow computing the position of the sensor with respect to the acquired map [17]. This technique, known as Simultaneous Localisation and Mapping (SLAM), can be used for location-based services in indoor environments as described below.…”

Open Pit Mine 3d Mapping by TLS and Digital Photogrammetry: 3d Model Update Thanks to a Slam Based Approach

“…Heron is a slam based mobile mapping system developed by an Italian Company (Gexcel) in collaboration with the laboratories of the European Commission at the Joint Research Centre of Ispra (Italy) (Sánchez C. et al, 2016). Heron is a wearable Mobile Mapping System that supports Indoor and Outdoor mapping.…”