3D Reconstruction for Road Scene with Obstacle Detection Feedback

Gao, Huanbing; Liu, Lei; Tian, Yuan; Lu, Shouyin

doi:10.1142/s0218001418550212

Cited by 4 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…3 D reconstruction of road environment [1], [2], [3] has received increasing attention in the assisted and autonomous driving field [4], [5] as it is crucial for obstacle detection [6], distance measurement [7], [8], and road condition recognition [9], etc. Existing methods commonly exploit 3D sensors such as LiDAR or adopt vision-based 3D reconstruction algorithms.…”

Section: Introductionmentioning

confidence: 99%

Monocular Road Planar Parallax Estimation

Yuan¹,

Chen²,

Wei³

et al. 2021

Preprint

View full text Add to dashboard Cite

Estimating the 3D structure of the drivable surface and surrounding environment is a crucial task for assisted and autonomous driving. It is commonly solved either by using expensive 3D sensors such as LiDAR or directly predicting the depth of points via deep learning. Instead of following existing methodologies, we propose Road Planar Parallax Attention Network (RPANet), a new deep neural network for 3D sensing from monocular image sequences based on planar parallax, which takes full advantage of the commonly seen road plane geometry in driving scenes. RPANet takes a pair of images aligned by the homography of the road plane as input and outputs a γ map for 3D reconstruction. Beyond estimating the depth or height, the γ map has a potential to construct a two-dimensional transformation between two consecutive frames while can be easily derived to depth or height. By warping the consecutive frames using the road plane as a reference, the 3D structure can be estimated from the planar parallax and the residual image displacements. Furthermore, to make the network better perceive the displacements caused by planar parallax, we introduce a novel cross-attention module. We sample data from the Waymo Open Dataset and construct data related to planar parallax. Comprehensive experiments are conducted on the sampled dataset to demonstrate the 3D reconstruction accuracy of our approach in challenging scenarios.

show abstract