Sparse Instance Activation for Real-Time Instance Segmentation

Cheng, Tianheng; Wang, Xinggang; Chen, Shaoyu; Zhang, Wenqiang; Zhang, Qian; Huang, Chang; Zhang, Zhaoxiang; Liu, Wenyu

doi:10.48550/arxiv.2203.12827

Cited by 1 publication

(4 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The system contains two main modules: the instance segmentation module as a stemming module and the 3D localization prediction module. The instance segmentation module is built based on a powerful feature extractor, the ResNet-50 [37] backbone, followed by a real-time instance segmentation head, SparseInst [38]. It takes RGB images as input and outputs the instance segmentation images, which are used as an intermediate representation.…”

Section: ) End-to-end Systemmentioning

confidence: 99%

“…Previously, most instance segmentation methods heavily rely on object detection and perform mask prediction based on bounding boxes or dense centers. In contrast, SparseInst [38] -a real-time instance segmentation head, highlight informative regions for each foreground object. Instance-level features are obtained by aggregating features according to the highlighted regions for recognition and segmentation.…”

Section: Integration Of Stemming Modulementioning

confidence: 99%

“…Instance-level features are obtained by aggregating features according to the highlighted regions for recognition and segmentation. With the desire to use instance segmentation as the intermediate representation z for the 3D distance prediction module, we integrate SparseInst [38] as the stemming module since it is a simple, compact, and unified framework that consists of a backbone network, an instance context encoder, and an IAM-based decoder.…”

Section: Integration Of Stemming Modulementioning

confidence: 99%

“…As mentioned in [38], ResNet is utilized to be the backbone of SparseInst. ResNet [37], also called Residual Networks, serves as the backbone for many computer vision applications.…”

Section: ) Backbone Networkmentioning

confidence: 99%

See 3 more Smart Citations

MonoIS3DLoc: Simulation to Reality Learning Based Monocular Instance Segmentation to 3D Objects Localization From Aerial View

Tran

Nguyen

et al. 2023

IEEE Access

View full text Add to dashboard Cite

3D object detection and localization based on only a monocular camera always faces its fundamental ill-posed issue to estimate 3D information. In combination with deep neural networks, recent researches have shown encouraging results to tackle this issue. However, most of them are only applied to street-view cameras based on several available small-size datasets and the 3D prediction accuracy of these methods is still low in comparison to traditional estimation methods using stereo-cameras. With the development of drone delivery applications in city spaces, it is also necessary to have a similar method to detect objects and estimate their 3D position from an aerial view. We proposed a novel Simulation to Reality approach to predict the object's 3D position from an aerial view. An instance segmentation of an object is used as an intermediate representation not only to create a very large dataset for training by simulation but also to minimize the gap between simulation and reality. We designed a feed-forward neural network to predict the 3D position from instance segmentation and integrated it with a range-attention classification to improve accuracy, especially for 3D object detection at far distances. To evaluate our methods, we created two simulation datasets: one for cross-validation with other state-of-the-art methods and the other one for practical experiments on a real drone with a monocular camera. The experiment's results demonstrate that we not only achieve better accuracy than the state-of-the-art methods using the monocular camera by testing on the same KITTI-3D dataset but also reach close to the accuracy of a stereo-based technique. Since our model is lightweight, we successfully deployed it on a companion computer on the real drone and the results of practical experiences are promising.

show abstract

Section: ) End-to-end Systemmentioning

confidence: 99%

Section: Integration Of Stemming Modulementioning

confidence: 99%

Section: Integration Of Stemming Modulementioning

confidence: 99%

“…As mentioned in [38], ResNet is utilized to be the backbone of SparseInst. ResNet [37], also called Residual Networks, serves as the backbone for many computer vision applications.…”

Section: ) Backbone Networkmentioning

confidence: 99%

See 2 more Smart Citations