MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer

التفاصيل البيبلوغرافية
العنوان: MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer
المؤلفون: Huang, Kuan-Chih, Wu, Tsung-Han, Su, Hung-Ting, Hsu, Winston H.
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition
الوصف: Monocular 3D object detection is an important yet challenging task in autonomous driving. Some existing methods leverage depth information from an off-the-shelf depth estimator to assist 3D detection, but suffer from the additional computational burden and achieve limited performance caused by inaccurate depth priors. To alleviate this, we propose MonoDTR, a novel end-to-end depth-aware transformer network for monocular 3D object detection. It mainly consists of two components: (1) the Depth-Aware Feature Enhancement (DFE) module that implicitly learns depth-aware features with auxiliary supervision without requiring extra computation, and (2) the Depth-Aware Transformer (DTR) module that globally integrates context- and depth-aware features. Moreover, different from conventional pixel-wise positional encodings, we introduce a novel depth positional encoding (DPE) to inject depth positional hints into transformers. Our proposed depth-aware modules can be easily plugged into existing image-only monocular 3D object detectors to improve the performance. Extensive experiments on the KITTI dataset demonstrate that our approach outperforms previous state-of-the-art monocular-based methods and achieves real-time detection. Code is available at https://github.com/kuanchihhuang/MonoDTR
Comment: Accepted to CVPR 2022
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2203.10981
رقم الانضمام: edsarx.2203.10981
قاعدة البيانات: arXiv