PowerBEV: A Powerful Yet Lightweight Framework for Instance Prediction in Bird’s-Eye View
Accurately perceiving instances and predicting their future motion are key tasks for autonomous vehicles, enabling them to navigate safely in complex urban traffic. While bird’s-eye view (BEV) representations are commonplace in perception for autonomous driving, their potential in a motion prediction setting is less explored. Existing approaches for BEV instance prediction from surround cameras rely on a multi-task auto-regressive setup coupled with complex post-processing to predict future instances in a spatio-temporally consistent manner. In this paper, we depart from this paradigm and propose an efficient novel end-to-end framework named PowerBEV, which differs in several design choices aimed at reducing the inherent redundancy in previous methods. First, rather than predicting the future in an auto-regressive fashion, PowerBEV uses a parallel, multi-scale module built from lightweight 2D convolutional networks. Second, we show that segmentation and centripetal backward flow are sufficient for prediction, simplifying previous multi-task objectives by eliminating redundant output modalities. Building on this output representation, we propose a simple, flow warping-based post-processing approach which produces more stable instance associations across time. Through this lightweight yet powerful design, PowerBEV outperforms state-of-the-art baselines on the NuScenes Dataset and poses an alternative paradigm for BEV instance prediction. We made our code publicly available at: https://github.com/EdwardLeeLPZ/PowerBEV.
- Published in:
International Joint Conference on Artificial Intelligence - Type:
Inproceedings - Authors:
Li, Peizheng; Ding, Shuxiao; Chen, Xieyuanli; Hanselmann, Niklas; Cordts, Marius; Gall, Jürgen - Year:
2023
Citation information
Li, Peizheng; Ding, Shuxiao; Chen, Xieyuanli; Hanselmann, Niklas; Cordts, Marius; Gall, Jürgen: PowerBEV: A Powerful Yet Lightweight Framework for Instance Prediction in Bird’s-Eye View, International Joint Conference on Artificial Intelligence, 2023, https://www.ijcai.org/proceedings/2023/120, Li.etal.2023a,
@Inproceedings{Li.etal.2023a,
author={Li, Peizheng; Ding, Shuxiao; Chen, Xieyuanli; Hanselmann, Niklas; Cordts, Marius; Gall, Jürgen},
title={PowerBEV: A Powerful Yet Lightweight Framework for Instance Prediction in Bird’s-Eye View},
booktitle={International Joint Conference on Artificial Intelligence},
url={https://www.ijcai.org/proceedings/2023/120},
year={2023},
abstract={Accurately perceiving instances and predicting their future motion are key tasks for autonomous vehicles, enabling them to navigate safely in complex urban traffic. While bird’s-eye view (BEV) representations are commonplace in perception for autonomous driving, their potential in a motion prediction setting is less explored. Existing approaches for BEV instance prediction from surround cameras...}}