GATraj: A graph- and attention-based multi-agent trajectory prediction model

Hao Cheng, Mengmeng Liu, Lin Chen, Hellward Broszio, Monika Sester, Michael Ying Yang

Research output: Contribution to journalArticlepeer-review

64 Citations (SciVal)

Abstract

Trajectory prediction has been a long-standing problem in intelligent systems like autonomous driving and robot navigation. Models trained on large-scale benchmarks have made significant progress in improving prediction accuracy. However, the importance on efficiency for real-time applications has been less emphasized. This paper proposes an attention-based graph model, named GATraj, which achieves a good balance of prediction accuracy and inference speed. We use attention mechanisms to model the spatial–temporal dynamics of agents, such as pedestrians or vehicles, and a graph convolutional network to model their interactions. Additionally, a Laplacian mixture decoder is implemented to mitigate mode collapse and generate diverse multimodal predictions for each agent. GATraj achieves state-of-the-art prediction performance at a much higher speed when tested on the ETH/UCY datasets for pedestrian trajectories, and good performance at about 100 Hz inference speed when tested on the nuScenes dataset for autonomous driving. We conduct extensive experiments to analyze the probability estimation of the Laplacian mixture decoder and compare it with a Gaussian mixture decoder for predicting different multimodalities. Furthermore, comprehensive ablation studies demonstrate the effectiveness of each proposed module in GATraj.

Original languageEnglish
Pages (from-to)163-175
Number of pages13
JournalISPRS Journal of Photogrammetry and Remote Sensing
Volume205
Early online date12 Oct 2023
DOIs
Publication statusPublished - 1 Nov 2023

Funding

This work is partially supported by the MSCA European Postdoctoral Fellowships under the 101062870 – VeVuSafety project and partially performed in the framework of project KaBa (Kamerabasierte Bewegungsanalyse aller Verkehrsteilnehmer für automatisiertes Fahren) supported by the European Regional Development Fund at VISCODA company.

FundersFunder number
H2020 Marie Skłodowska-Curie Actions101062870
European Regional Development Fund

    Keywords

    • Autonomous driving
    • Graph model
    • Mixture density network
    • Pedestrian
    • Trajectory prediction

    ASJC Scopus subject areas

    • Atomic and Molecular Physics, and Optics
    • Engineering (miscellaneous)
    • Computer Science Applications
    • Computers in Earth Sciences

    Fingerprint

    Dive into the research topics of 'GATraj: A graph- and attention-based multi-agent trajectory prediction model'. Together they form a unique fingerprint.

    Cite this