Characterizing Visual Localization and Mapping Datasets

Sajad Saeedi, Eduardo Carvalho, Wenbin Li, Dimos Tzoumanikas, Stefan Leutenegger, Paul Kelly, Andrew Davison

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Downloads (Pure)

Abstract

Benchmarking mapping and motion estimation algorithms is established practice in robotics and computer vision. As the diversity of datasets increases, in terms of the trajectories, models, and scenes, it becomes a challenge to select datasets for a given benchmarking purpose. Inspired by the Wasserstein distance, this paper addresses this concern by developing novel metrics to evaluate trajectories and the environments without relying on any SLAM or motion estimation algorithm. The metrics, which so far have been missing in the research community, can be applied to the plethora of datasets that exist. Additionally, to improve the robotics SLAM benchmarking, the paper presents a new dataset for visual localization and mapping algorithms. A broad range of real-world trajectories is used in very high-quality scenes and a rendering framework to create a set of synthetic datasets with groundtruth trajectory and dense map which are representative of key SLAM applications such as virtual reality (VR), micro aerial vehicle (MAV) flight, and ground robotics.
Original languageEnglish
Title of host publicationIEEE/RSJ International Conference on Robotics and Automation (ICRA)​
Publication statusAccepted/In press - 1 Jun 2019

Publication series

NameProceedings - International Conference on Robotics and Automation
PublisherIEEE
ISSN (Print)1050-4729

Cite this

Saeedi, S., Carvalho, E., Li, W., Tzoumanikas, D., Leutenegger, S., Kelly, P., & Davison, A. (Accepted/In press). Characterizing Visual Localization and Mapping Datasets. In IEEE/RSJ International Conference on Robotics and Automation (ICRA)​ (Proceedings - International Conference on Robotics and Automation).

Characterizing Visual Localization and Mapping Datasets. / Saeedi, Sajad; Carvalho, Eduardo; Li, Wenbin; Tzoumanikas, Dimos; Leutenegger, Stefan; Kelly, Paul; Davison, Andrew.

IEEE/RSJ International Conference on Robotics and Automation (ICRA)​. 2019. (Proceedings - International Conference on Robotics and Automation).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Saeedi, S, Carvalho, E, Li, W, Tzoumanikas, D, Leutenegger, S, Kelly, P & Davison, A 2019, Characterizing Visual Localization and Mapping Datasets. in IEEE/RSJ International Conference on Robotics and Automation (ICRA)​. Proceedings - International Conference on Robotics and Automation.
Saeedi S, Carvalho E, Li W, Tzoumanikas D, Leutenegger S, Kelly P et al. Characterizing Visual Localization and Mapping Datasets. In IEEE/RSJ International Conference on Robotics and Automation (ICRA)​. 2019. (Proceedings - International Conference on Robotics and Automation).
Saeedi, Sajad ; Carvalho, Eduardo ; Li, Wenbin ; Tzoumanikas, Dimos ; Leutenegger, Stefan ; Kelly, Paul ; Davison, Andrew. / Characterizing Visual Localization and Mapping Datasets. IEEE/RSJ International Conference on Robotics and Automation (ICRA)​. 2019. (Proceedings - International Conference on Robotics and Automation).
@inproceedings{1545b545963548bc9306aff69888fbc6,
title = "Characterizing Visual Localization and Mapping Datasets",
abstract = "Benchmarking mapping and motion estimation algorithms is established practice in robotics and computer vision. As the diversity of datasets increases, in terms of the trajectories, models, and scenes, it becomes a challenge to select datasets for a given benchmarking purpose. Inspired by the Wasserstein distance, this paper addresses this concern by developing novel metrics to evaluate trajectories and the environments without relying on any SLAM or motion estimation algorithm. The metrics, which so far have been missing in the research community, can be applied to the plethora of datasets that exist. Additionally, to improve the robotics SLAM benchmarking, the paper presents a new dataset for visual localization and mapping algorithms. A broad range of real-world trajectories is used in very high-quality scenes and a rendering framework to create a set of synthetic datasets with groundtruth trajectory and dense map which are representative of key SLAM applications such as virtual reality (VR), micro aerial vehicle (MAV) flight, and ground robotics.",
author = "Sajad Saeedi and Eduardo Carvalho and Wenbin Li and Dimos Tzoumanikas and Stefan Leutenegger and Paul Kelly and Andrew Davison",
year = "2019",
month = "6",
day = "1",
language = "English",
series = "Proceedings - International Conference on Robotics and Automation",
publisher = "IEEE",
booktitle = "IEEE/RSJ International Conference on Robotics and Automation (ICRA)​",

}

TY - GEN

T1 - Characterizing Visual Localization and Mapping Datasets

AU - Saeedi, Sajad

AU - Carvalho, Eduardo

AU - Li, Wenbin

AU - Tzoumanikas, Dimos

AU - Leutenegger, Stefan

AU - Kelly, Paul

AU - Davison, Andrew

PY - 2019/6/1

Y1 - 2019/6/1

N2 - Benchmarking mapping and motion estimation algorithms is established practice in robotics and computer vision. As the diversity of datasets increases, in terms of the trajectories, models, and scenes, it becomes a challenge to select datasets for a given benchmarking purpose. Inspired by the Wasserstein distance, this paper addresses this concern by developing novel metrics to evaluate trajectories and the environments without relying on any SLAM or motion estimation algorithm. The metrics, which so far have been missing in the research community, can be applied to the plethora of datasets that exist. Additionally, to improve the robotics SLAM benchmarking, the paper presents a new dataset for visual localization and mapping algorithms. A broad range of real-world trajectories is used in very high-quality scenes and a rendering framework to create a set of synthetic datasets with groundtruth trajectory and dense map which are representative of key SLAM applications such as virtual reality (VR), micro aerial vehicle (MAV) flight, and ground robotics.

AB - Benchmarking mapping and motion estimation algorithms is established practice in robotics and computer vision. As the diversity of datasets increases, in terms of the trajectories, models, and scenes, it becomes a challenge to select datasets for a given benchmarking purpose. Inspired by the Wasserstein distance, this paper addresses this concern by developing novel metrics to evaluate trajectories and the environments without relying on any SLAM or motion estimation algorithm. The metrics, which so far have been missing in the research community, can be applied to the plethora of datasets that exist. Additionally, to improve the robotics SLAM benchmarking, the paper presents a new dataset for visual localization and mapping algorithms. A broad range of real-world trajectories is used in very high-quality scenes and a rendering framework to create a set of synthetic datasets with groundtruth trajectory and dense map which are representative of key SLAM applications such as virtual reality (VR), micro aerial vehicle (MAV) flight, and ground robotics.

M3 - Conference contribution

T3 - Proceedings - International Conference on Robotics and Automation

BT - IEEE/RSJ International Conference on Robotics and Automation (ICRA)​

ER -