Markerless tracking system for augmented reality in the automotive industry

João Paulo Lima, Rafael Roberto, Francisco Simões, Mozart Almeida, Lucas Figueiredo, Jo o.Marcelo Teixeira, Veronica Teichrieb

Research output: Contribution to journalArticlepeer-review

79 Citations (SciVal)


This paper presents a complete natural feature based tracking system that supports the creation of augmented reality applications focused on the automotive sector. The proposed pipeline encompasses scene modeling, system calibration and tracking steps. An augmented reality application was built on top of the system for indicating the location of 3D coordinates in a given environment which can be applied to many different applications in cars, such as a maintenance assistant, an intelligent manual, and many others. An analysis of the system was performed during the Volkswagen/ISMAR Tracking Challenge 2014, which aimed to evaluate state-of-the-art tracking approaches on the basis of requirements encountered in automotive industrial settings. A similar competition environment was also created by the authors in order to allow further studies. Evaluation results showed that the system allowed users to correctly identify points in tasks that involved tracking a rotating vehicle, tracking data on a complete vehicle and tracking with high accuracy. This evaluation allowed also to understand the applicability limits of texture based approaches in the textureless automotive environment, a problem not addressed frequently in the literature. To the best of the authors’ knowledge, this is the first work addressing the analysis of a complete tracking system for augmented reality focused on the automotive sector which could be tested and validated in a major benchmark like the Volkswagen/ISMAR Tracking Challenge, providing useful insights on the development of such expert and intelligent systems.

Original languageEnglish
Pages (from-to)100-114
Number of pages15
JournalExpert Systems with Applications
Publication statusPublished - 1 Oct 2017

Bibliographical note

Funding Information:
The authors would like to thank Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) (processes 456800/2014-0, 140898/2014-0) for partially funding this research.

Publisher Copyright:
© 2017 Elsevier Ltd


  • Augmented reality
  • Automotive sector
  • Tracking

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence


Dive into the research topics of 'Markerless tracking system for augmented reality in the automotive industry'. Together they form a unique fingerprint.

Cite this