VGPN: Voice-Guided Pointing Robot Navigation for Humans

Jun Hu, Zhongyu Jiang, Xionghao Ding, Taijiang Mu, Peter Hall

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

10 Citations (SciVal)


Pointing gestures are widely used in robot navigation approaches nowadays. However, most approaches only use pointing gestures, and these have two major limitations. Firstly, they need to recognize pointing gestures all the time, which leads to long processing time and significant system overheads. Secondly, the user's pointing direction may not be very accurate, so the robot may go to an undesired place. To relieve these limitations, we propose a voice-guided pointing robot navigation approach named VGPN, and implement its prototype on a wheeled robot, TurtleBot 2. VGPN recognizes a pointing gesture only if voice information is insufficient for navigation. VGPN also uses voice information as a supplementary channel to help determine the target position of the user's pointing gesture. In the evaluation, we compare VGPN to the pointing-only navigation approach. The results show that VGPN effectively reduces the processing time cost when pointing gesture is unnecessary, and improves the user satisfaction with navigation accuracy.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018
Number of pages6
ISBN (Electronic)9781728103761
Publication statusPublished - 14 Mar 2019
Event2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018 - Kuala Lumpur, Malaysia
Duration: 12 Dec 201815 Dec 2018


Conference2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018
CityKuala Lumpur


  • navigation
  • pointing gesture
  • robot
  • voice

ASJC Scopus subject areas

  • Biotechnology
  • Artificial Intelligence
  • Human-Computer Interaction


Dive into the research topics of 'VGPN: Voice-Guided Pointing Robot Navigation for Humans'. Together they form a unique fingerprint.

Cite this