Interacting with Real Objects in Virtual Worlds

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In a virtual reality (VR) experience, the manner in which a user in-
teracts with the virtual environment and computer generated objects in the scene greatly effects the feeling of immersion. Traditionally, VR systems use controllers as a means of facilitating interaction, with a sequence of button presses corresponding to a particular action. However, controllers do not accurately model the intuitive way to interact with a real-world object and offer limited tactile feedback. Alternatively, a physical object can be tracked and used to regulate the behaviour of a virtual object. In this chapter, we review a range of approaches which use the tracked behaviour of a physical object to control elements of the virtual environment. These virtual props
have the potential to be used as a more immersive alternative to the traditional controllers. We discuss how motion capture systems and external sensors can be used to track rigid and non-rigid objects, in order to drive the motion of computer generated 3D models. We then consider two neural network based tracking solutions and explain how these can be used for transporting real objects into virtual environments.
Original languageEnglish
Title of host publicationReal VR – Immersive Digital Reality: How to Import the Real World into Head-Mounted Immersive Displays (Lecture Notes in Computer Science)
EditorsM. Magnor, A. Sorkine-Hornung
Place of PublicationCham, Switzerland
PublisherSpringer
Chapter15
Pages337-353
Number of pages17
Edition1st
ISBN (Print)9783030418151
DOIs
Publication statusPublished - 11 Mar 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11900

Cite this

Taylor, C. (2020). Interacting with Real Objects in Virtual Worlds. In M. Magnor, & A. Sorkine-Hornung (Eds.), Real VR – Immersive Digital Reality: How to Import the Real World into Head-Mounted Immersive Displays (Lecture Notes in Computer Science) (1st ed., pp. 337-353). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11900). Springer. https://doi.org/10.1007/978-3-030-41816-8_15