Real-time generation of interactive virtual human behaviours

Yue Zheng, Yulia Hicks, Dave Marshall, Darren Cosker

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In this paper, we propose a new approach for generating interactive behaviours for virtual characters, namely the windowed Viterbi algorithm, capable of doing so in real-time. Consequently, we compare the performance of the standard Viterbi algorithm and the windowed Viterbi algorithm within our system. Our system tracks and analyses the behaviour of a real person in video input and produces a fully articulated three dimensional (3D) character interacting with the person in the video input. Our system is model-based. Prior to tracking, we train a collection of dual-input Hidden Markov Model (HMM) on 3D motion capture (MoCap) data representing a number of interactions between two people. Then using the dual-input HMM, we generate a moving virtual character reacting to (the motion of) a real person. In this article, we present the detailed evaluation of using the windowed Viterbi algorithms within our system, and show that our approach is suitable for generating interactive behaviours in real-time. Furthermore, in order to enhance the tracking capabilities of the algorithm, we develop a novel technique that splits the complex motion data in an automated way. This results in improved tracking of the human motion from our model.
Original languageEnglish
Title of host publicationComputer Vision and Computer Graphics: Theory and Applications - International Conference, VISIGRAPP 2008, Revised Selected Papers
EditorsA. Ranchordas, H.J. Araújo, J.M. Pereira, J. Braz
Place of PublicationHeidelberg, German
PublisherSpringer
Pages70-82
Number of pages13
Volume24
ISBN (Electronic)978-3-642-10226-4
ISBN (Print)978-3-642-10225-7
DOIs
Publication statusPublished - 2009
Event3rd International Joint Conference on Computer Vision and Computer Graphics: Theory and Applications, VISIGRAPP 2008, January 22, 2008 - January 25, 2008 - Funchal-Madeira, Portugal
Duration: 1 Jan 2009 → …

Publication series

NameCommunications in Computer and Information Science
PublisherSpringer Verlag

Conference

Conference3rd International Joint Conference on Computer Vision and Computer Graphics: Theory and Applications, VISIGRAPP 2008, January 22, 2008 - January 25, 2008
CountryPortugal
CityFunchal-Madeira
Period1/01/09 → …

Fingerprint Dive into the research topics of 'Real-time generation of interactive virtual human behaviours'. Together they form a unique fingerprint.

Cite this