Real-Time online action detection forests using spatio-Temporal contexts

Seungryul Baek, Kwang In Kim, Tae Kyun Kim

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

16 Citations (SciVal)


Online action detection (OAD) is challenging since 1) robust yet computationally expensive features cannot be straightforwardly used due to the real-Time processing requirements and 2) the localization and classification of actions have to be performed even before they are fully observed. We propose a new random forest (RF)-based online action detection framework that addresses these challenges. Our algorithm uses computationally efficient skeletal joint features. High accuracy is achieved by using robust convolutional neural network (CNN)-based features which are extracted from the raw RGBD images, plus the temporal relationships between the current frame of interest, and the past and futures frames. While these high-quality features are not available in real-Time testing scenario, we demonstrate that they can be effectively exploited in training RF classifiers: We use these spatio-Temporal contexts to craft RF's new split functions improving RFs' leaf node statistics. Experiments with challenging MSRAction3D, G3D, and OAD datasets demonstrate that our algorithm significantly improves the accuracy over the state-of-The-Art on-line action detection algorithms while achieving the real-Time efficiency of existing skeleton-based RF classifiers.

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), 2017
Number of pages10
ISBN (Electronic)9781509048229
Publication statusPublished - 11 May 2017
Event17th IEEE Winter Conference on Applications of Computer Vision, WACV 2017 - Santa Rosa, USA United States
Duration: 24 Mar 201731 Mar 2017


Conference17th IEEE Winter Conference on Applications of Computer Vision, WACV 2017
Country/TerritoryUSA United States
CitySanta Rosa

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Real-Time online action detection forests using spatio-Temporal contexts'. Together they form a unique fingerprint.

Cite this