Deep domain adaptation in action space

Arshad Jamal, Vinay P. Namboodiri, Dipti Deodhare, K. S. Venkatesh

Research output: Contribution to conferencePaper

3 Citations (Scopus)

Abstract

In the general settings of supervised learning, human action recognition has been a widely studied topic. The classifiers learned in this setting assume that the training and test data have been sampled from the same underlying probability distribution. However, in most of the practical scenarios, this assumption is not true, resulting in a suboptimal performance of the classifiers. This problem, referred to as Domain Shift, has been extensively studied, but mostly for image/object classification task. In this paper, we investigate the problem of Domain Shift in action videos, an area that has remained under-explored, and propose two new approaches named Action Modeling on Latent Subspace (AMLS) and Deep Adversarial Action Adaptation (DAAA). In the AMLS approach, the action videos in the target domain are modeled as a sequence of points on a latent subspace and adaptive kernels are successively learned between the source domain point and the sequence of target domain points on the manifold. In the DAAA approach, an end-to-end adversarial learning framework is proposed to align the two domains. The action adaptation experiments were conducted using various combinations of multi-domain action datasets, including six common classes of Olympic Sports and UCF50 datasets and all classes of KTH, MSR and our own SonyCam datasets. In this paper, we have achieved consistent improvements over chosen baselines and obtained some state-of-the-art results for the datasets.

Original languageEnglish
Publication statusPublished - 1 Jan 2019
Event29th British Machine Vision Conference, BMVC 2018 - Newcastle, UK United Kingdom
Duration: 3 Sep 20186 Sep 2018

Conference

Conference29th British Machine Vision Conference, BMVC 2018
CountryUK United Kingdom
CityNewcastle
Period3/09/186/09/18

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Jamal, A., Namboodiri, V. P., Deodhare, D., & Venkatesh, K. S. (2019). Deep domain adaptation in action space. Paper presented at 29th British Machine Vision Conference, BMVC 2018, Newcastle, UK United Kingdom.