RGBT-Dog: A Parametric Model and Pose Prior for Canine Body Analysis Data Creation

Jake Deane, Sinead Kearney, Kwang In Kim, Darren Cosker

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

Abstract

While there exists a great deal of labeled in-the-wild human data, the same is not true for animals. Manually creating new labels for the full range of animal species would take years of effort from the community. We are also now seeing the emerging potential for computer vision methods in areas like animal conservation, which is an additional motivation for this direction of research. Key to our approach is the ability to easily generate as many labeled training images as we desire across a range of different modalities. To achieve this, we present a new large scale canine motion capture dataset and parametric canine body and texture model. These are used to produce the first large scale, multi-domain, multi-task dataset for canine body analysis comprising of detailed synthetic labels on both real images and fully synthetic images in a range of realistic poses. We also introduce the first pose prior for animals in the form of a variational pose prior for canines which is used to fit the parametric model to images of canines. We demonstrate the effectiveness of our labels for training computer vision models on tasks such as parts-based segmentation and pose estimation and show such models can generalise to other animal species without additional training.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
Place of PublicationU. S. A.
PublisherIEEE
Pages6044-6054
Number of pages11
ISBN (Electronic)9798350318920
DOIs
Publication statusPublished - 9 Apr 2024
Event2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024 - Waikoloa, USA United States
Duration: 4 Jan 20248 Jan 2024

Publication series

NameProceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024

Conference

Conference2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
Country/TerritoryUSA United States
CityWaikoloa
Period4/01/248/01/24

Keywords

  • Algorithms
  • Animals / Insects
  • Applications
  • Biometrics
  • body pose
  • face
  • gesture
  • Image recognition and understanding

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Cite this