FALF ConvNets: Fatuous auxiliary loss based filter-pruning for efficient deep CNNs

Pravendra Singh, Vinay Sameer Raja Kadi, Vinay P. Namboodiri

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Obtaining efficient Convolutional Neural Networks (CNNs) are imperative to enable their application for a wide variety of tasks (classification, detection, etc.). While several methods have been proposed to solve this problem, we propose a novel strategy for solving the same that is orthogonal to the strategies proposed so far. We hypothesize that if we add a fatuous auxiliary task, to a network which aims to solve a semantic task such as classification or detection, the filters devoted to solving this frivolous task would not be relevant for solving the main task of concern. These filters could be pruned and pruning these would not reduce the performance on the original task. We demonstrate that this strategy is not only successful, it in fact allows for improved performance for a variety of tasks such as object classification, detection and action recognition. An interesting observation is that the task needs to be fatuous so that any semantically meaningful filters would not be relevant for solving this task. We thoroughly evaluate our proposed approach on different architectures (LeNet, VGG-16, ResNet, Faster RCNN, SSD-512, C3D, and MobileNet V2) and datasets (MNIST, CIFAR, ImageNet, GTSDB, COCO, and UCF101) and demonstrate its generalizability through extensive experiments. Moreover, our compressed models can be used at run-time without requiring any special libraries or hardware. Our model compression method reduces the number of FLOPS by an impressive factor of 6.03X and GPU memory footprint by more than 17X for VGG-16, significantly outperforming other state-of-the-art filter pruning methods. We demonstrate the usability of our approach for 3D convolutions and various vision tasks such as object classification, object detection, and action recognition.
Original languageEnglish
Article number103857
Pages (from-to)1-14
Number of pages14
JournalImage and Vision Computing
Volume93
Issue number103857
Early online date27 Nov 2019
DOIs
Publication statusPublished - 1 Jan 2020

Keywords

  • Convolutional neural network
  • Deep learning
  • Filter pruning
  • Image recognition
  • Model compression

ASJC Scopus subject areas

  • Signal Processing
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'FALF ConvNets: Fatuous auxiliary loss based filter-pruning for efficient deep CNNs'. Together they form a unique fingerprint.

Cite this