Practical variable selection for generalized additive models

Giampiero Marra, Simon N Wood

Research output: Contribution to journalArticle

195 Citations (Scopus)

Abstract

The problem of variable selection within the class of generalized additive models, when there are many covariates to choose from but the number of predictors is still somewhat smaller than the number of observations, is considered. Two very simple but effective shrinkage methods and an extension of the nonnegative garrote estimator are introduced. The proposals avoid having to use nonparametric testing methods for which there is no general reliable distributional theory. Moreover, component selection is carried out in one single step as opposed to many selection procedures which involve an exhaustive search of all possible models. The empirical performance of the proposed methods is compared to that of some available techniques via an extensive simulation study. The results show under which conditions one method can be preferred over another, hence providing applied researchers with some practical guidelines. The procedures are also illustrated analysing data on plasma beta-carotene levels from a cross-sectional study conducted in the United States.
Original languageEnglish
Pages (from-to)2372-2387
Number of pages16
JournalComputational Statistics & Data Analysis
Volume55
Issue number7
DOIs
Publication statusPublished - 1 Jul 2011

Keywords

  • shrinkage smoother
  • generalized additive model
  • penalized thin plate regression spline
  • nonnegative garrote estimator
  • practical variable selection

Fingerprint Dive into the research topics of 'Practical variable selection for generalized additive models'. Together they form a unique fingerprint.

Cite this