Abstract
Effective approaches to forecast model selection are crucial to improve forecast accuracy and to facilitate the use of forecasts for decision-making processes. Information criteria or cross-validation are common approaches of forecast model selection. Both methods compare forecasts with the respective actual realizations. However, no existing selection method assesses out-of-sample forecasts before the actual values become available-a technique used in human judgment in this context. Research in judgmentalmodel selection emphasizes that human judgment can be superior to statistical selection procedures in evaluating the quality of forecasting models. We, therefore, propose a new way of statistical model selection based on these insights from human judgment. Our approach relies on an asynchronous comparison of forecasts and actual values, allowing for an ex ante evaluation of forecasts via representativeness. We test this criterion on numerous time series. Results from our analyses provide evidence that forecast performance can be improved whenmodels are selected based on their representativeness.
Original language | English |
---|---|
Pages (from-to) | 2672-2690 |
Number of pages | 19 |
Journal | Management Science |
Volume | 69 |
Issue number | 5 |
Early online date | 18 Jul 2022 |
DOIs | |
Publication status | Published - 31 May 2023 |
Bibliographical note
Publisher Copyright:© 2022 INFORMS.
Keywords
- empirical evaluation
- forecasting
- information criteria
- model combination
- model selection
- representativeness
ASJC Scopus subject areas
- Strategy and Management
- Management Science and Operations Research