Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models

We use "glide charts" (plots of sequences of root mean squared forecast errors as the target date is approached) to evaluate and compare fixed-target forecasts of Arctic sea ice. We first use them to evaluate the simple feature-engineered linear regression (FELR) forecasts of Diebold and G...

Full description

Bibliographic Details
Main Authors: Diebold, Francis X., Goebel, Maximilian, Coulombe, Philippe Goulet
Format: Text
Language:unknown
Published: 2022
Subjects:
Economics - Econometrics
Statistics - Applications
Arctic
Sea ice
Online Access:http://arxiv.org/abs/2206.10721
id ftarxivpreprints:oai:arXiv.org:2206.10721
record_format openpolar
spelling ftarxivpreprints:oai:arXiv.org:2206.10721 2023-09-05T13:17:04+02:00 Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models Diebold, Francis X. Goebel, Maximilian Coulombe, Philippe Goulet 2022-06-21 http://arxiv.org/abs/2206.10721 unknown http://arxiv.org/abs/2206.10721 Economics - Econometrics Statistics - Applications text 2022 ftarxivpreprints 2023-08-16T17:08:43Z We use "glide charts" (plots of sequences of root mean squared forecast errors as the target date is approached) to evaluate and compare fixed-target forecasts of Arctic sea ice. We first use them to evaluate the simple feature-engineered linear regression (FELR) forecasts of Diebold and Goebel (2021), and to compare FELR forecasts to naive pure-trend benchmark forecasts. Then we introduce a much more sophisticated feature-engineered machine learning (FEML) model, and we use glide charts to evaluate FEML forecasts and compare them to a FELR benchmark. Our substantive results include the frequent appearance of predictability thresholds, which differ across months, meaning that accuracy initially fails to improve as the target date is approached but then increases progressively once a threshold lead time is crossed. Also, we find that FEML can improve appreciably over FELR when forecasting "turning point" months in the annual cycle at horizons of one to three months ahead. Text Arctic Sea ice ArXiv.org (Cornell University Library) Arctic
institution Open Polar
collection ArXiv.org (Cornell University Library)
op_collection_id ftarxivpreprints
language unknown
topic Economics - Econometrics
Statistics - Applications
spellingShingle Economics - Econometrics
Statistics - Applications
Diebold, Francis X.
Goebel, Maximilian
Coulombe, Philippe Goulet
Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
topic_facet Economics - Econometrics
Statistics - Applications
description We use "glide charts" (plots of sequences of root mean squared forecast errors as the target date is approached) to evaluate and compare fixed-target forecasts of Arctic sea ice. We first use them to evaluate the simple feature-engineered linear regression (FELR) forecasts of Diebold and Goebel (2021), and to compare FELR forecasts to naive pure-trend benchmark forecasts. Then we introduce a much more sophisticated feature-engineered machine learning (FEML) model, and we use glide charts to evaluate FEML forecasts and compare them to a FELR benchmark. Our substantive results include the frequent appearance of predictability thresholds, which differ across months, meaning that accuracy initially fails to improve as the target date is approached but then increases progressively once a threshold lead time is crossed. Also, we find that FEML can improve appreciably over FELR when forecasting "turning point" months in the annual cycle at horizons of one to three months ahead.
format Text
author Diebold, Francis X.
Goebel, Maximilian
Coulombe, Philippe Goulet
author_facet Diebold, Francis X.
Goebel, Maximilian
Coulombe, Philippe Goulet
author_sort Diebold, Francis X.
title Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
title_short Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
title_full Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
title_fullStr Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
title_full_unstemmed Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
title_sort assessing and comparing fixed-target forecasts of arctic sea ice: glide charts for feature-engineered linear regression and machine learning models
publishDate 2022
url http://arxiv.org/abs/2206.10721
geographic Arctic
geographic_facet Arctic
genre Arctic
Sea ice
genre_facet Arctic
Sea ice
op_relation http://arxiv.org/abs/2206.10721
_version_ 1776198389581479936

Similar Items