How well must climate models agree with observations?

The usefulness of a climate-model simulation cannot be inferred solely from its degree of agreement with observations. Instead, one has to consider additional factors such as internal variability, the tuning of the model, observational uncertainty, the temporal change in dominant processes or the un...

Full description

Bibliographic Details
Published in:Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
Main Author: Notz, Dirk
Format: Text
Language:English
Published: The Royal Society Publishing 2015
Subjects:
Online Access:http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4607702/
http://www.ncbi.nlm.nih.gov/pubmed/26347535
https://doi.org/10.1098/rsta.2014.0164
Description
Summary:The usefulness of a climate-model simulation cannot be inferred solely from its degree of agreement with observations. Instead, one has to consider additional factors such as internal variability, the tuning of the model, observational uncertainty, the temporal change in dominant processes or the uncertainty in the forcing. In any model-evaluation study, the impact of these limiting factors on the suitability of specific metrics must hence be examined. This can only meaningfully be done relative to a given purpose for using a model. I here generally discuss these points and substantiate their impact on model evaluation using the example of sea ice. For this example, I find that many standard metrics such as sea-ice area or volume only permit limited inferences about the shortcomings of individual models.