Letter | Published:

Quantification of modelling uncertainties in a large ensemble of climate change simulations

Naturevolume 430pages768772 (2004) | Download Citation



Comprehensive global climate models1 are the only tools that account for the complex set of processes which will determine future climate change at both a global and regional level. Planners are typically faced with a wide range of predicted changes from different models of unknown relative quality2,3, owing to large but unquantified uncertainties in the modelling process4. Here we report a systematic attempt to determine the range of climate changes consistent with these uncertainties, based on a 53-member ensemble of model versions constructed by varying model parameters. We estimate a probability density function for the sensitivity of climate to a doubling of atmospheric carbon dioxide levels, and obtain a 5–95 per cent probability range of 2.4–5.4 °C. Our probability density function is constrained by objective estimates of the relative reliability of different model versions, the choice of model parameters that are varied and their uncertainty ranges, specified on the basis of expert advice. Our ensemble produces a range of regional changes much wider than indicated by traditional methods based on scaling the response patterns of an individual simulation5,6.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.


All prices are NET prices.


  1. 1

    Gordon, C. et al. The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments. Clim. Dyn. 16, 147–168 (2000)

  2. 2

    Giorgi, F. & Francisco, R. Evaluating uncertainties in the prediction of regional climate change. Geophys. Res. Lett. 27, 1295–1298 (2000)

  3. 3

    Allen, M. R. & Ingram, W. J. Constraints on future changes in climate and the hydrological cycle. Nature 419, 224–232 (2002)

  4. 4

    Cubasch, U. et al. in Climate Change 2001, The Science of Climate Change Ch. 9 (eds Houghton, J. T. et al.) 527–582 (Cambridge Univ. Press, Cambridge, 2001)

  5. 5

    Allen, M. R., Stott, P. A., Mitchell, J. F. B., Schnur, R. & Delworth, T. L. Quantifying the uncertainty in forecasts of anthropogenic climate change. Nature 417, 617–620 (2000)

  6. 6

    Mearns, L. O. et al. in Climate Change 2001, The Science of Climate Change Ch. 13 (eds Houghton, J. T. et al.) 739–768 (Cambridge Univ. Press, Cambridge, 2001)

  7. 7

    Meehl, G. A. et al. Trends in extreme weather and climate events: issues related to modelling extremes in projections of future climate change. Bull. Am. Meteorol. Soc. 81, 427–436 (2000)

  8. 8

    Stocker, T. F. et al. in Climate Change 2001, The Science of Climate Change Ch. 7 (eds Houghton, J. T. et al.) 417–470 (Cambridge Univ. Press, Cambridge, 2001)

  9. 9

    Randall, D. A. & Wielicki, B. A. Measurements, models and hypotheses in the atmospheric sciences. Bull. Am. Meteorol. Soc. 78, 399–406 (1997)

  10. 10

    Wigley, T. M. L. & Raper, S. C. B. Interpretation of high projections for global-mean warming. Science 293, 451–454 (2001)

  11. 11

    Palmer, T. N. A nonlinear dynamical perspective on model error: A proposal for non-local stochastic-dynamic parametrization in weather and climate prediction models. Q.J.R. Meteorol. Soc. 127, 279–303 (2001)

  12. 12

    Pope, V. D., Gallani, M., Rowntree, P. R. & Stratton, R. A. The impact of new physical parameterisations in the Hadley Centre climate model—HadAM3. Clim. Dyn. 16, 123–146 (2000)

  13. 13

    Keen, A. B. & Murphy, J. M. Influence of natural variability and the cold start problem on the simulated transient response to increasing CO2 . Clim. Dyn. 13, 847–864 (1997)

  14. 14

    Milly, P. C. D. Wetherald, R. T. Dunne, K. A. & Delworth, T. L. Increasing risk of great floods in a changing climate. Nature 415, 514–517 (2002)

  15. 15

    Leroy, S. S. Detecting climate signals: Some Bayesian aspects. J. Clim. 11, 640–651 (1998)

  16. 16

    Stott, P. A. & Kettleborough, J. A. Origins and estimates of uncertainty in predictions of twenty-first century temperature rise. Nature 416, 723–726 (2002)

  17. 17

    Giorgi, F. & Mearns, L. O. Calculation of average, uncertainty range, and reliability of regional climate changes from AOGCM simulations via the “Reliability Ensemble Averaging” (REA) method. J. Clim. 15, 1141–1158 (2002)

  18. 18

    Giorgi, F. & Mearns, L. O. Probability of regional climate change based on the Reliability Ensemble Averaging (REA) method. Geophys. Res. Lett. 30, 1629 (2003)

  19. 19

    Andronova, N. G. & Schlesinger, M. E. Objective estimation of the probability density function for climate sensitivity. J. Geophys. Res. 106, 22605–22612 (2001)

  20. 20

    Forest, C. E., Stone, P. H., Sokolov, A. P., Allen, M. R. & Webster, M. D. Quantifying uncertainties in climate system properties with the use of recent climate observations. Science 295, 113–117 (2002)

  21. 21

    Knutti, R., Stocker, T. F., Joos, F. & Plattner, G. K. Constraints on radiative forcing and future climate change from observations and climate model ensembles. Nature 416, 719–723 (2002)

  22. 22

    Gregory, J. M., Stouffer, R. J., Raper, S. C. B., Stott, P. A. & Rayner, N. A. An observationally based estimate of the climate sensitivity. J. Clim. 15, 3117–3121 (2002)

  23. 23

    Anderson, T. L. et al. Climate forcing by aerosols—a hazy picture. Science 300, 110–111 (2003)

  24. 24

    Barnett, T. P., Pierce, D. W. & Schnur, R. Detection of anthropogenic climate change in the world's oceans. Science 292, 270–274 (2001)

  25. 25

    Boer, G. J. & Yu, B. Dynamical aspects of climate sensitivity. Geophys. Res. Lett. 30, 1135 (2003)

  26. 26

    Stouffer, R. J. & Manabe, S. Response of a coupled ocean-atmosphere model to increasing atmospheric carbon dioxide: sensitivity to the rate of increase. J. Clim. 12, 2224–2237 (1999)

  27. 27

    Watterson, I. G. Interpretation of simulated global warming using a simple model. J. Clim. 13, 202–215 (2000)

  28. 28

    Senior, C. A. & Mitchell, J. F. B. The time-dependence of climate sensitivity. Geophys. Res. Lett. 27, 2685–2689 (2000)

  29. 29

    Stainforth, D. A. et al. Evaluating uncertainty in the climate response to changing levels of greenhouse gases. Nature (submitted)

  30. 30

    Allen, M. R. & Stainforth, D. A. Towards objective probabilistic climate forecasting. Nature 419, 228 (2002)

Download references


We thank A. Thorpe and M. Allen for encouraging the development of this project. We also acknowledge many Hadley Centre colleagues for their advice on model parameters and their uncertainty ranges, and for comments on earlier versions of the manuscript. This work was supported by the UK Department of the Environment, Food and Rural Affairs. D.A.S. was funded by the NERC COAPEC thematic programme.

Author information


  1. Hadley Centre for Climate Prediction and Research, Met Office, FitzRoy Road, Exeter, EX1 3PB, UK

    • James M. Murphy
    • , David M. H. Sexton
    • , David N. Barnett
    • , Gareth S. Jones
    • , Mark J. Webb
    •  & Matthew Collins
  2. Department of Physics, University of Oxford, Parks Road, Oxford, OX1 3PU, UK

    • David A. Stainforth


  1. Search for James M. Murphy in:

  2. Search for David M. H. Sexton in:

  3. Search for David N. Barnett in:

  4. Search for Gareth S. Jones in:

  5. Search for Mark J. Webb in:

  6. Search for Matthew Collins in:

  7. Search for David A. Stainforth in:

Competing interests

The authors declare that they have no competing financial interests.

Corresponding author

Correspondence to James M. Murphy.

Supplementary information

  1. Supplementary Information

    Contains supporting detail of the GCM ensemble integrations including the parameters perturbations implemented. We also document in more detail the Climate Prediction Index, the methodology used to contruct pdfs of climate sensitivity and tests of the impact of biases in sea surface temperature. (DOC 248 kb)

About this article

Publication history



Issue Date



Further reading


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.