Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 7-Day Trial for You or Your Team.

Learn More →

Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian Model Averaging

Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian... Bayesian model averaging (BMA) is a statistical postprocessing technique that generates calibrated and sharp predictive probability density functions (PDFs) from forecast ensembles. It represents the predictive PDF as a weighted average of PDFs centered on the bias-corrected ensemble members, where the weights reflect the relative skill of the individual members over a training period. This work adapts the BMA approach to situations that arise frequently in practice; namely, when one or more of the member forecasts are exchangeable, and when there are missing ensemble members. Exchangeable members differ in random perturbations only, such as the members of bred ensembles, singular vector ensembles, or ensemble Kalman filter systems. Accounting for exchangeability simplifies the BMA approach, in that the BMA weights and the parameters of the component PDFs can be assumed to be equal within each exchangeable group. With these adaptations, BMA can be applied to postprocess multimodel ensembles of any composition. In experiments with surface temperature and quantitative precipitation forecasts from the University of Washington mesoscale ensemble and ensemble Kalman filter systems over the Pacific Northwest, the proposed extensions yield good results. The BMA method is robust to exchangeability assumptions, and the BMA postprocessed combined ensemble shows better verification results than any of the individual, raw, or BMA postprocessed ensemble systems. These results suggest that statistically postprocessed multimodel ensembles can outperform individual ensemble systems, even in cases in which one of the constituent systems is superior to the others. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Monthly Weather Review American Meteorological Society

Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian Model Averaging

Download PDF
13 pages

Loading next page...
 
/lp/american-meteorological-society/calibrating-multimodel-forecast-ensembles-with-exchangeable-and-zN0s5jD2Tq

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
American Meteorological Society
Copyright
Copyright © 2009 American Meteorological Society
ISSN
1520-0493
DOI
10.1175/2009MWR3046.1
Publisher site
See Article on Publisher Site

Abstract

Bayesian model averaging (BMA) is a statistical postprocessing technique that generates calibrated and sharp predictive probability density functions (PDFs) from forecast ensembles. It represents the predictive PDF as a weighted average of PDFs centered on the bias-corrected ensemble members, where the weights reflect the relative skill of the individual members over a training period. This work adapts the BMA approach to situations that arise frequently in practice; namely, when one or more of the member forecasts are exchangeable, and when there are missing ensemble members. Exchangeable members differ in random perturbations only, such as the members of bred ensembles, singular vector ensembles, or ensemble Kalman filter systems. Accounting for exchangeability simplifies the BMA approach, in that the BMA weights and the parameters of the component PDFs can be assumed to be equal within each exchangeable group. With these adaptations, BMA can be applied to postprocess multimodel ensembles of any composition. In experiments with surface temperature and quantitative precipitation forecasts from the University of Washington mesoscale ensemble and ensemble Kalman filter systems over the Pacific Northwest, the proposed extensions yield good results. The BMA method is robust to exchangeability assumptions, and the BMA postprocessed combined ensemble shows better verification results than any of the individual, raw, or BMA postprocessed ensemble systems. These results suggest that statistically postprocessed multimodel ensembles can outperform individual ensemble systems, even in cases in which one of the constituent systems is superior to the others.

Journal

Monthly Weather Review – American Meteorological Society

Published: Apr 28, 2009

References

  • A method for producing and evaluating probabilistic forecasts from ensemble model integrations.
    Anderson
  • A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems.
    Buizza
  • Maximum likelihood for incomplete data via the EM algorithm (with discussion).
    Dempster
  • A data assimilation case study using a limited-area ensemble Kalman filter.
    Dirren
  • The rationale behind the success of multi-model ensembles in seasonal forecasting II: Calibration and combination.
    Doblas-Reyes
  • Effective mesoscale, short-range ensemble forecasting.
    Eckel
  • Sequential data assimilation with a non-linear quasi-geostrophic model using Monte Carlo methods to forecast error statistics.
    Evensen
  • EnsembleBMA: An R package for probabilistic forecasting using ensembles and Bayesian model averaging.
    Fraley
  • Strictly proper scoring rules, prediction, and estimation.
    Gneiting
  • Probabilistic forecasts, calibration and sharpness.
    Gneiting
  • Initial results for a mesoscale short-range ensemble forecasting system over the Pacific Northwest.
    Grimit
  • The continuous ranked probability score for circular variables and its application to mesoscale forecast ensemble verification.
    Grimit
  • The rationale behind the success of multi-model ensembles in seasonal forecasting I: Basic concept.
    Hagedorn
  • Interpretation of rank histograms for verifying ensemble forecasts.
    Hamill
  • Ensemble-based atmospheric data assimilation: A tutorial.
    Hamill
  • Comments on “Calibrated surface temperature forecasts from the Canadian ensemble prediction system using Bayesian model averaging”.
    Hamill
  • Verification of Eta-RSM short-range ensemble forecasts.
    Hamill
  • SRNWP-PEPS: A regional multi-model ensemble in Europe.
    Heizenreder
  • Decomposition of the continuous ranked probability score for ensemble predictions.
    Hersbach
  • Strategies in naturalistic decision-making: A cognitive task analysis of naval weather forecasting.
    Joslyn
  • Replacing missing data for ensemble systems.
    McCandless
  • The EM Algorithm and Extensions.
    McLachlan
  • The ECMWF ensemble system: Methodology and validation.
    Molteni
  • TIGGE: Preliminary results on comparing and combining ensembles.
    Park
  • Using Bayesian model averaging to calibrate forecast ensembles.
    Raftery
  • Analysis of Incomplete Multivariate Data by Simulation.
    Schafer
  • Probabilistic quantitative precipitation forecasting using Bayesian model averaging.
    Sloughter
  • Probabilistic wind speed forecasting using ensembles and Bayesian model averaging.
    Sloughter
  • Evaluation of probabilistic prediction systems.
    Talagrand
  • Performance characteristics of a pseudo-operational ensemble Kalman filter.
    Torn
  • Boundary conditions for limited-area ensemble Kalman filters.
    Torn
  • Ensemble forecasting at the NMC: The generation of perturbations.
    Toth
  • Ensemble Bayesian model averaging using Markov chain Monte Carlo sampling.
    Vrugt
  • Can multi-model combination really enhance the prediction skill of forecasts?
    Weigel
  • Statistical Methods in the Atmospheric Sciences.
    Wilks
  • Calibrated surface temperature forecasts from the Canadian ensemble prediction system using Bayesian model averaging.
    Wilson
  • Reply.
    Wilson