Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/american-meteorological-society/scoring-rules-for-forecast-verification-mHs1YYfzIR
References (22)
-
L. Leung, G. North (1990)
Information Theory and Climate PredictionJournal of Climate, 3
-
S. Jewson (2004)
The problem with the Brier scorearXiv: Atmospheric and Oceanic Physics
-
C. Shannon (1948)
A mathematical theory of communicationBell Syst. Tech. J., 27
-
Good (1952)
Rational decisions.J. Roy. Stat. Soc., 14A
-
L. Gandin, A. Murphy (1992)
Equitable Skill Scores for Categorical ForecastsMonthly Weather Review, 120
-
J. Bernardo (1979)
Expected Information as Expected UtilityAnnals of Statistics, 7
-
J. Gibbs (1902)
Elementary Principles in Statistical Mechanics -
Talagrand (1999)
Evaluation of probabilistic prediction system. -
G. Brier, R. Allen (1951)
Verification of Weather Forecasts -
S. Kullback, R. Leibler (1951)
On Information and SufficiencyAnnals of Mathematical Statistics, 22
-
Lindley (1985)
Making Decisions. -
E. Jaynes (1957)
Information Theory and Statistical MechanicsPhysical Review, 106
-
Shannon (1948)
A mathematical theory of communication.Bell Syst. Technol. J., 27
-
J. Bröcker, Leonard Smith (2007)
Scoring Probabilistic Forecasts: The Importance of Being ProperWeather and Forecasting, 22
-
M. Roulston, Leonard Smith (2002)
Evaluating Probabilistic Forecasts Using Information TheoryMonthly Weather Review, 130
-
E. Epstein (1969)
A Scoring System for Probability Forecasts of Ranked CategoriesJournal of Applied Meteorology, 8
-
G. Brier (1950)
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITYMonthly Weather Review, 78
-
Jeffrey Anderson (1996)
A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model IntegrationsJournal of Climate, 9
-
Mason (1982)
A model for assessment of weather forecasts.Aust. Meteor. Mag., 30
-
A. Murphy (1971)
A Note on the Ranked Probability ScoreJournal of Applied Meteorology, 10
-
D. Wilks (1995)
Statistical Methods in the Atmospheric Sciences: An Introduction -
I. Jolliffe, D. Stephenson (2008)
Proper Scores for Probability Forecasts Can Never Be EquitableMonthly Weather Review, 136
- Publisher
- American Meteorological Society
- Copyright
- Copyright © 2009 American Meteorological Society
- ISSN
- 1520-0493
- DOI
- 10.1175/2009MWR2945.1
- Publisher site
- See Article on Publisher Site
Abstract
The problem of probabilistic forecast verification is approached from a theoretical point of view starting from three basic desiderata: additivity, exclusive dependence on physical observations (“locality”), and strictly proper behavior. By imposing such requirements and only using elementary mathematics, a univocal measure of forecast goodness is demonstrated to exist. This measure is the logarithmic score, based on the relative entropy between the observed occurrence frequencies and the predicted probabilities for the forecast events. Information theory is then used as a guide to choose the scoring-scale offset for obtaining meaningful and fair skill scores. Finally the Brier score is assessed and, for single-event forecasts, its equivalence to the second-order approximation of the logarithmic score is shown. The large part of the presented results are far from being new or original, nevertheless their use still meets with some resistance in the weather forecast community. This paper aims at providing a clear presentation of the main arguments for using the logarithmic score.
Journal
Monthly Weather Review – American Meteorological Society
Published: Jan 15, 2009