Comment on “Bias Correction, Quantile Mapping, and Downscaling: Revisiting the Inflation Issue”

Bob Glahn Meteorological Development Laboratory, Office of Science and Technology Integration, National Weather Service, Silver Spring, Maryland

Search for other papers by Bob Glahn in
Current site
Google Scholar
PubMed
Close
Full access

Corresponding author address: Bob Glahn, Meteorological Development Laboratory, National Weather Service, 1325 East West Highway, Silver Spring, MD 20910.E-mail: harry.glahn@noaa.gov

The original article that was the subject of this comment/reply can be found at http://journals.ametsoc.org/doi/abs/10.1175/JCLI-D-12-00821.1.

Corresponding author address: Bob Glahn, Meteorological Development Laboratory, National Weather Service, 1325 East West Highway, Silver Spring, MD 20910.E-mail: harry.glahn@noaa.gov

The original article that was the subject of this comment/reply can be found at http://journals.ametsoc.org/doi/abs/10.1175/JCLI-D-12-00821.1.

Several papers in the Journal of Climate have discussed the use of inflation of regression estimates (e.g., Karl et al. 1990; von Storch 1999), a recent one being Maraun (2013). Generally, Maraun (2013, 2014) disparages the inflation concept and is very specific in Maraun (2014) where he states that “. . . inflation is appropriate for neither prediction nor simulation” (p. 1823). He also states, “In the early years of numerical weather forecasting, a tendency of the regression method to ‘not forecasting the extremes as often as they are observed’ (Klein et al. 1959) had been noted, basically because erroneously only the predicted mean ax had been considered for the forecast but not the distribution around it. As a ‘correction’ inflation has been suggested . . .” (p. 1823). I believe Maraun’s statement (Maraun 2014) that the inflation procedure is “flawed” is unjustified and his statement that it is not appropriate for prediction is incorrect. Maraun’s treatment of inflation may inhibit its use where it would be appropriate. His statement concerning the distribution around the mean implies probability forecasts, and that would be an excellent avenue to take, provided the users of the forecasts would accept them in lieu of a specific value forecast; however, since that is many times not the case, a specific value is imperative. My purpose here is not to justify inflation as the best way to achieve regression estimates of the more rare events, as Klein et al. (1959) long ago stated, but rather to indicate that it can be used successfully as one way.

Specifically, regression inflation relates to estimation of a weather variable (predictand) as a linear function of one or more predictors. The relationship between the predictand and the predictors is measured by the reduction of variance (RV), which is the square of the (multiple) correlation coefficient R. As R and RV being less than unity implies, the variance of the predicted value afforded by the regression equation is less than the variance in the dependent sample of the variable to be predicted. Inflation, here, is the division of the forecast departures from the dependent sample mean by R so that when combined with the mean this produces a predicted variance equal to the predictand variance on the dependent sample.1

Statistical postprocessing (of numerical model output) for weather prediction, to which this discussion relates, was in its infancy when Bill Klein and others first published the inflation adjustment. At that time, much less was known about statistical prediction than today, and even though Klein et al. (1959) state concerning inflation that “. . . it should not be construed that this is necessarily the best objective method of forecasting temperature classes” (p. 681), it seemed at the time that inflation was progressing into widespread use, and that the pitfalls of the procedure should be pointed out; that was the reason Roger Allen and I (Glahn and Allen 1966) wrote our brief note, which Maraun references in support of his statement that inflation is flawed. Klein et al. (1967, p. 218) show Klein’s awareness of inflation’s characteristics, but continued to use it.

Whether inflation is a good procedure or not depends critically on the intended use of the prediction. Discussions in the climate literature usually pertain to some form of climate prediction or climate simulation as stated by Maraun (2013), which generally differs in purpose from weather prediction on an hour-to-hour or day-to-day basis.

My and Allen’s note (Glahn and Allen 1966) may have had a negative tone to it, but it was not intended to mean that inflation should never be used. We stated, “When operational forecasts are being considered, the final judgement of the ‘goodness’ of these forecasts should be on the basis of their usefulness to the user” (p. 126). Regression inflation is a technique that has some good features and, like any technique, some bad; does that make all of them “flawed?” Ed Epstein (Epstein 1967) provided comments on the Glahn and Allen (1966) and Klein et al. (1959) papers and states, “It is my judgment that the considerations which led to the introduction of the inflation techniques are valid” (p. 427). Then he went on to propose the use of a nonlinear scaling of the dependent variable such that the smaller deviations from the mean are changed less than inflation would change them and the larger deviations are changed more.

Weather forecasts must be useful to a user to justify their being made. I can cite a couple of situations where inflation has been used successfully. One is in the prediction of 10-m wind speed (Russo et al. 1964). Wind speed is essentially a continuous variable, but its distribution is highly nonnormal. It is bounded at the low end at zero. Values less than 10 knots (kt)2 are not very predictable for various reasons, including instrument response, siting issues, and very small scale fluctuations, but are very numerous. A corporate user interested only in winds over 20 kt may find that regression just never forecasts winds that high, making the forecasts useless for that user. To make them useful, some method must be used to alert the user that 20-kt winds are more likely than at other times. Provided that there are some winds in the developmental sample greater than 20 kt, inflation will likely make some greater than 20 kt. Such forecasts can be verified by appropriate metrics, and the results of that verification provided to the potential users of the inflated forecasts. Strong winds can be perceived as a threat, and the threat score (TS) applies (Palmer and Allen 1949).3 The TS generally rewards a system that produces as many forecasts of “threats” as occur.

One aspect of inflation is that not only more high forecasts are made, but also more low forecasts, and this means many very weak winds are forecast, even to being negative. Developers at the Meteorological Development Laboratory have used inflation for wind speed since 1975 (Schwartz and Carter 1982; Jacks et al. 1990; Su 2005; Rudack 2015), and the established practice now is to “partially inflate,” where the forecasts above the mean are inflated, but those below the mean are not (Su 2005; Rudack 2015).4

Another study where inflation was shown to be useful was in the prediction of cloud amount (Carter and Glahn 1976; Carter 1976). At some locations, the distribution is U-shaped; there are many clear days and cloudy days. Regression, where the amount of cloud (in octas or percent) is the predictand, will usually provide a great many forecasts of a few or some cloud, but a relatively few of clear and overcast. Inflation can spread the distribution to one that is nearer to the observed. Even though some measures of “goodness” will be worse with the inflation (e.g., RMSE), some will likely be better, possibly the Heidke skill score, TS, and the user’s utility when the forecasts are scored with the users’ specific utility matrix.

In summary, regression inflation should be considered one of the possible statistical techniques for weather forecasting, as long as its strengths and weaknesses are recognized, the characteristics of the forecasts are determined, and such information is furnished to the potential users.

REFERENCES

  • Carter, G. M., 1976: Testing LFM- and PE-based statistical cloud prediction for the cool season. TDL Office Note 76-18, Techniques Development Laboratory, National Weather Service, 11 pp.

  • Carter, G. M., and H. R. Glahn, 1976: Objective prediction of cloud amount based on model output statistics. Mon. Wea. Rev., 104, 15651572, doi:10.1175/1520-0493(1976)104<1565:OPOCAB>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Donaldson, R., R. Dyer, and M. Krauss, 1975: An objective evaluator of techniques for predicting severe weather events. Preprints, Ninth Conf. on Severe Local Storms, Amer. Meteor. Soc., Norman, OK, 321–326.

  • Epstein, E. S., 1967: A modified inflation procedure. J. Appl. Meteor., 6, 427429, doi:10.1175/1520-0450(1967)006<0427:AMIP>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Glahn, H. R., and R. A. Allen, 1966: A note concerning the “inflation” of regression forecasts. J. Appl. Meteor., 5, 124126, doi:10.1175/1520-0450(1966)005<0124:ANCTOR>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Jacks, E., J. B. Bower, V. Dagostaro, J. P. Dallavalle, M. C. Erickson, and J. C. Su, 1990: New NGM-based MOS guidance for maximum/minimum temperature, probability of precipitation, cloud amount, and surface wind. Wea. Forecasting, 5, 128138, doi:10.1175/1520-0434(1990)005<0128:NNBMGF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Karl, T. R., W.-C. Wang, M. E. Schlesinger, R. W. Knight, and D. Portman, 1990: A method of relating general circulation model simulated climate to the observed local climate. Part I: Seasonal statistics. J. Climate, 3, 10531079, doi:10.1175/1520-0442(1990)003<1053:AMORGC>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Klein, W. H., B. M. Lewis, and I. Enger, 1959: Objective prediction of five-day mean temperatures during winter. J. Meteor., 16, 672682, doi:10.1175/1520-0469(1959)016<0672:OPOFDM>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Klein, W. H., F. Lewis, and G. P. Casely, 1967: Automated nationwide forecasts of maximum and minimum temperature. J. Appl. Meteor., 6, 216228, doi:10.1175/1520-0450(1967)006<0216:ANFOMA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Maraun, D., 2013: Bias correction, quantile mapping, and downscaling: Revisiting the inflation issue. J. Climate, 26, 21372143, doi:10.1175/JCLI-D-12-00821.1.

    • Search Google Scholar
    • Export Citation
  • Maraun, D., 2014: Reply to “Comment on ‘Bias correction, quantile mapping, and downscaling: Revisiting the inflation issue.’” J. Climate, 27, 18211825, doi:10.1175/JCLI-D-13-00307.1.

    • Search Google Scholar
    • Export Citation
  • Palmer, W. C., and R. A. Allen, 1949: Note on the accuracy of forecasts concerning the rain problem. Weather Bureau, 2 pp.

  • Rudack, D. E., 2015: Results of sensitivity testing of MOS wind speed and direction guidance using various sample sizes from the global ensemble forecast system (GEFS) reforecasts. Special Symp. on Model Postprocessing and Downscaling, Amer. Meteor Soc., Phoenix, AZ, 4.3. [Available online at https://ams.confex.com/ams/95Annual/webprogram/Paper263730.html.]

  • Russo, J. A., Jr., I. Enger, and E. L. Sorenson, 1964: A statistical approach to short-period prediction of surface winds. J. Appl. Meteor., 3, 126131, doi:10.1175/1520-0450(1964)003<0126:ASATTS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Schwartz, B. E., and G. M. Carter, 1982: An evaluation of a modified speed enhancement technique for objective surface wind forecasting. TDL Office Note 82-1, Techniques Development Laboratory, National Weather Service, 10 pp.

  • Schaefer, J. T., 1990: The Critical Success Index as an indicator of warning skill. Wea. Forecasting, 5, 570575, doi:10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Su, J. C., 2005: GFS-based MOS wind forecast guidance for islands in the tropical western Pacific Ocean. 21st Conf. on Weather Analysis and Forecasting/17th Conf. on Numerical Weather Prediction, Washington, DC, Amer. Meteor. Soc., 13B.4. [Available online at https://ams.confex.com/ams/WAFNWP34BC/techprogram/paper_94513.htm.]

  • von Storch, H., 1999: On the use of “inflation” in statistical downscaling. J. Climate, 12, 35053506, doi:10.1175/1520-0442(1999)012<3505:OTUOII>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
1

Some papers, by virtue of assuming zero mean of the variables involved, do not make it abundantly clear that it is the departures from the mean that are inflated, and not the total regression estimate.

2

1 knot (kt) = 0.51 m s−1; kt is the unit of measurement used widely in the United States, especially by the aviation community.

3

The threat score is the same as the critical success index (Donaldson et al. 1975; Schaefer 1990), widely used in evaluation of severe weather threats.

4

The Meteorological Development Laboratory’s home page (http://www.nws.noaa.gov/tdl/) states the partial inflation vice full inflation of the operational MOS wind speed forecasts started 20 June 2006.

Save
  • Carter, G. M., 1976: Testing LFM- and PE-based statistical cloud prediction for the cool season. TDL Office Note 76-18, Techniques Development Laboratory, National Weather Service, 11 pp.

  • Carter, G. M., and H. R. Glahn, 1976: Objective prediction of cloud amount based on model output statistics. Mon. Wea. Rev., 104, 15651572, doi:10.1175/1520-0493(1976)104<1565:OPOCAB>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Donaldson, R., R. Dyer, and M. Krauss, 1975: An objective evaluator of techniques for predicting severe weather events. Preprints, Ninth Conf. on Severe Local Storms, Amer. Meteor. Soc., Norman, OK, 321–326.

  • Epstein, E. S., 1967: A modified inflation procedure. J. Appl. Meteor., 6, 427429, doi:10.1175/1520-0450(1967)006<0427:AMIP>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Glahn, H. R., and R. A. Allen, 1966: A note concerning the “inflation” of regression forecasts. J. Appl. Meteor., 5, 124126, doi:10.1175/1520-0450(1966)005<0124:ANCTOR>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Jacks, E., J. B. Bower, V. Dagostaro, J. P. Dallavalle, M. C. Erickson, and J. C. Su, 1990: New NGM-based MOS guidance for maximum/minimum temperature, probability of precipitation, cloud amount, and surface wind. Wea. Forecasting, 5, 128138, doi:10.1175/1520-0434(1990)005<0128:NNBMGF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Karl, T. R., W.-C. Wang, M. E. Schlesinger, R. W. Knight, and D. Portman, 1990: A method of relating general circulation model simulated climate to the observed local climate. Part I: Seasonal statistics. J. Climate, 3, 10531079, doi:10.1175/1520-0442(1990)003<1053:AMORGC>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Klein, W. H., B. M. Lewis, and I. Enger, 1959: Objective prediction of five-day mean temperatures during winter. J. Meteor., 16, 672682, doi:10.1175/1520-0469(1959)016<0672:OPOFDM>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Klein, W. H., F. Lewis, and G. P. Casely, 1967: Automated nationwide forecasts of maximum and minimum temperature. J. Appl. Meteor., 6, 216228, doi:10.1175/1520-0450(1967)006<0216:ANFOMA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Maraun, D., 2013: Bias correction, quantile mapping, and downscaling: Revisiting the inflation issue. J. Climate, 26, 21372143, doi:10.1175/JCLI-D-12-00821.1.

    • Search Google Scholar
    • Export Citation
  • Maraun, D., 2014: Reply to “Comment on ‘Bias correction, quantile mapping, and downscaling: Revisiting the inflation issue.’” J. Climate, 27, 18211825, doi:10.1175/JCLI-D-13-00307.1.

    • Search Google Scholar
    • Export Citation
  • Palmer, W. C., and R. A. Allen, 1949: Note on the accuracy of forecasts concerning the rain problem. Weather Bureau, 2 pp.

  • Rudack, D. E., 2015: Results of sensitivity testing of MOS wind speed and direction guidance using various sample sizes from the global ensemble forecast system (GEFS) reforecasts. Special Symp. on Model Postprocessing and Downscaling, Amer. Meteor Soc., Phoenix, AZ, 4.3. [Available online at https://ams.confex.com/ams/95Annual/webprogram/Paper263730.html.]

  • Russo, J. A., Jr., I. Enger, and E. L. Sorenson, 1964: A statistical approach to short-period prediction of surface winds. J. Appl. Meteor., 3, 126131, doi:10.1175/1520-0450(1964)003<0126:ASATTS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Schwartz, B. E., and G. M. Carter, 1982: An evaluation of a modified speed enhancement technique for objective surface wind forecasting. TDL Office Note 82-1, Techniques Development Laboratory, National Weather Service, 10 pp.

  • Schaefer, J. T., 1990: The Critical Success Index as an indicator of warning skill. Wea. Forecasting, 5, 570575, doi:10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Su, J. C., 2005: GFS-based MOS wind forecast guidance for islands in the tropical western Pacific Ocean. 21st Conf. on Weather Analysis and Forecasting/17th Conf. on Numerical Weather Prediction, Washington, DC, Amer. Meteor. Soc., 13B.4. [Available online at https://ams.confex.com/ams/WAFNWP34BC/techprogram/paper_94513.htm.]

  • von Storch, H., 1999: On the use of “inflation” in statistical downscaling. J. Climate, 12, 35053506, doi:10.1175/1520-0442(1999)012<3505:OTUOII>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1225 761 47
PDF Downloads 351 74 8