Editorial Type:
Article
Article Type:
Research Article

Applying a Divisive Clustering Algorithm to a Large Ensemble for Medium-Range Forecasting at the Weather Prediction Center

Keith F. Brill I.M. Systems Group, Inc., and NOAA/NWS/NCEP/Weather Prediction Center, College Park, Maryland

Search for other papers by Keith F. Brill in
Current site
Google Scholar
PubMed Close
,
Anthony R. Fracasso NOAA/NWS/NCEP/Weather Prediction Center, College Park, Maryland

Search for other papers by Anthony R. Fracasso in
Current site
Google Scholar
PubMed Close
, and
Christopher M. Bailey NOAA/NWS/NCEP/Weather Prediction Center, College Park, Maryland

Search for other papers by Christopher M. Bailey in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Aug 2015
DOI:
https://doi.org/10.1175/WAF-D-14-00137.1
Page(s):
873–891
Restricted access

Abstract

This article explores the potential advantages of using a clustering approach to distill information contained within a large ensemble of forecasts in the medium-range time frame. A divisive clustering algorithm based on the one-dimensional discrete Fourier transformation is described and applied to the 70-member combination of the 20-member National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System (GEFS) and the 50-member European Centre for Medium-Range Weather Forecasts (ECMWF) ensemble. Cumulative statistical verification indicates that clusters selected objectively based on having the largest number of members do not perform better than the ECMWF ensemble mean. However, including a cluster in a blended forecast to maintain continuity or to nudge toward a preferred solution may be a reasonable strategy in some cases. In such cases, a cluster may be used to sharpen a forecast weakly depicted by the ensemble mean but favored in consideration of continuity, consistency, collaborative thinking, and/or the trend in the guidance. Clusters are often useful for depicting forecast solutions not apparent via the ensemble mean but supported by a subset of ensemble members. A specific case is presented to demonstrate the possible utility of a clustering approach in the forecasting process.

Corresponding author address: Keith F. Brill, NOAA/NWS/NCEP/Weather Prediction Center, 5830 University Research Ct., Rm. 4630, College Park, MD 20740. E-mail: keith.brill@noaa.gov

Abstract

This article explores the potential advantages of using a clustering approach to distill information contained within a large ensemble of forecasts in the medium-range time frame. A divisive clustering algorithm based on the one-dimensional discrete Fourier transformation is described and applied to the 70-member combination of the 20-member National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System (GEFS) and the 50-member European Centre for Medium-Range Weather Forecasts (ECMWF) ensemble. Cumulative statistical verification indicates that clusters selected objectively based on having the largest number of members do not perform better than the ECMWF ensemble mean. However, including a cluster in a blended forecast to maintain continuity or to nudge toward a preferred solution may be a reasonable strategy in some cases. In such cases, a cluster may be used to sharpen a forecast weakly depicted by the ensemble mean but favored in consideration of continuity, consistency, collaborative thinking, and/or the trend in the guidance. Clusters are often useful for depicting forecast solutions not apparent via the ensemble mean but supported by a subset of ensemble members. A specific case is presented to demonstrate the possible utility of a clustering approach in the forecasting process.

Corresponding author address: Keith F. Brill, NOAA/NWS/NCEP/Weather Prediction Center, 5830 University Research Ct., Rm. 4630, College Park, MD 20740. E-mail: keith.brill@noaa.gov
Save
Cover Weather and Forecasting
Weather and Forecasting

  • Alhamed, A., Lakshmivarahan S. , and Stensrud D. J. , 2002: Cluster analysis of multimodel ensemble data from SAMEX. Mon. Wea. Rev., 130, 226–256, doi:10.1175/1520-0493(2002)130<0226:CAOMED>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Atger, F., 1999: Tubing: An alternative to clustering for the classification of ensemble forecasts. Wea. Forecasting, 14, 741–757, doi:10.1175/1520-0434(1999)014<0741:TAATCF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Branković, Č., Matjačić B. , Ivatek-Šahdan S. , and Buizza R. , 2008: Downscaling of ECMWF ensemble forecasts for cases of severe weather: Ensemble statistics and cluster analysis. Mon. Wea. Rev., 136, 3323–3342, doi:10.1175/2008MWR2322.1.

    • Search Google Scholar
    • Export Citation

  • De Pondeca, M. S. F. V., and Coauthors, 2011: The real-time mesoscale analysis at NOAA’s National Centers for Environmental Prediction: Current status and development. Wea. Forecasting, 26, 593–612, doi:10.1175/WAF-D-10-05037.1.

    • Search Google Scholar
    • Export Citation

  • Dutton, J. A., 1986: The Ceaseless Wind. Dover Publications, 617 pp.

  • Ferranti, L., and Corti S. , 2011: New clustering products. ECMWF Newsletter, No. 127, Reading, United Kingdom, 6–11. [Available online at http://old.ecmwf.int/publications/newsletters/pdf/127.pdf.]

  • Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155–167, doi:10.1175/1520-0434(1999)014<0155:HTFENP>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Im, J.-S., Brill K. , and Danaher E. , 2006: Confidence interval estimation for quantitative precipitation forecasts (QPF) using Short-Range Ensemble Forecasts (SREF). Wea. Forecasting, 21, 24–41, doi:10.1175/WAF902.1.

    • Search Google Scholar
    • Export Citation

  • Inness, P., and Dorling S. , 2013: Operational Weather Forecasting. J. Wiley and Sons, 231 pp.

  • Johnson, A., Wang X. , Xue M. , and Kong F. , 2011: Hierarchical cluster analysis of a convection-allowing ensemble during the Hazardous Weather Testbed 2009 Spring Experiment. Part II: Ensemble clustering over the whole experiment period. Mon. Wea. Rev., 139, 3694–3710, doi:10.1175/MWR-D-11-00016.1.

    • Search Google Scholar
    • Export Citation

  • Keune, J., Ohlwein C. , and Hense A. , 2014: Multivariate probabilistic analysis and predictability of medium-range ensemble weather forecasts. Mon. Wea. Rev., 142, 4074–4090, doi:10.1175/MWR-D-14-00015.1.

    • Search Google Scholar
    • Export Citation

  • Kistler, R., and Coauthors, 2001: The NCEP–NCAR 50-Year Reanalysis: Monthly means CD-ROM and documentation. Bull. Amer. Meteor. Soc., 82, 247–267, doi:10.1175/1520-0477(2001)082<0247:TNNYRM>2.3.CO;2.

    • Search Google Scholar
    • Export Citation

  • Marzban, C., Sandgathe S. , and Lyons H. , 2008: An object-oriented verification of three NWP model formulations via cluster analysis: An objective and a subjective analysis. Mon. Wea. Rev., 136, 3392–3407, doi:10.1175/2007MWR2333.1.

    • Search Google Scholar
    • Export Citation

  • Meyer, P. L., 1970: Introductory Probability and Statistical Applications. 2nd ed. Addison-Wesley, 367 pp.

  • Nakaegawa, T., and Kanamitsu M. , 2006: Cluster analysis of the seasonal forecast skill of the NCEP SFM over the Pacific–North America sector. J. Climate, 19, 123–138, doi:10.1175/JCLI3609.1.

    • Search Google Scholar
    • Export Citation

  • Novak, D. R., Bailey C. , Brill K. F. , Burke P. , Hogsett W. A. , Rausch R. , and Schichtel M. , 2014a: Precipitation and temperature forecast performance at the Weather Prediction Center. Wea. Forecasting, 29, 489–504, doi:10.1175/WAF-D-13-00066.1.

    • Search Google Scholar
    • Export Citation

  • Novak, D. R., Brill K. F. , and Hogsett W. A. , 2014b: Using percentiles to communicate snowfall uncertainty. Wea. Forecasting, 29, 1259–1265, doi:10.1175/WAF-D-14-00019.1.

    • Search Google Scholar
    • Export Citation

  • Palmer, T. N., Brankovic C. , Molteni F. , Tibaldi S. , Ferranti L. , Hollingsworth A. , Cubasch U. , and Klinker E. , 1990: The European Centre for Medium-Range Weather Forecasts (ECMWF) program on extended-range prediction. Bull. Amer. Meteor. Soc., 71, 1317–1330, doi:10.1175/1520-0477(1990)071<1317:TECFMR>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Straus, D. M., and Molteni F. , 2004: Circulation regimes and SST forcing: Results from large GCM ensembles. J. Climate, 17, 1641–1656, doi:10.1175/1520-0442(2004)017<1641:CRASFR>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Tracton, M. S., and Kalnay E. , 1993: Ensemble forecasting at NMC: Operational implementation. Wea. Forecasting, 8, 379–398, doi:10.1175/1520-0434(1993)008<0379:OEPATN>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 630 pp.

  • Yussouf, N., Stensrud D. J. , and Lakshmivarahan S. , 2004: Cluster analysis of multimodel ensemble data over New England. Mon. Wea. Rev., 132, 2452–2462, doi:10.1175/1520-0493(2004)132<2452:CAOMED>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 265 94 16
PDF Downloads 177 55 12