Editorial Type:
Article
Article Type:
Research Article

Evaluating Medium-Range Tropical Cyclone Forecasts in Uniform- and Variable-Resolution Global Models

Christopher A. Davis National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Christopher A. Davis in
Current site
Google Scholar
PubMed Close
,
David A. Ahijevych National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by David A. Ahijevych in
Current site
Google Scholar
PubMed Close
,
Wei Wang National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Wei Wang in
Current site
Google Scholar
PubMed Close
, and
William C. Skamarock National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by William C. Skamarock in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Nov 2016
DOI:
https://doi.org/10.1175/MWR-D-16-0021.1
Page(s):
4141–4160
Restricted access

Abstract

An evaluation of medium-range forecasts of tropical cyclones (TCs) is performed, covering the eastern North Pacific basin during the period 1 August–3 November 2014. Real-time forecasts from the Model for Prediction Across Scales (MPAS) and operational forecasts from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) are evaluated. A new TC-verification method is introduced that treats TC tracks as objects. The method identifies matching pairs of forecast and observed tracks, missed and false alarm tracks, and derives statistics using a multicategory contingency table methodology. The formalism includes track, intensity, and genesis.

Two configurations of MPAS, a uniform 15-km mesh and a variable-resolution mesh transitioning from 60 km globally to 15 km over the eastern Pacific, are compared with each other and with the operational GFS. The two configurations of MPAS reveal highly similar forecast skill and biases through at least day 7. This result supports the effectiveness of TC prediction using variable resolution.

Both MPAS and the GFS suffer from biases in predictions of genesis at longer time ranges; MPAS produces too many storms whereas the GFS produces too few. MPAS better discriminates hurricanes than does the GFS, but the false alarms in MPAS lower overall forecast skill in the medium range relative to GFS. The biases in MPAS forecasts are traced to errors in the parameterization of shallow convection south of the equator and the resulting erroneous invigoration of the ITCZ over the eastern North Pacific.

The National Center for Atmospheric Research is sponsored by the National Science Foundation.

Corresponding author address: Christopher A. Davis, National Center for Atmospheric Research, P.O. Box 3000, Boulder, CO 80307. E-mail: cdavis@ucar.edu

Abstract

An evaluation of medium-range forecasts of tropical cyclones (TCs) is performed, covering the eastern North Pacific basin during the period 1 August–3 November 2014. Real-time forecasts from the Model for Prediction Across Scales (MPAS) and operational forecasts from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) are evaluated. A new TC-verification method is introduced that treats TC tracks as objects. The method identifies matching pairs of forecast and observed tracks, missed and false alarm tracks, and derives statistics using a multicategory contingency table methodology. The formalism includes track, intensity, and genesis.

Two configurations of MPAS, a uniform 15-km mesh and a variable-resolution mesh transitioning from 60 km globally to 15 km over the eastern Pacific, are compared with each other and with the operational GFS. The two configurations of MPAS reveal highly similar forecast skill and biases through at least day 7. This result supports the effectiveness of TC prediction using variable resolution.

Both MPAS and the GFS suffer from biases in predictions of genesis at longer time ranges; MPAS produces too many storms whereas the GFS produces too few. MPAS better discriminates hurricanes than does the GFS, but the false alarms in MPAS lower overall forecast skill in the medium range relative to GFS. The biases in MPAS forecasts are traced to errors in the parameterization of shallow convection south of the equator and the resulting erroneous invigoration of the ITCZ over the eastern North Pacific.

The National Center for Atmospheric Research is sponsored by the National Science Foundation.

Corresponding author address: Christopher A. Davis, National Center for Atmospheric Research, P.O. Box 3000, Boulder, CO 80307. E-mail: cdavis@ucar.edu
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Aberson, S. D., 2008: An alternative tropical cyclone intensity forecast verification technique. Wea. Forecasting, 23, 1304–1310, doi:10.1175/2008WAF2222123.1.

    • Search Google Scholar
    • Export Citation

  • Chan, J. C. L., and R. H. F. Kwok, 1999: Tropical cyclone genesis in a global numerical weather prediction model. Mon. Wea. Rev., 127, 611–624, doi:10.1175/1520-0493(1999)127<0611:TCGIAG>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Chou, K.-H., C.-C. Wu, and S.-Z. Lin, 2013: Assessment of the ASCAT wind error characteristics by global dropwindsonde observations. J. Geophys. Res. Atmos., 118, 9011–9021, doi:10.1002/jgrd.50724.

    • Search Google Scholar
    • Export Citation

  • Coniglio, M. C., J. Correia Jr., P. T. Marsh, and F. Kong, 2013: Verification of convection-allowing WRF model forecasts of the planetary boundary layer using sounding observations. Wea. Forecasting, 28, 842–862, doi:10.1175/WAF-D-12-00103.1.

    • Search Google Scholar
    • Export Citation

  • Davis, C., and Coauthors, 2008: Prediction of landfalling hurricanes with the Advanced Hurricane WRF model. Mon. Wea. Rev., 136, 1990–2005, doi:10.1175/2007MWR2085.1.

    • Search Google Scholar
    • Export Citation

  • Demuth, J., M. DeMaria, and J. A. Knaff, 2006: Improvement of advanced microwave sounder unit tropical cyclone intensity and size estimation algorithms. J. Appl. Meteor. Climatol., 45, 1573–1581, doi:10.1175/JAM2429.1.

    • Search Google Scholar
    • Export Citation

  • Doswell, C. A., III, R. Davies-Jones, and D. L. Keller, 1990: On summary measures of skill in rare event forecasting based on contingency tables. Wea. Forecasting, 5, 576–585, doi:10.1175/1520-0434(1990)005<0576:OSMOSI>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Elsberry, R. L., W. M. Clune, and P. A. Harr, 2009: Evaluation of global model early track and formation prediction during the combined TCS08 and T-PARC field experiment. Asia-Pac. J. Atmos. Sci., 45, 357–374.

    • Search Google Scholar
    • Export Citation

  • Fairall, C. W., E. F. Bradley, J. E. Hare, A. A. Grachev, and J. B. Edson, 2003: Bulk parameterization of air–sea fluxes: Updates and verification for the COARE algorithm. J. Climate, 16, 571–591, doi:10.1175/1520-0442(2003)016<0571:BPOASF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Gall, R., J. Franklin, F. Marks, E. N. Rappaport, and F. Toepfer, 2013: The Hurricane Forecast Improvement Project. Bull. Amer. Meteor. Soc., 94, 329–343, doi:10.1175/BAMS-D-12-00071.1.

    • Search Google Scholar
    • Export Citation

  • Halperin, D. J., H. E. Fuelberg, R. E. Hart, J. H. Cossuth, P. Sura, and R. J. Pasch, 2013: An evaluation of tropical cyclone genesis forecasts from global numerical models. Wea. Forecasting, 28, 1423–1445, doi:10.1175/WAF-D-13-00008.1.

    • Search Google Scholar
    • Export Citation

  • Hart, R. E., 2003: A cyclone phase space derived from thermal wind and thermal asymmetry. Mon. Wea. Rev., 131, 585–616, doi:10.1175/1520-0493(2003)131<0585:ACPSDF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Hashimoto, A., J. M. Done, L. D. Fowler, and C. L. Bruyère, 2016: Tropical cyclone activity in nested regional and global grid-refined simulations. Climate Dyn., 47, 497–508, doi:10.1007/s00382-015-2852-2.

    • Search Google Scholar
    • Export Citation

  • Klemp, J. B., W. C. Skamarock, and S.-H. Park, 2015: Idealized global nonhydrostatic atmospheric test cases on a reduced-radius sphere. J. Adv. Model. Earth Syst., 7, 1155–1177, doi:10.1002/2015MS000435.

    • Search Google Scholar
    • Export Citation

  • Knaff, J. A., S. P. Longmore, and D. A. Molenar, 2014: An objective satellite-based tropical cyclone size climatology. J. Climate, 27, 455–476, doi:10.1175/JCLI-D-13-00096.1.

    • Search Google Scholar
    • Export Citation

  • Knutson, T. R., J. J. Sirutis, S. T. Garner, I. M. Held, and R. E. Tuleya, 2007: Simulation of the recent multidecadal increase of Atlantic hurricane activity using an 18-km-grid regional model. Bull. Amer. Meteor. Soc., 88, 1549–1565, doi:10.1175/BAMS-88-10-1549.

    • Search Google Scholar
    • Export Citation

  • Murphy, A. H., 1993: What is a good forecast? An essay on the nature of goodness in weather forecasting. Wea. Forecasting, 8, 281–293, doi:10.1175/1520-0434(1993)008<0281:WIAGFA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Noh, Y., W. G. Cheon, S.-Y. Hong, and S. Raasch, 2003: Improvement of the K-profile model for the planetary boundary layer based on large eddy simulation data. Bound.-Layer Meteor., 107, 401–427, doi:10.1023/A:1022146015946.

    • Search Google Scholar
    • Export Citation

  • Park, S.-H., W. C. Skamarock, J. B. Klemp, L. D. Fowler, and M. G. Duda, 2013: Evaluation of global atmospheric solvers using extensions of the Jablonowski and Williamson baroclinic wave test case. Mon. Wea. Rev., 141, 3116–3129, doi:10.1175/MWR-D-12-00096.1.

    • Search Google Scholar
    • Export Citation

  • Park, S.-H., J. B. Klemp, and W. C. Skamarock, 2014: A comparison of mesh refinement in the global MPAS-A and WRF models using an idealized normal-mode baroclinic wave simulation. Mon. Wea. Rev., 142, 3614–3634, doi:10.1175/MWR-D-14-00004.1.

    • Search Google Scholar
    • Export Citation

  • Pollard, R. T., P. B. Rhines, and R. O. R. Y. Thompson, 1973: The deepening of the wind-mixed layer. Geophys. Fluid Dyn., 3, 381–404.

  • Raymond, D. J., C. S. Bretherton, and J. Molinari, 2006: Dynamics of the intertropical convergence zone of the east Pacific. J. Atmos. Sci., 63, 582–597, doi:10.1175/JAS3642.1.

    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., J. B. Klemp, M. G. Duda, L. D. Fowler, S.-H. Park, and T. D. Ringler, 2012: A multiscale nonhydrostatic atmospheric model using centroidal Voronoi tesselations and C-grid staggering. Mon. Wea. Rev., 140, 3090–3105, doi:10.1175/MWR-D-11-00215.1.

    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., S.-H. Park, J. B. Klemp, and C. Snyder, 2014: Atmospheric kinetic energy spectra from global high-resolution nonhydrostatic simulations. J. Atmos. Sci., 71, 4369–4381, doi:10.1175/JAS-D-14-0114.1.

    • Search Google Scholar
    • Export Citation

  • Torn, R. D., and C. A. Davis, 2012: The influence of shallow convection on tropical cyclone track forecasts. Mon. Wea. Rev., 140, 2188–2197, doi:10.1175/MWR-D-11-00246.1.

    • Search Google Scholar
    • Export Citation

  • Vigh, J., 2015: Tropical cyclone guidance project. Accessed May 2015. [Available online at http://www.ral.ucar.edu/guidance/.]

  • Vitart, F., J. L. Anderson, and W. F. Stern, 1997: Simulation of the interannual variability of tropical storm frequency in an ensemble of GCM integrations. J. Climate, 10, 745–760, doi:10.1175/1520-0442(1997)010<0745:SOIVOT>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Yamaguchi, M., F. Vitart, S. T. K. Lang, L. Magnusson, R. L. Elsberry, G. Elliott, M. Kyouda, and T. Nakazawa, 2015: Global distribution of the skill of tropical cyclone activity forecasts on short- to medium-range time scales. Wea. Forecasting, 30, 1695–1709, doi:10.1175/WAF-D-14-00136.1.

    • Search Google Scholar
    • Export Citation

  • Zarzycki, C. M., and C. Jablonowski, 2015: Experimental tropical cyclone forecasts using a variable-resolution global model. Mon. Wea. Rev., 143, 4012–4037, doi:10.1175/MWR-D-15-0159.1.

    • Search Google Scholar
    • Export Citation

  • Zhang, C., Y. Wang, and K. Hamilton, 2011: Improved representation of boundary layer clouds over the Southeast Pacific in ARW-WRF using a modified Tiedtke cumulus parameterization scheme. Mon. Wea. Rev., 139, 3489–3513, doi:10.1175/MWR-D-10-05091.1.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 470 157 29
PDF Downloads 419 113 7