A Global Climatology of Extratropical Transition. Part II: Statistical Performance of the Cyclone Phase Space

Melanie Bieli Department of Applied Physics and Applied Mathematics, Columbia University, New York, New York

Search for other papers by Melanie Bieli in
Current site
Google Scholar
PubMed
Close
,
Suzana J. Camargo Lamont-Doherty Earth Observatory, Columbia University, Palisades, New York

Search for other papers by Suzana J. Camargo in
Current site
Google Scholar
PubMed
Close
,
Adam H. Sobel Department of Applied Physics and Applied Mathematics, and Lamont-Doherty Earth Observatory, Columbia University, Palisades, New York

Search for other papers by Adam H. Sobel in
Current site
Google Scholar
PubMed
Close
,
Jenni L. Evans Department of Meteorology and Atmospheric Science, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Jenni L. Evans in
Current site
Google Scholar
PubMed
Close
, and
Timothy Hall NASA Goddard Institute for Space Studies, New York, New York

Search for other papers by Timothy Hall in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

This study analyzes the differences between an objective, automated identification of tropical cyclones (TCs) that undergo extratropical transition (ET), and the designation of ET determined subjectively by human forecasters in best track data in all basins globally. The objective identification of ET is based on the cyclone phase space (CPS), calculated from the Japanese 55-yr Reanalysis (JRA-55) or the ECMWF interim reanalysis (ERA-Interim). The resulting classification into ET storms and non-ET storms underlies the global climatology of ET presented in Part I of this study. Here, the authors investigate how well the CPS classifications agree with those in the best track records calculated from JRA-55 or from ERA-Interim data. According to F1 scores and Matthews correlation coefficients (MCCs), the classification of ET storms in the CPS agrees best with the best track classification in the western North Pacific (MCC > 0.7) and the North Atlantic (MCC > 0.5). In other basins, the correlation between the CPS classification and the best track classification is only slightly higher than that of a random classification. The JRA-55 classification achieves higher performance scores than does the ERA-Interim classification, and the differences are statistically significant in all basins. The lower performance of ERA-Interim is mainly due to a higher false alarm rate, particularly in the eastern North Pacific. Overall, the results show that while the CPS-based classifications are good enough to be useful for many purposes, there is almost certainly room for improvement—in the representation of the storms in reanalyses, in our objective metrics of ET, and in our scientific understanding of the ET process.

Supplemental information related to this paper is available at the Journals Online website: https://doi.org/10.1175/JCLI-D-18-0052.1.s1.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

This article has a companion article which can be found at http://journals.ametsoc.org/doi/abs/10.1175/JCLI-D-17-0518.1.

Publisher’s Note: This article was revised on 5 August 2019 in order to correct a typographical error in section 3d.

Corresponding author: Melanie Bieli, mb4036@columbia.edu

Abstract

This study analyzes the differences between an objective, automated identification of tropical cyclones (TCs) that undergo extratropical transition (ET), and the designation of ET determined subjectively by human forecasters in best track data in all basins globally. The objective identification of ET is based on the cyclone phase space (CPS), calculated from the Japanese 55-yr Reanalysis (JRA-55) or the ECMWF interim reanalysis (ERA-Interim). The resulting classification into ET storms and non-ET storms underlies the global climatology of ET presented in Part I of this study. Here, the authors investigate how well the CPS classifications agree with those in the best track records calculated from JRA-55 or from ERA-Interim data. According to F1 scores and Matthews correlation coefficients (MCCs), the classification of ET storms in the CPS agrees best with the best track classification in the western North Pacific (MCC > 0.7) and the North Atlantic (MCC > 0.5). In other basins, the correlation between the CPS classification and the best track classification is only slightly higher than that of a random classification. The JRA-55 classification achieves higher performance scores than does the ERA-Interim classification, and the differences are statistically significant in all basins. The lower performance of ERA-Interim is mainly due to a higher false alarm rate, particularly in the eastern North Pacific. Overall, the results show that while the CPS-based classifications are good enough to be useful for many purposes, there is almost certainly room for improvement—in the representation of the storms in reanalyses, in our objective metrics of ET, and in our scientific understanding of the ET process.

Supplemental information related to this paper is available at the Journals Online website: https://doi.org/10.1175/JCLI-D-18-0052.1.s1.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

This article has a companion article which can be found at http://journals.ametsoc.org/doi/abs/10.1175/JCLI-D-17-0518.1.

Publisher’s Note: This article was revised on 5 August 2019 in order to correct a typographical error in section 3d.

Corresponding author: Melanie Bieli, mb4036@columbia.edu

Supplementary Materials

    • Supplemental Materials (PDF 1.29 MB)
Save
  • Beven, J. L., 2008: Verification of National Hurricane Center forecasts of extratropical transition. Preprints, 28th Conf. on Hurricanes and Tropical Meteorology, Orlando, FL, Amer. Meteor. Soc., 10C.2, https://ams.confex.com/ams/28Hurricanes/techprogram/paper_138321.htm.

  • Beven, J. L., 2012: Cyclone type analysis and forecasting: A need to re-visit the issue. Preprints, 30th Conf. on Hurricanes and Tropical Meteorology, Ponte Vedra Beach, FL, Amer. Meteor. Soc., 2A.3, https://ams.confex.com/ams/30Hurricane/webprogram/Paper205647.html.

  • Bieli, M., S. J. Camargo, A. H. Sobel, J. L. Evans, and T. Hall, 2019: A global climatology of extratropical transition. Part I: Characteristics across basins. J. Climate, 32, 35573582, https://doi.org/10.1175/JCLI-D-17-0518.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Camargo, S. J., and A. A. Wing, 2016: Tropical cyclones in climate models. Wiley Interdiscip. Rev.: Climate Change, 7, 211237, https://doi.org/10.1002/wcc.373.

    • Search Google Scholar
    • Export Citation
  • Dee, D. P., and Coauthors, 2011: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Quart. J. Roy. Meteor. Soc., 137, 553597, https://doi.org/10.1002/qj.828.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ebita, A., and Coauthors, 2011: The Japanese 55-year Reanalysis “JRA-55”: An interim report. SOLA, 7, 149152, https://doi.org/10.2151/sola.2011-038.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Evans, C., and Coauthors, 2017: The extratropical transition of tropical cyclones. Part I: Cyclone evolution and direct impacts. Mon. Wea. Rev., 145, 43174344, https://doi.org/10.1175/MWR-D-17-0027.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Evans, J. L., and R. E. Hart, 2003: Objective indicators of the life cycle evolution of extratropical transition for Atlantic tropical cyclones. Mon. Wea. Rev., 131, 909925, https://doi.org/10.1175/1520-0493(2003)131<0909:OIOTLC>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fiorino, M., 2002: Analysis and forecasts of tropical cyclones in the ECMWF 40-year reanalysis (ERA-40). Extended Abstracts, 25th Conf. on Hurricanes and Tropical Meteorology, San Diego, CA, Amer. Meteor. Soc., 261–264, https://ams.confex.com/ams/25HURR/techprogram/paper_38743.htm.

  • Fogarty, C., 2010: Forecasting extratropical transition. Proc. Seventh Int. Workshop on Tropical Cyclones, St. Gilles Les Bains, La Réunion, France, WMO, 2.5, http://www.wmo.int/pages/prog/arep/wwrp/tmr/otherfileformats/documents/2_5.pdf.

  • Gibson, J., P. Kållberg, S. Uppala, A. Hernandez, A. Nomura, and E. Serrano, 1997: ERA-15 Description. Vol. 1, ECMWF Re-Analysis (ERA) Project Report Series, European Centre for Medium-Range Weather Forecasts, 72 pp., https://www.ecmwf.int/en/elibrary/9584-era-description.

  • Hart, R. E., 2003: A cyclone phase space derived from thermal wind and thermal asymmetry. Mon. Wea. Rev., 131, 585616, https://doi.org/10.1175/1520-0493(2003)131<0585:ACPSDF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hatsushika, H., J. Tsutsui, M. Fiorino, and K. Onogi, 2006: Impact of wind profile retrievals on the analysis of tropical cyclones in the JRA-25 reanalysis. J. Meteor. Soc. Japan, 84, 891905, https://doi.org/10.2151/jmsj.84.891.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hodges, K., A. Cobb, and P. L. Vidale, 2017: How well are tropical cyclones represented in reanalysis datasets? J. Climate, 30, 52435264, https://doi.org/10.1175/JCLI-D-16-0557.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jones, S. C., and Coauthors, 2003: The extratropical transition of tropical cyclones: Forecast challenges, current understanding, and future directions. Wea. Forecasting, 18, 10521092, https://doi.org/10.1175/1520-0434(2003)018<1052:TETOTC>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kitabatake, N., 2011: Climatology of extratropical transition of tropical cyclones in the western North Pacific defined by using cyclone phase space. J. Meteor. Soc. Japan, 89, 309325, https://doi.org/10.2151/jmsj.2011-402.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knaff, J. A., S. P. Longmore, and D. A. Molenar, 2014: An objective satellite-based tropical cyclone size climatology. J. Climate, 27, 455476, https://doi.org/10.1175/JCLI-D-13-00096.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kobayashi, S., and Coauthors, 2015: The JRA-55 reanalysis: General specifications and basic characteristics. J. Meteor. Soc. Japan, 93, 548, https://doi.org/10.2151/jmsj.2015-001.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kofron, D. E., E. A. Ritchie, and J. S. Tyo, 2010: Determination of a consistent time for the extratropical transition of tropical cyclones. Part I: Examination of existing methods for finding “ET time”. Mon. Wea. Rev., 138, 43284343, https://doi.org/10.1175/2010MWR3180.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Landsea, C. W., and J. L. Franklin, 2013: Atlantic hurricane database uncertainty and presentation of a new database format. Mon. Wea. Rev., 141, 35763592, https://doi.org/10.1175/MWR-D-12-00254.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liu, M., G. A. Vecchi, J. A. Smith, and H. Murakami, 2017: The present-day simulation and twenty-first-century projection of the climatology of extratropical transition in the North Atlantic. J. Climate, 30, 27392756, https://doi.org/10.1175/JCLI-D-16-0352.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Masson, A., 2014: The extratropical transition of Hurricane Igor and the impacts on Newfoundland. Nat. Hazards, 72, 617632, https://doi.org/10.1007/s11069-013-1027-x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Matthews, B. W., 1975: Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim. Biophys. Acta, Protein Struct., 405, 442451, https://doi.org/10.1016/0005-2795(75)90109-9.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Murakami, H., 2014: Tropical cyclones in reanalysis data sets. Geophys. Res. Lett., 41, 21332141, https://doi.org/10.1002/2014GL059519.

  • Politis, D. N., J. P. Romano, and M. Wolf, 1999: Subsampling. Springer-Verlag, 348 pp., https://doi.org/10.1007/978-1-4612-1554-7.

  • Randall, D. A., and Coauthors, 2007: Climate models and their evaluation. Climate Change 2007: The Physical Science Basis, S. Solomon et al., Eds., Cambridge University Press, 589662.

  • Schenkel, B. A., and R. E. Hart, 2012: An examination of tropical cyclone position, intensity, and intensity life cycle within atmospheric reanalysis datasets. J. Climate, 25, 34533475, https://doi.org/10.1175/2011JCLI4208.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ting, K. M., 2010: Precision and recall. Encyclopedia of Machine Learning, C. Sammut and G. I. Webb, Eds, Springer, 781, https://doi.org/10.1007/978-0-387-30164-8_652.

    • Crossref
    • Export Citation
  • Wood, K. M., and E. A. Ritchie, 2014: A 40-year climatology of extratropical transition in the eastern North Pacific. J. Climate, 27, 59996015, https://doi.org/10.1175/JCLI-D-13-00645.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zarzycki, C. M., D. R. Thatcher, and C. Jablonowski, 2017: Objective tropical cyclone extratropical transition detection in high-resolution reanalysis and climate model data. J. Adv. Model. Earth Syst., 9, 130148, https://doi.org/10.1002/2016ms000775.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 662 161 22
PDF Downloads 564 121 7