Tropical and Extratropical Cyclone Detection Using Deep Learning

Christina Kumler-Bonfanti Cooperative Institute for Research in Environmental Sciences, University of Colorado Boulder, Boulder, Colorado
NOAA/OAR/ESRL/Global Systems Laboratory, Boulder, Colorado

Search for other papers by Christina Kumler-Bonfanti in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0001-6129-1209
,
Jebb Stewart NOAA/OAR/ESRL/Global Systems Laboratory, Boulder, Colorado

Search for other papers by Jebb Stewart in
Current site
Google Scholar
PubMed
Close
,
David Hall NVIDIA Corporation, Boulder Colorado

Search for other papers by David Hall in
Current site
Google Scholar
PubMed
Close
, and
Mark Govett NOAA/OAR/ESRL/Global Systems Laboratory, Boulder, Colorado

Search for other papers by Mark Govett in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Extracting valuable information from large sets of diverse meteorological data is a time-intensive process. Machine-learning methods can help to improve both speed and accuracy of this process. Specifically, deep-learning image-segmentation models using the U-Net structure perform faster and can identify areas that are missed by more restrictive approaches, such as expert hand-labeling and a priori heuristic methods. This paper discusses four different state-of-the-art U-Net models designed for detection of tropical and extratropical cyclone regions of interest (ROI) from two separate input sources: total precipitable water output from the Global Forecast System (GFS) model and water vapor radiance images from the Geostationary Operational Environmental Satellite (GOES). These models are referred to as International Best Track Archive for Climate Stewardship (IBTrACS)-GFS, Heuristic-GFS, IBTrACS-GOES, and Heuristic-GOES. All four U-Nets are fast information extraction tools and perform with an ROI detection accuracy ranging from 80% to 99%. These are additionally evaluated with the Dice and Tversky intersection-over-union (IoU) metrics, having Dice coefficient scores ranging from 0.51 to 0.76 and Tversky coefficients ranging from 0.56 to 0.74. The extratropical cyclone U-Net model performed 3 times as fast as the comparable heuristic model used to detect the same ROI. The U-Nets were specifically selected for their capabilities in detecting cyclone ROI beyond the scope of the training labels. These machine-learning models identified more ambiguous and active ROI missed by the heuristic model and hand-labeling methods that are commonly used in generating real-time weather alerts, having a potentially direct impact on public safety.

© 2020 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Christina Kumler-Bonfanti, christina.e.kumler@noaa.gov

Abstract

Extracting valuable information from large sets of diverse meteorological data is a time-intensive process. Machine-learning methods can help to improve both speed and accuracy of this process. Specifically, deep-learning image-segmentation models using the U-Net structure perform faster and can identify areas that are missed by more restrictive approaches, such as expert hand-labeling and a priori heuristic methods. This paper discusses four different state-of-the-art U-Net models designed for detection of tropical and extratropical cyclone regions of interest (ROI) from two separate input sources: total precipitable water output from the Global Forecast System (GFS) model and water vapor radiance images from the Geostationary Operational Environmental Satellite (GOES). These models are referred to as International Best Track Archive for Climate Stewardship (IBTrACS)-GFS, Heuristic-GFS, IBTrACS-GOES, and Heuristic-GOES. All four U-Nets are fast information extraction tools and perform with an ROI detection accuracy ranging from 80% to 99%. These are additionally evaluated with the Dice and Tversky intersection-over-union (IoU) metrics, having Dice coefficient scores ranging from 0.51 to 0.76 and Tversky coefficients ranging from 0.56 to 0.74. The extratropical cyclone U-Net model performed 3 times as fast as the comparable heuristic model used to detect the same ROI. The U-Nets were specifically selected for their capabilities in detecting cyclone ROI beyond the scope of the training labels. These machine-learning models identified more ambiguous and active ROI missed by the heuristic model and hand-labeling methods that are commonly used in generating real-time weather alerts, having a potentially direct impact on public safety.

© 2020 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Christina Kumler-Bonfanti, christina.e.kumler@noaa.gov
Save
  • American Meteorological Society, 2019: Extratropical cyclone. Glossary of Meteorology, http://glossary.ametsoc.org/wiki/Extratropical_cyclone.

  • Atlantic Oceanographic and Meteorological Laboratory, 2020: What is an extra-tropical cyclone? NOAA, accessed 4 May 2020, http://www.aoml.noaa.gov/hrd/tcfaq/A7.html.

  • Bahrampour, S., N. Ramakrishnan, L. Schott, and M. Shah, 2015: Comparative study of deep learning software frameworks. arXiv 1511.06435, 9 pp., https://arxiv.org/pdf/1511.06435.pdf.

  • Bonfanti, C., L. Trailovic, J. Stewart, and M. Govett, 2018: Machine learning: Defining Worldwide cyclone labels for training. 2018 21st Int. Conf. on Information Fusion (FUSION), Cambridge, United Kingdom, IEEE, 753–760, https://doi.org/10.23919/icif.2018.8455276.

    • Crossref
    • Export Citation
  • Cheng, K.-S., J.-S. Lin, and C.-W. Mao, 1996: The application of competitive Hopfield neural network to medical image segmentation. IEEE Trans. Med. Imaging, 15, 560567, https://doi.org/10.1109/42.511759.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cichoki, A., and R. Unbehauen, 1996: Neural Networks for Optimization and Signal Processing. John Wiley and Sons, 544 pp.

  • Ciresan, D., U. Meier, and J. Schmidhuber, 2012: Multi-column deep neural networks for image classification. 2012 IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, IEEE, 3642–3649, https://doi.org/10.1109/cvpr.2012.6248110.

    • Crossref
    • Export Citation
  • Deng, J., W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, 2009: ImageNet: A large-scale hierarchical image database. 2009 IEEE Conf. on Computer Vision and Pattern Recognition, Miami, FL, IEEE, 248–255, https://doi.org/10.1109/cvpr.2009.5206848.

    • Crossref
    • Export Citation
  • Deng, L., 2012: The MNIST database of handwritten digit images for machine learning research. IEEE Signal Process. Mag., 29, 141142, https://doi.org/10.1109/MSP.2012.2211477.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dia, H., 2001: An object-oriented neural network approach to short-term traffic forecasting. Eur. J. Oper. Res., 131, 253261, https://doi.org/10.1016/S0377-2217(00)00125-9.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gagne, D. J., A. Mcgovern, S. E. Haupt, R. A. Sobash, J. K. Williams, and M. Xue, 2017: Storm-based probabilistic hail forecasting with machine learning applied to convection-allowing ensembles. Wea. Forecasting, 32, 18191840, https://doi.org/10.1175/WAF-D-17-0010.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Giacinto, G., and F. Roli, 2001: Design of effective neural network ensembles for image classification purposes. Image Vis. Comput., 19, 699707, https://doi.org/10.1016/S0262-8856(01)00045-2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Giffard-Roisin, S., M. Yang, G. Charpiat, C. K. Bonfanti, B. Kégl, and C. Monteleoni, 2020: Tropical cyclone track forecasting using fused deep learning from aligned reanalysis data. Front. Big Data, 3, 1, https://doi.org/10.3389/fdata.2020.00001.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Glorot, X., A. Bordes, and Y. Bengio, 2011: Deep sparse rectifier neural networks. 14th Int. Conf. on Artificial Intelligence and Statistics (AISTATS)2011, Fort Lauderdale, FL, JMLR, 315–323.

  • Gulli, A., and S. Pal, 2017: Deep Learning with Keras: Implement Neural Networks with Keras on Theano and Tensorflow. Packt Publishing, 318 pp.

  • He, K., X. Zhang, S. Ren, and J. Sun, 2016: Deep residual learning for image recognition. 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, IEEE, 770–778, https://doi.org/10.1109/cvpr.2016.90.

    • Crossref
    • Export Citation
  • Holland, G. J., 1993: Ready reckoner. Global Guide to Tropical Cyclone Forecasting, World Meteorological Organization Doc. WMO/TC-560, Rep. TCP-31, 9.1–9.32, https://library.wmo.int/doc_num.php?explnum_id=9598.

  • Jenner, L., 2015: GOES overview and history. NASA, accessed 25 September 2018, http://www.nasa.gov/content/goes-overview/index.html.

  • Jergensen, G. E., A. McGovern, R. Lagerquist, and T. Smith, 2020: Classifying convective storms using machine learning. Wea. Forecasting, 35, 537559, https://doi.org/10.1175/WAF-D-19-0170.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knapp, K. R., M. C. Kruk, D. H. Levinson, H. J. Diamond, and C. J. Neumann, 2010: The International Best Track Archive for Climate Stewardship (IBTrACS). Bull. Amer. Meteor. Soc., 91, 363376, https://doi.org/10.1175/2009BAMS2755.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Krizhevsky, A., I. Sutskever, and G. E. Hinton, 2017: ImageNet classification with deep convolutional neural networks. Commun. ACM, 60, 8490, https://doi.org/10.1145/3065386.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lagerquist, R., A. McGovern, C. R. Homeyer, D. J. Gagne II, and T. Smith, 2020: Deep learning on three-dimensional multiscale data for next-hour tornado prediction. Mon. Wea. Rev., 148, 28372861, https://doi.org/10.1175/MWR-D-19-0372.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lawrence, S., C. Giles, A. C. Tsoi, and A. Back, 1997: Face recognition: A convolutional neural-network approach. IEEE Trans. Neural Networks., 8, 98113, https://doi.org/10.1109/72.554195.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • LeCun, Y., and Y. Bengio, 1995: Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks, MIT Press, 276–279.

  • LeCun, Y., Y. Bengio, and G. Hinton, 2015: Deep learning. Nature, 521, 436444, https://doi.org/10.1038/nature14539.

  • Lee, Y., G. Wahba, and S. A. Ackerman, 2004: Cloud classification of satellite radiance data by multicategory support vector machines. J. Atmos. Oceanic Technol., 21, 159169, https://doi.org/10.1175/1520-0426(2004)021<0159:CCOSRD>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liang, M., and X. Hu, 2015: Recurrent convolutional neural network for object recognition. 2015 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Boston, MA, IEEE, 3367–3375, https://doi.org/10.1109/cvpr.2015.7298958.

    • Crossref
    • Export Citation
  • Lin, T.-Y., P. Goyal, R. Girshick, K. He, and P. Dollar, 2017: Focal loss for dense object detection. 2017 IEEE Int. Conf. on Computer Vision (ICCV), Venice, Italy, IEEE, 2999–3007, https://doi.org/10.1109/iccv.2017.324.

    • Crossref
    • Export Citation
  • Liu, S., and W. Deng, 2015: Very deep convolutional neural network based image classification using small training sample size. 2015 Third IAPR Asian Conf. on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia, IEEE, 730–734, https://doi.org/10.1109/acpr.2015.7486599.

    • Crossref
    • Export Citation
  • Long, J., E. Shelhamer, and T. Darrell, 2015: Fully convolutional networks for semantic segmentation. 2015 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Boston, MA, IEEE, 3431–3440, https://doi.org/10.1109/cvpr.2015.7298965.

    • Crossref
    • Export Citation
  • McGovern, A., K. L. Elmore, D. J. Gagne, S. E. Haupt, C. D. Karstens, R. Lagerquist, T. Smith, and J. K. Williams, 2017: Using artificial intelligence to improve real-time decision-making for high-impact weather. Bull. Amer. Meteor. Soc., 98, 20732090, https://doi.org/10.1175/BAMS-D-16-0123.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Merrill, R. T., 1993: Tropical cyclone structure. Global Guide to Tropical Cyclone Forecasting, World Meteorological Organization Doc. WMO/TC-560, Rep. TCP-31, 2.1–2.60, https://library.wmo.int/doc_num.php?explnum_id=9598.

  • National Hurricane Center, 2013: Saffir-Simpson Hurricane Wind Scale. NOAA, https://www.nhc.noaa.gov/aboutsshws.php.

  • NCEI, 2019: Global Forecast System (GFS). NCEP National Climatic Data Center, accessed 15 December 2019, http://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-forcast-system-gfs.

  • Neu, U., and Coauthors, 2013: IMILAST: A community effort to intercompare extratropical cyclone detection and tracking algorithms. Bull. Amer. Meteor. Soc., 94, 529547, https://doi.org/10.1175/BAMS-D-11-00154.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Patterson, J., and A. Gibson, 2017: Major architectures of deep networks. Deep Learning: A Practitioner’s Approach. OʼReilly, 117–164.

  • Recknagel, F., M. French, P. Harkonen, and K.-I. Yabunaka, 1997: Artificial neural network approach for modelling and prediction of algal blooms. Ecol. Modell., 96, 1128, https://doi.org/10.1016/S0304-3800(96)00049-X.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ronneberger, O., 2017: Invited Talk: U-Net Convolutional Networks for biomedical image segmentation. Bildverarbeitung für die Medizin 2017, Informatik aktuell, Springer, 3, https://doi.org/10.1007/978-3-662-54345-0_3.

    • Crossref
    • Export Citation
  • Ronneberger, O., P. Fischer, and T. Brox, 2015: U-Net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Lecture Notes in Computer Science, Springer, 234–241, https://doi.org/10.1007/978-3-319-24574-4_28.

    • Crossref
    • Export Citation
  • Schmit, T. J., S. S. Lindstrom, J. J. Gerth, and M. M. Gunshor, 2018: Applications of the 16 spectral bands on the Advanced Baseline Imager (ABI). J. Oper. Meteor., 06, 3346, https://doi.org/10.15191/nwajom.2018.0604.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sergeev, A., and M. Del Balso, 2018: Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv 1802.05799, 10 pp., https://arxiv.org/pdf/1802.05799.pdf.

  • Simonyan, K., and A. Zisserman, 2015: Very deep convolutional networks for large-scale image recognition. arXiv 1409.1556, 14 pp., https://arxiv.org/pdf/1409.1556.pdf.

  • Srivastava, N., G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, 2014: Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res., 15, 19291958.

    • Search Google Scholar
    • Export Citation
  • Sudre, C. H., W. Li, T. Vercauteren, S. Ourselin, and M. J. Cardoso, 2017: Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, M. Cardoso et al., Eds., Lecture Notes in Computer Science, Springer, 240–248, https://doi.org/10.1007/978-3-319-67558-9_28.

    • Crossref
    • Export Citation
  • Weingroff, M., 2014: How satellite observations impact NWP. UCAR, accessed 15 March 2019, http://kejian1.cmatc.cn/vod/comet/nwp/sat_nwp/print.php.htm.

All Time Past Year Past 30 Days
Abstract Views 1107 0 0
Full Text Views 1757 834 49
PDF Downloads 1466 511 38