Editorial Type:
Article
Article Type:
Research Article

PostProcessing and Visualization Techniques for Convection-Allowing Ensembles

Brett Roberts Cooperative Institute for Mesoscale Meteorological Studies, and NOAA/NWS/Storm Prediction Center, and NOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Brett Roberts in
Current site
Google Scholar
PubMed Close
,
Israel L. Jirak NOAA/NWS/Storm Prediction Center, Norman, Oklahoma

Search for other papers by Israel L. Jirak in
Current site
Google Scholar
PubMed Close
,
Adam J. Clark NOAA/OAR/National Severe Storms Laboratory, and School of Meteorology, University of Oklahoma, Norman, Oklahoma

Search for other papers by Adam J. Clark in
Current site
Google Scholar
PubMed Close
,
Steven J. Weiss NOAA/NWS/Storm Prediction Center, Norman, Oklahoma

Search for other papers by Steven J. Weiss in
Current site
Google Scholar
PubMed Close
, and
John S. Kain NOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by John S. Kain in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jul 2019
DOI:
https://doi.org/10.1175/BAMS-D-18-0041.1
Page(s):
1245–1258
Restricted access

Abstract

Since the early 2000s, growing computing resources for numerical weather prediction (NWP) and scientific advances enabled development and testing of experimental, real-time deterministic convection-allowing models (CAMs). By the late 2000s, continued advancements spurred development of CAM ensemble forecast systems, through which a broad range of successful forecasting applications have been demonstrated. This work has prepared the National Weather Service (NWS) for practical usage of the High Resolution Ensemble Forecast (HREF) system, which was implemented operationally in November 2017. Historically, methods for postprocessing and visualizing products from regional and global ensemble prediction systems (e.g., ensemble means and spaghetti plots) have been applied to fields that provide information on mesoscale to synoptic-scale processes. However, much of the value from CAMs is derived from the explicit simulation of deep convection and associated storm-attribute fields like updraft helicity and simulated reflectivity. Thus, fully exploiting CAM ensembles for forecasting applications has required the development of fundamentally new data extraction, postprocessing, and visualization strategies. In the process, challenges imposed by the immense data volume inherent to these systems required new approaches when considering diverse factors like forecaster interpretation and computational expense. In this article, we review the current state of postprocessing and visualization for CAM ensembles, with a particular focus on forecast applications for severe convective hazards that have been evaluated within NOAA’s Hazardous Weather Testbed. The HREF web viewer implemented at the NWS Storm Prediction Center (SPC) is presented as a prototype for deploying these techniques in real time on a flexible and widely accessible platform.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CURRENT AFFILIATION: NOAA/NCEP/Environmental Modeling Center, College Park, Maryland

CORRESPONDING AUTHOR: Brett Roberts, brett.roberts@noaa.gov

Abstract

Since the early 2000s, growing computing resources for numerical weather prediction (NWP) and scientific advances enabled development and testing of experimental, real-time deterministic convection-allowing models (CAMs). By the late 2000s, continued advancements spurred development of CAM ensemble forecast systems, through which a broad range of successful forecasting applications have been demonstrated. This work has prepared the National Weather Service (NWS) for practical usage of the High Resolution Ensemble Forecast (HREF) system, which was implemented operationally in November 2017. Historically, methods for postprocessing and visualizing products from regional and global ensemble prediction systems (e.g., ensemble means and spaghetti plots) have been applied to fields that provide information on mesoscale to synoptic-scale processes. However, much of the value from CAMs is derived from the explicit simulation of deep convection and associated storm-attribute fields like updraft helicity and simulated reflectivity. Thus, fully exploiting CAM ensembles for forecasting applications has required the development of fundamentally new data extraction, postprocessing, and visualization strategies. In the process, challenges imposed by the immense data volume inherent to these systems required new approaches when considering diverse factors like forecaster interpretation and computational expense. In this article, we review the current state of postprocessing and visualization for CAM ensembles, with a particular focus on forecast applications for severe convective hazards that have been evaluated within NOAA’s Hazardous Weather Testbed. The HREF web viewer implemented at the NWS Storm Prediction Center (SPC) is presented as a prototype for deploying these techniques in real time on a flexible and widely accessible platform.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CURRENT AFFILIATION: NOAA/NCEP/Environmental Modeling Center, College Park, Maryland

CORRESPONDING AUTHOR: Brett Roberts, brett.roberts@noaa.gov
Save
Cover Bulletin of the American Meteorological Society
Bulletin of the American Meteorological Society

  • Ahijevych, D., E. Gilleland, B. G. Brown, and E. E. Ebert, 2009: Application of spatial verification methods to idealized and NWP-gridded precipitation forecasts. Wea. Forecasting, 24, 1485–1497, https://doi.org/10.1175/2009WAF2222298.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Aligo, E. A., B. Ferrier, and J. R. Carley, 2018: Modified NAM microphysics for forecasts of deep convective storms. Mon. Wea. Rev., 146, 4115–4153, https://doi.org/10.1175/MWR-D-17-0277.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Blake, B. T., J. R. Carley, T. I. Alcott, I. Jankov, M. E. Pyle, S. E. Perfater, and B. Albright, 2018: An adaptive approach for the calculation of ensemble gridpoint probabilities. Wea. Forecasting, 33, 1063–1080, https://doi.org/10.1175/WAF-D-18-0035.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, A. J., W. A. Gallus, and T.-C. Chen, 2007: Comparison of the diurnal precipitation cycle in convection-resolving and non-convection-resolving mesoscale models. Mon. Wea. Rev., 135, 3456–3473, https://doi.org/10.1175/MWR3467.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, A. J., and Coauthors, 2012a: An overview of the 2010 Hazardous Weather Testbed Experimental Forecast Program spring experiment. Bull. Amer. Meteor. Soc., 93, 55–74, https://doi.org/10.1175/BAMS-D-11-00040.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, A. J., J. S. Kain, P. T. Marsh, J. Correia, M. Xue, and F. Kong, 2012b: Forecasting tornado pathlengths using a three-dimensional object identification algorithm applied to convection-allowing forecasts. Wea. Forecasting, 27, 1090–1113, https://doi.org/10.1175/WAF-D-11-00147.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, A. J., and Coauthors, 2018: The Community Leveraged Unified Ensemble (CLUE) in the 2016 NOAA/Hazardous Weather Testbed Spring Forecasting Experiment. Bull. Amer. Meteor. Soc., 99, 1433–1448, https://doi.org/10.1175/BAMS-D-16-0309.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Dey, S. R. A., R. S. Plant, N. M. Roberts, and S. Migliorini, 2016: Assessing spatial precipitation uncertainties in a convective-scale ensemble. Quart. J. Roy. Meteor. Soc., 142, 2935–2948, https://doi.org/10.1002/qj.2893.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Done, J., C. A. Davis, and M. Weisman, 2004: The next generation of NWP: Explicit forecasts of convection using the Weather Research and Forecasting (WRF) model. Atmos. Sci. Lett., 5, 110–117, https://doi.org/10.1002/asl.72.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Droegemeier, K. K., 1997: The numerical prediction of thunderstorms: Challenges, potential benefits and results from real-time operational tests. WMO Bull., 46, 324–336.

    • Search Google Scholar
    • Export Citation

  • Ebert, E. E., 2009: Neighborhood verification: A strategy for rewarding close forecasts. Wea. Forecasting, 24, 1498–1510, https://doi.org/10.1175/2009WAF2222251.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Ferrier, B., 1994: A double-moment multiple-phase four-class bulk ice scheme. Part I: Description. J. Atmos. Sci., 51, 249–280, https://doi.org/10.1175/1520-0469(1994)051<0249:ADMMPF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gallo, B. T., A. J. Clark, and S. R. Dembek, 2016: Forecasting tornadoes using convection-permitting ensembles. Wea. Forecasting, 31, 273–295, https://doi.org/10.1175/WAF-D-15-0134.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gallo, B. T., and Coauthors, 2017: Breaking new ground in severe weather prediction: The 2015 NOAA/Hazardous Weather Testbed Spring Forecasting Experiment. Wea. Forecasting, 32, 1541–1568, https://doi.org/10.1175/WAF-D-16-0178.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Guyer, J. L., and I. L. Jirak, 2014: The utility of storm-scale ensemble forecasts of cool season severe weather events from the SPC perspective. 27th Conf. on Severe Local Storms, Madison, WI, Amer. Meteor. Soc., P3.37, https://ams.confex.com/ams/27SLS/webprogram/Paper254640.html.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., and J.-O. J. Lim, 2006: The WRF single-moment 6-class microphysics scheme (WSM6). J. Korean Meteor. Soc, 42, 129–151.

  • Hong, S.-Y., Y. Noh, and J. Dudhia, 2006: A new vertical diffusion package with an explicit treatment of entrainment processes. Mon. Wea. Rev., 134, 2318–2341, https://doi.org/10.1175/MWR3199.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Janjić, Z. I., 1994: The step-mountain eta coordinate model: Further developments of the convection, viscous sublayer, and turbulence closure schemes. Mon. Wea. Rev., 122, 927–945, https://doi.org/10.1175/1520-0493(1994)122<0927:TSMECM>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Janjić, Z. I., and R. L. Gall, 2012: Scientific documentation of the NCEP nonhydrostatic multiscale model on the B grid (NMMB). Part 1: Dynamics. NCAR Tech. Note NCAR/TN-489+STR, 75 pp., https://doi.org/10.5065/D6WH2MZX.

    • Search Google Scholar
    • Export Citation

  • Jirak, I. L., S. J. Weiss, and C. J. Melick, 2012: The SPC storm-scale ensemble of opportunity: Overview and results from the 2012 Hazardous Weather Testbed Spring Forecasting Experiment. 26th Conf. on Severe Local Storms, Nashville, TN, Amer. Meteor. Soc., P9.137, https://ams.confex.com/ams/26SLS/webprogram/Paper211729.html.

    • Search Google Scholar
    • Export Citation

  • Jirak, I. L., C. J. Melick, and S. J. Weiss, 2014: Combining probabilistic ensemble information from the environment with simulated storm attributes to generate calibrated probabilities of severe weather hazards. 27th Conf. on Severe Local Storms, Madison, WI, Amer. Meteor. Soc., P2.5, https://ams.confex.com/ams/27SLS/webprogram/Paper254649.html.

    • Search Google Scholar
    • Export Citation

  • Jirak, I. L., A. J. Clark, B. Roberts, B. T. Gallo, and S. J. Weiss, 2018: Exploring the optimal configuration of the High Resolution Ensemble Forecast System. 25th Conf. on Numerical Weather Prediction, Denver, CO, Amer. Meteor. Soc., 14B.6, https://ams.confex.com/ams/29WAF25NWP/webprogram/Paper345640.html.

    • Search Google Scholar
    • Export Citation

  • Jones, T. A., K. Knopfmeier, D. Wheatley, G. Creager, P. Minnis, and R. Palikonda, 2016: Storm-scale data assimilation and ensemble forecasting with the NSSL Experimental Warn-on-Forecast System. Part II: Combined radar and satellite data experiments. Wea. Forecasting, 31, 297–327, https://doi.org/10.1175/WAF-D-15-0107.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Jung, Y., G. Zhang, and M. Xue, 2008: Assimilation of simulated polarimetric radar data for a convective storm using the ensemble Kalman filter. Part I: Observation operators for reflectivity and polarimetric variables. Mon. Wea. Rev., 136, 2228–2245, https://doi.org/10.1175/2007MWR2083.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kain, J. S., S. J. Weiss, J. J. Levit, M. E. Baldwin, and D. R. Bright, 2006: Examination of convection-allowing configurations of the WRF Model for the prediction of severe convective weather: The SPC/NSSL Spring Program 2004. Wea. Forecasting, 21, 167–181, https://doi.org/10.1175/WAF906.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kain, J. S., and Coauthors, 2008: Some practical considerations regarding horizontal resolution in the first generation of operational convection-allowing NWP. Wea. Forecasting, 23, 931–952, https://doi.org/10.1175/WAF2007106.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kain, J. S., S. R. Dembek, S. J. Weiss, J. L. Case, J. J. Levit, and R. A. Sobash, 2010: Extracting unique information from high-resolution forecast models: Monitoring selected fields and phenomena every time step. Wea. Forecasting, 25, 1536–1542, https://doi.org/10.1175/2010WAF2222430.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Koch, S. E., B. Ferrier, M. T. Stoelinga, E. Szoke, S. J. Weiss, and J. S. Kain, 2005: The use of simulated radar reflectivity fields in the diagnosis of mesoscale phenomena from high-resolution WRF model forecasts. 11th Conf. on Mesoscale Processes, Albuquerque, NM, Amer. Meteor. Soc., J4J.7, https://ams.confex.com/ams/pdfpapers/97032.pdf.

  • Krocak, M., and H. E. Brooks, 2017: Towards consistency in forecasting severe weather events across a wide range of temporal and spatial scales in the FACETS paradigm. Seventh Conf. on Transition of Research to Operations, Seattle, WA, Amer. Meteor. Soc., J4.6, https://ams.confex.com/ams/97Annual/webprogram/Paper308117.html.

  • Lilly, D. K., 1990: Numerical prediction of thunderstorms—Has its time come? Quart. J. Roy. Meteor. Soc., 116, 779–798, https://doi.org/10.1002/qj.49711649402.

    • Search Google Scholar
    • Export Citation

  • Liu, C., M. W. Moncrieff, J. D. Tuttle, and R. E. Carbone, 2006: Explicit and parameterized episodes of warm-season precipitation over the continental United States. Adv. Atmos. Sci., 23, 91–105, https://doi.org/10.1007/s00376-006-0010-9.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Schwartz, C. S., and R. A. Sobash, 2017: Generating probabilistic forecasts from convection-allowing ensembles using neighborhood approaches: A review and recommendations. Mon. Wea. Rev., 145, 3397–3418, https://doi.org/10.1175/MWR-D-16-0400.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Schwartz, C. S., G. S. Romine, R. A. Sobash, K. R. Fossell, and M. L. Weisman, 2015: NCAR’s experimental real-time convection-allowing ensemble prediction system. Wea. Forecasting, 30, 1645–1654, https://doi.org/10.1175/WAF-D-15-0103.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., and Coauthors, 2008: A description of the Advanced Research WRF version 3. NCAR Tech. Note NCAR/TN-475+STR, 113 pp., https://doi.org/10.5065/D68S4MVH.

    • Search Google Scholar
    • Export Citation

  • Skinner, P. S., and Coauthors, 2018: Object-based verification of a prototype Warn-on-Forecast system. Wea. Forecasting, 33, 1225–1250, https://doi.org/10.1175/WAF-D-18-0020.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Sobash, R. A., J. S. Kain, D. R. Bright, A. R. Dean, M. C. Coniglio, and S. J. Weiss, 2011: Probabilistic forecast guidance for severe thunderstorms based on the identification of extreme phenomena in convection-allowing model forecasts. Wea. Forecasting, 26, 714–728, https://doi.org/10.1175/WAF-D-10-05046.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Sobash, R. A., G. S. Romine, C. S. Schwartz, D. J. Gagne, and M. L. Weisman, 2016a: Explicit forecasts of low-level rotation from convection-allowing models for next-day tornado prediction. Wea. Forecasting, 31, 1591–1614, https://doi.org/10.1175/WAF-D-16-0073.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Sobash, R. A., C. S. Schwartz, G. S. Romine, K. R. Fossell, and M. L. Weisman, 2016b: Severe weather prediction using storm surrogates from an ensemble forecasting system. Wea. Forecasting, 31, 255–271, https://doi.org/10.1175/WAF-D-15-0138.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Stensrud, D. J., and Coauthors, 2009: Convective-scale Warn-on-Forecast System: A vision for 2020. Bull. Amer. Meteor. Soc., 90, 1487–1499, https://doi.org/10.1175/2009BAMS2795.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Toth, Z., E. Kalnay, S. M. Tracton, R. Wobus, and J. Irwin, 1997: A synoptic evaluation of the NCEP ensemble. Wea. Forecasting, 12, 140–153, https://doi.org/10.1175/1520-0434(1997)012<0140:ASEOTN>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Weisman, M. L., W. C. Skamarock, and J. B. Klemp, 1997: The resolution dependence of explicitly modeled convective systems. Mon. Wea. Rev., 125, 527–548, https://doi.org/10.1175/1520-0493(1997)125<0527:TRDOEM>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Weisman, M. L., C. Davis, W. Wang, K. W. Manning, and J. B. Klemp, 2008: Experiences with 0–36-h explicit convective forecasts with the WRF-ARW model. Wea. Forecasting, 23, 407–437, https://doi.org/10.1175/2007WAF2007005.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wheatley, D. M., K. H. Knopfmeier, T. A. Jones, and G. J. Creager, 2015: Storm-scale data assimilation and ensemble forecasting with the NSSL Experimental Warn-on-Forecast System. Part I: Radar data experiments. Wea. Forecasting, 30, 1795–1817, https://doi.org/10.1175/WAF-D-15-0043.1.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wilson, K. A., P. L. Heinselman, P. S. Skinner, J. J. Choate, and K. E. Klockow-McClain, 2019: Meteorologists’ interpretations of storm-scale ensemble-based forecast guidance. Wea. Climate Soc., 11, 337–354, https://doi.org/10.1175/WCAS-D-18-0084.1.

    • Search Google Scholar
    • Export Citation

  • Xue, M., D. Wang, J. Gao, K. Brewster, and K. K. Droegemeier, 2003: The Advanced Regional Prediction System (ARPS), storm-scale numerical weather prediction and data assimilation. Meteor. Atmos. Phys., 82, 139–170.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Xue, M., and Coauthors, 2007: CAPS real-time storm-scale ensemble and high-resolution forecasts as part of the NOAA Hazardous Weather Testbed 2007 spring experiment. 18th Conf. on Numerical Weather Prediction, Park City, UT, Amer. Meteor. Soc., 3B.1, https://ams.confex.com/ams/pdfpapers/124587.pdf.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1072 380 27
PDF Downloads 889 290 16