Editorial Type:
Article
Article Type:
Research Article

Evaluating the Performance of Planetary Boundary Layer and Cloud Microphysical Parameterization Schemes in Convection-Permitting Ensemble Forecasts Using Synthetic GOES-13 Satellite Observations

Rebecca Cintineo Cooperative Institute of Meteorological Satellite Studies, University of Wisconsin–Madison, Madison, Wisconsin

Search for other papers by Rebecca Cintineo in
Current site
Google Scholar
PubMed Close
,
Jason A. Otkin Cooperative Institute of Meteorological Satellite Studies, University of Wisconsin–Madison, Madison, Wisconsin

Search for other papers by Jason A. Otkin in
Current site
Google Scholar
PubMed Close
,
Ming Xue Center for the Analysis and Prediction of Storms, University of Oklahoma, Norman, Oklahoma

Search for other papers by Ming Xue in
Current site
Google Scholar
PubMed Close
, and
Fanyou Kong Center for the Analysis and Prediction of Storms, University of Oklahoma, Norman, Oklahoma

Search for other papers by Fanyou Kong in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jan 2014
DOI:
https://doi.org/10.1175/MWR-D-13-00143.1
Page(s):
163–182
Restricted access

Abstract

In this study, the ability of several cloud microphysical and planetary boundary layer parameterization schemes to accurately simulate cloud characteristics within 4-km grid-spacing ensemble forecasts over the contiguous United States was evaluated through comparison of synthetic Geostationary Operational Environmental Satellite (GOES) infrared brightness temperatures with observations. Four double-moment microphysics schemes and five planetary boundary layer (PBL) schemes were evaluated. Large differences were found in the simulated cloud cover, especially in the upper troposphere, when using different microphysics schemes. Overall, the results revealed that the Milbrandt–Yau and Morrison microphysics schemes tended to produce too much upper-level cloud cover, whereas the Thompson and the Weather Research and Forecasting Model (WRF) double-moment 6-class (WDM6) microphysics schemes did not contain enough high clouds. Smaller differences occurred in the cloud fields when using different PBL schemes, with the greatest spread in the ensemble statistics occurring during and after daily peak heating hours. Results varied somewhat depending upon the verification method employed, which indicates the importance of using a suite of verification tools when evaluating high-resolution model performance. Finally, large differences between the various microphysics and PBL schemes indicate that large uncertainties remain in how these schemes represent subgrid-scale processes.

Corresponding author address: Rebecca Cintineo, CIMSS, University of Wisconsin–Madison, 1225 West Dayton St., Madison, WI 53706. E-mail: rebecca.cintineo@ssec.wisc.edu

Abstract

In this study, the ability of several cloud microphysical and planetary boundary layer parameterization schemes to accurately simulate cloud characteristics within 4-km grid-spacing ensemble forecasts over the contiguous United States was evaluated through comparison of synthetic Geostationary Operational Environmental Satellite (GOES) infrared brightness temperatures with observations. Four double-moment microphysics schemes and five planetary boundary layer (PBL) schemes were evaluated. Large differences were found in the simulated cloud cover, especially in the upper troposphere, when using different microphysics schemes. Overall, the results revealed that the Milbrandt–Yau and Morrison microphysics schemes tended to produce too much upper-level cloud cover, whereas the Thompson and the Weather Research and Forecasting Model (WRF) double-moment 6-class (WDM6) microphysics schemes did not contain enough high clouds. Smaller differences occurred in the cloud fields when using different PBL schemes, with the greatest spread in the ensemble statistics occurring during and after daily peak heating hours. Results varied somewhat depending upon the verification method employed, which indicates the importance of using a suite of verification tools when evaluating high-resolution model performance. Finally, large differences between the various microphysics and PBL schemes indicate that large uncertainties remain in how these schemes represent subgrid-scale processes.

Corresponding author address: Rebecca Cintineo, CIMSS, University of Wisconsin–Madison, 1225 West Dayton St., Madison, WI 53706. E-mail: rebecca.cintineo@ssec.wisc.edu
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Ackerman, S. A., 1996: Global satellite observations of negative brightness temperature differences between 11 and 6.7 μm. J. Atmos. Sci., 53, 2803–2812.

    • Search Google Scholar
    • Export Citation

  • Baum, B. A., P. Yang, A. J. Heymsfield, S. Platnick, M. D. King, and S. T. Bedka, 2005: Bulk scattering models for the remote sensing of ice clouds. Part II: Narrowband models. J. Appl. Meteor., 44, 1896–1911.

    • Search Google Scholar
    • Export Citation

  • Bikos, D., and Coauthors, 2012: Synthetic satellite imagery for real-time high-resolution model evaluation. Wea. Forecasting, 27, 784–795.

    • Search Google Scholar
    • Export Citation

  • Chaboureau, J.-P., and J.-P. Pinty, 2006: Validation of a cirrus parameterization with Meteosat Second Generation observations. Geophys. Res. Lett., 33, L03815, doi:10.1029/2005GL024725.

    • Search Google Scholar
    • Export Citation

  • Chen, S.-H., and W.-Y. Sun, 2002: A one-dimensional time dependent cloud model. J. Meteor. Soc. Japan, 80, 99–118.

  • Chou, M.-D., and M. J. Suarez, 1994: An efficient thermal infrared radiation parameterization for use in general circulation models. NASA Tech. Memo. 104606, Vol. 3, 85 pp.

  • Clark, A. J., and Coauthors, 2012: An overview of the 2010 Hazardous Weather Testbed Experimental Forecast Program Spring Experiment. Bull. Amer. Meteor. Soc., 93, 55–74.

    • Search Google Scholar
    • Export Citation

  • Coniglio, M. C., J. Corria Jr., P. T. Marsh, and F. Kong, 2013: Verification of convection-allowing WRF model forecasts of the planetary boundary layer using sounding observations. Wea. Forecasting, 28, 842–862.

    • Search Google Scholar
    • Export Citation

  • Davis, C., B. Brown, and R. Bullock, 2006: Object-based verification of precipitation forecasts. Part I: Methodology and application to mesoscale rain areas. Mon. Wea. Rev., 134, 1772–1784.

    • Search Google Scholar
    • Export Citation

  • Feltz, W. F., K. M. Bedka, J. A. Otkin, T. Greenwald, and S. A. Ackerman, 2009: Understanding satellite-observed mountain wave signatures using high-resolution numerical model data. Wea. Forecasting, 24, 76–86.

    • Search Google Scholar
    • Export Citation

  • Gao, J., M. Zue, K. Brewster, and K. K. Droegemeier, 2004: A three-dimensional variational data analysis method with recursive filter for Doppler radars. J. Atmos. Oceanic Technol., 21, 457–469.

    • Search Google Scholar
    • Export Citation

  • Grasso, L. D., and T. Greenwald, 2004: Analysis of 10.7-mm brightness temperatures of a simulated thunderstorm with two-moment microphysics. Mon. Wea. Rev., 132, 815–825.

    • Search Google Scholar
    • Export Citation

  • Grasso, L. D., M. Sengupta, J. F. Dostalek, R. Brummer, and M. DeMaria, 2008: Synthetic satellite imagery for current and future environmental satellites. Int. J. Remote Sens., 29, 4373–4384.

    • Search Google Scholar
    • Export Citation

  • Grasso, L. D., M. Sengupta, and M. DeMaria, 2010: Comparison between observed and synthetic 6.5 and 10.7 mm GOES-12 imagery of thunderstorms that occurred on 8 May 2003. Int. J. Remote Sens., 31, 647–663.

    • Search Google Scholar
    • Export Citation

  • Han, Y., P. van Delst, Q. Liu, F. Weng, B. Yan, R. Treadon, and J. Derber, 2006: JCSDA Community Radiative Transfer Model (CRTM)—version 1. NOAA Tech. Rep. NESDIS 122, 40 pp.

  • Heidinger, A. K., C. O’Dell, R. Bennartz, and T. Greenwald, 2006: The successive-order-of-interaction radiative transfer model. Part I: Model development. J. Appl. Meteor. Climatol., 45, 1388–1402.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., 2010: A new stable boundary-layer mixing scheme and its impact on the simulated East Asian summer monsoon. Quart. J. Roy. Meteor. Soc., 136, 1481–1496.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., and J.-O. J. Lim, 2006: The WRF single-moment 6-class microphysics scheme (WSM6). J. Korean Meteor. Soc., 42, 129–151.

  • Hong, S.-Y., J. Dudhia, and S.-H. Chen, 2004: A revised approach to ice microphysical processes for the bulk parameterization of clouds and precipitation. Mon. Wea. Rev., 132, 103–120.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., Y. Noh, and J. Dudhia, 2006: A new vertical diffusion package with an explicit treatment of entrainment processes. Mon. Wea. Rev., 134, 2318–2341.

    • Search Google Scholar
    • Export Citation

  • Hu, M., M. Xue, and K. Brewster, 2006: 3DVAR and cloud analysis with WSR-88D level-II data for the prediction of Fort Worth tornadic thunderstorms. Part I: Cloud analysis and its impact. Mon. Wea. Rev., 134, 675–698.

    • Search Google Scholar
    • Export Citation

  • Hu, X.-M., J. W. Nielsen-Gammon, and F. Zhang, 2010: Evaluation of three planetary boundary layer schemes in the WRF model. J. Appl. Meteor. Climatol., 49, 1831–1844.

    • Search Google Scholar
    • Export Citation

  • Jankov, I., and Coauthors, 2011: An evaluation of five ARW-WRF microphysics schemes using synthetic GOES imagery for an atmospheric river event affecting the California coast. J. Hydrometeor., 12, 618–633.

    • Search Google Scholar
    • Export Citation

  • Karlsson, K.-G., 1996: Validation of modeled cloudiness using satellite-estimated cloud climatologies. Tellus, 48A, 767–785.

  • Kong, F., and Coauthors, 2007: Preliminary analysis on the real-time storm-scale ensemble forecasts produced as a part of the NOAA Hazardous Weather Testbed 2007 Spring Experiment. Preprints, 22nd Conf. on Weather Analysis and Forecasting/18th Conf. on Numerical Weather Prediction, Salt Lake City, UT, Amer. Meteor. Soc., 3B.2. [Available online at https://ams.confex.com/ams/22WAF18NWP/techprogram/paper_124667.htm.]

  • Kong, F., M. Xue, K. W. Thomas, Y. Wang, K. Brewster, and X. Wang, 2012a: CAPS storm-scale ensemble forecast in NOAA Hazardous Weather Testbed Spring Experiments. Extended Abstracts, Third WMO/WWRP Int. Symp. on Nowcasting and Very Short Range Forecasting, Rio de Janeiro, Brazil, WMO/WWRP. [Available online at http://www.labhidro.iag.usp.br/wsn12/papers/num4.pdf.]

  • Kong, F., and Coauthors, 2012b: CAPS storm-scale ensemble forecasting system for the NOAA HWT 2012 Spring Experiment: Impact of IC/LBC perturbations. Extended Abstracts, 26th Conf. on Severe Local Storms, Nashville, TN, Amer. Meteor. Soc., P138. [Available online at https://ams.confex.com/ams/26SLS/webprogram/Paper211966.html.]

  • Lim, K.-S. S., and S.-Y. Hong, 2010: Development of an effective double-moment cloud microphysics scheme with prognostic cloud condensation nuclei (CCN) for weather and climate models. Mon. Wea. Rev., 138, 1587–1612.

    • Search Google Scholar
    • Export Citation

  • Lopez, P., K. Finkele, P. Clark, and P. Mascart, 2003: Validation and intercomparison of three FASTEX cloud systems: Comparison with coarse-resolution simulations. Quart. J. Roy. Meteor. Soc., 129, 1841–1871.

    • Search Google Scholar
    • Export Citation

  • Mass, C. F., D. Ovens, K. Westrick, and B. A. Colle, 2002: Does increasing horizontal resolution produce more skillful forecasts? Bull. Amer. Meteor. Soc., 83, 407–430.

    • Search Google Scholar
    • Export Citation

  • Mecikalski, J. R., and K. M. Bedka, 2006: Forecasting convective initiation by monitoring the evolution of moving cumulus in daytime GOES imagery. Mon. Wea. Rev., 134, 49–78.

    • Search Google Scholar
    • Export Citation

  • Mellor, G. L., and T. Yamada, 1982: Development of a turbulence closure model for geophysical fluid problems. Rev. Geophys., 20, 851–875.

    • Search Google Scholar
    • Export Citation

  • Milbrandt, J. A., and M. K. Yau, 2005a: A multimoment bulk microphysics parameterization. Part I: Analysis of the role of the spectral shape parameter. J. Atmos. Sci., 62, 3051–3064.

    • Search Google Scholar
    • Export Citation

  • Milbrandt, J. A., and M. K. Yau, 2005b: A multimoment bulk microphysics parameterization. Part II: A proposed three-moment closure and scheme description. J. Atmos. Sci., 62, 3065–3081.

    • Search Google Scholar
    • Export Citation

  • Mlawer, E. J., S. J. Taubman, P. D. Brown, M. J. Iacono, and S. A. Clough, 1997: Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave. J. Geophys. Res., 102 (D14), 16 663–16 682.

    • Search Google Scholar
    • Export Citation

  • Morcrette, J. J., 1991: Evaluation of model-generated cloudiness: Satellite-observed and model-generated diurnal variability of brightness temperatures. Mon. Wea. Rev., 119, 1205–1224.

    • Search Google Scholar
    • Export Citation

  • Morrison, H., and J. Milbrandt, 2011: Comparison of two-moment bulk microphysics schemes in idealized supercell thunderstorm simulations. Mon. Wea. Rev., 139, 1103–1130.

    • Search Google Scholar
    • Export Citation

  • Morrison, H., G. Thompson, and V. Tatarskii, 2009: Impact of cloud microphysics on the development of trailing stratiform precipitation in a simulated squall line: Comparison of one- and two-moment schemes. Mon. Wea. Rev., 137, 991–1007.

    • Search Google Scholar
    • Export Citation

  • Nakanishi, M., 2001: Improvement of Mellor-Yamada turbulence closure model based on large-eddy simulation data. Bound.-Layer Meteor., 99, 349–378.

    • Search Google Scholar
    • Export Citation

  • Nakanishi, M., and H. Niino, 2004: An improved Mellor-Yamada level-3 model with condensation physics: Its design and verification. Bound.-Layer Meteor., 112, 1–31.

    • Search Google Scholar
    • Export Citation

  • Nakanishi, M., and H. Niino, 2006: An improved Mellor-Yamada level-3 model: Its numerical stability and application to a regional prediction of advection fog. Bound.-Layer Meteor., 119, 397–407.

    • Search Google Scholar
    • Export Citation

  • Nakanishi, M., and H. Niino, 2009: Development of an improved turbulence closure model for the atmospheric boundary layer. J. Meteor. Soc. Japan, 87, 895–912.

    • Search Google Scholar
    • Export Citation

  • O’Dell, C. W., A. K. Heidinger, T. Greenwald, P. Bauer, and R. Bennartz, 2006: The successive-order-of-interaction radiative transfer model. Part II: Model performance and applications. J. Appl. Meteor. Climatol., 45, 1403–1413.

    • Search Google Scholar
    • Export Citation

  • Otkin, J. A., 2010: Clear and cloudy-sky infrared brightness temperature assimilation using an ensemble Kalman filter. J. Geophys. Res., 115, D19207, doi:10.1029/2009JD013759.

    • Search Google Scholar
    • Export Citation

  • Otkin, J. A., and T. J. Greenwald, 2008: Comparison of WRF model-simulated and MODIS-derived cloud data. Mon. Wea. Rev., 136, 1957–1970.

    • Search Google Scholar
    • Export Citation

  • Otkin, J. A., D. J. Posselt, E. R. Olson, H.-L. Huang, J. E. Davies, J. Li, and C. S. Velden, 2007: Mesoscale numerical weather prediction models used in support of infrared hyperspectral measurement simulation and product algorithm development. J. Atmos. Oceanic Technol., 24, 585–601.

    • Search Google Scholar
    • Export Citation

  • Otkin, J. A., T. J. Greenwald, J. Sieglaff, and H.-L. Huang, 2009: Validation of a large-scale simulated brightness temperature dataset using SEVIRI satellite observations. J. Appl. Meteor. Climatol., 48, 1613–1626.

    • Search Google Scholar
    • Export Citation

  • Pleim, J. E., 2007a: A combined local and nonlocal closure model for the atmospheric boundary layer. Part I: Model description and testing. J. Appl. Meteor. Climatol., 46, 1383–1395.

    • Search Google Scholar
    • Export Citation

  • Pleim, J. E., 2007b: A combined local and nonlocal closure model for the atmospheric boundary layer. Part II: Application and evaluation in a mesoscale meteorological model. J. Appl. Meteor. Climatol., 46, 1396–1409.

    • Search Google Scholar
    • Export Citation

  • Rikus, L., 1997: Application of a scheme for validating clouds in an operational global NWP model. Mon. Wea. Rev., 125, 1615–1637.

  • Roberts, N. M., 2008: Assessing the spatial and temporal variation in the skill of precipitation forecasts from an NWP model. Meteor. Appl., 15, 163–169.

    • Search Google Scholar
    • Export Citation

  • Roberts, N. M., and H. W. Lean, 2008: Scale-selective verification of rainfall accumulations from high- resolution forecasts of convective events. Mon. Wea. Rev., 136, 78–97.

    • Search Google Scholar
    • Export Citation

  • Sanders, F., and J. R. Gyakum, 1980: Synoptic-dynamic climatology of the “bomb.” Mon. Wea. Rev., 108, 1589–1606.

  • Schmetz, J., S. A. Tjemkes, M. Gube, and L. van de Berg, 1997: Monitoring deep convection and convective overshooting with METEOSAT. Adv. Space Res., 19, 433–441.

    • Search Google Scholar
    • Export Citation

  • Seemann, S. W., E. E. Borbas, R. O. Knuteson, G. R. Stephenson, and H.-L. Huang, 2008: Development of a global infrared land surface emissivity database for application to clear-sky sounding retrievals from multispectral satellite radiance measurements. J. Appl. Meteor. Climatol., 47, 108–123.

    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., 2004: Evaluating mesoscale NWP models using kinetic energy spectra. Mon. Wea. Rev., 132, 3019–3032.

  • Skamarock, W. C., and Coauthors, 2008: A description of the Advanced Research WRF version 3. NCAR Tech. Note NCAR/TN-475+STR, Mesoscale and Microscale Meteorology Division, NCAR, Boulder, CO, 125 pp. [Available online at http://www.mmm.ucar.edu/wrf/users/docs/arw_v3.pdf.]

  • Sukoriansky, S., B. Galperin, and I. Staroselsky, 2005: A quasi-normal scale elimination model of turbulent flows with stable stratification. Phys. Fluids, 17, 85–107.

    • Search Google Scholar
    • Export Citation

  • Sukoriansky, S., B. Galperin, and V. Perov, 2006: A quasi-normal scale elimination model of turbulence and its application to stably stratified flows. Nonlinear Processes Geophys., 13, 9–22.

    • Search Google Scholar
    • Export Citation

  • Sun, Z., and L. Rikus, 2004: Validating model clouds and their optical properties using geostationary satellite imagery. Mon. Wea. Rev., 132, 2006–2020.

    • Search Google Scholar
    • Export Citation

  • Thompson, G., P. R. Field, R. M. Rasmussen, and W. D. Hall, 2008: Explicit forecasts of winter precipitation using an improved bulk microphysics scheme. Part II: Implementation of a new snow parameterization. Mon. Wea. Rev., 136, 5095–5115.

    • Search Google Scholar
    • Export Citation

  • Tselioudis, G., and C. Jakob, 2002: Evaluation of midlatitude cloud properties in a weather and a climate model: Dependence on dynamic regime and spatial resolution. J. Geophys. Res., 107, 4781, doi:10.1029/2002JD002259.

    • Search Google Scholar
    • Export Citation

  • Van Weverberg, K., and Coauthors, 2013: The role of cloud microphysics parameterization in the simulation of mesoscale convective system clouds and precipitation in the tropical western Pacific. J. Atmos. Sci., 70, 1104–1128.

    • Search Google Scholar
    • Export Citation

  • Xie, B., J. C. H. Fung, A. Chan, and A. Lau, 2012: Evaluation of nonlocal and local planetary boundary layer schemes in the WRF model. J. Geophys. Res., 117, D12103, doi:10.1029/2011JD017080.

    • Search Google Scholar
    • Export Citation

  • Xue, M., D. H. Wang, J. D. Gao, K. Brewster, and K. K. Droegemeier, 2003: The Advanced Regional Prediction System (ARPS), storm-scale numerical weather prediction and assimilation. Meteor. Atmos. Phys., 82, 139–170.

    • Search Google Scholar
    • Export Citation

  • Xue, M., and Coauthors, 2007: CAPS realtime storm-scale ensemble and high-resolution forecasts as part of the NOAA Hazardous Weather Testbed 2007 spring experiment. Preprints, 22nd Conf. on Weather Analysis and Forecasting/18th Conf. on Numerical Weather Prediction, Salt Lake City, UT, Amer. Meteor. Soc., 3B.1. [Available online at https://ams.confex.com/ams/22WAF18NWP/techprogram/paper_124587.htm.]

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 589 184 7
PDF Downloads 468 163 5