Estimating Full Longwave and Shortwave Radiative Transfer with Neural Networks of Varying Complexity

Ryan Lagerquist aCooperative Institute for Research in the Atmosphere, Colorado State University, Fort Collins, Colorado
bNational Oceanic and Atmospheric Administration/Global Systems Laboratory, Boulder, Colorado

Search for other papers by Ryan Lagerquist in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0002-8409-415X
,
David D. Turner bNational Oceanic and Atmospheric Administration/Global Systems Laboratory, Boulder, Colorado

Search for other papers by David D. Turner in
Current site
Google Scholar
PubMed
Close
,
Imme Ebert-Uphoff aCooperative Institute for Research in the Atmosphere, Colorado State University, Fort Collins, Colorado
cDepartment of Electrical and Computer Engineering, Colorado State University, Fort Collins, Colorado

Search for other papers by Imme Ebert-Uphoff in
Current site
Google Scholar
PubMed
Close
, and
Jebb Q. Stewart bNational Oceanic and Atmospheric Administration/Global Systems Laboratory, Boulder, Colorado

Search for other papers by Jebb Q. Stewart in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Radiative transfer (RT) is a crucial but computationally expensive process in numerical weather/climate prediction. We develop neural networks (NN) to emulate a common RT parameterization called the Rapid Radiative Transfer Model (RRTM), with the goal of creating a faster parameterization for the Global Forecast System (GFS) v16. In previous work we emulated a highly simplified version of the shortwave RRTM only—excluding many predictor variables, driven by Rapid Refresh forecasts interpolated to a consistent height grid, using only 30 sites in the Northern Hemisphere. In this work we emulate the full shortwave and longwave RRTM—with all predictor variables, driven by GFSv16 forecasts on the native pressure–sigma grid, using data from around the globe. We experiment with NNs of widely varying complexity, including the U-net++ and U-net3+ architectures and deeply supervised training, designed to ensure realistic and accurate structure in gridded predictions. We evaluate the optimal shortwave NN and optimal longwave NN in great detail—as a function of geographic location, cloud regime, and other weather types. Both NNs produce extremely reliable heating rates and fluxes. The shortwave NN has an overall RMSE/MAE/bias of 0.14/0.08/−0.002 K day−1 for heating rate and 6.3/4.3/−0.1 W m−2 for net flux. Analogous numbers for the longwave NN are 0.22/0.12/−0.0006 K day−1 and 1.07/0.76/+0.01 W m−2. Both NNs perform well in nearly all situations, and the shortwave (longwave) NN is 7510 (90) times faster than the RRTM. Both will soon be tested online in the GFSv16.

Significance Statement

Radiative transfer is an important process for weather and climate. Accurate radiative transfer models exist, such as the RRTM, but these models are computationally slow. We develop neural networks (NNs), a type of machine learning model that is often computationally fast after training, to mimic the RRTM. We wish to accelerate the RRTM by orders of magnitude without sacrificing much accuracy. We drive both the NNs and RRTM with data from the GFSv16, an operational weather model, using locations around the globe during all seasons. We show that the NNs are highly accurate and much faster than the RRTM, which suggests that the NNs could be used to solve radiative transfer inside the GFSv16.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ryan Lagerquist, ralager@colostate.edu

Abstract

Radiative transfer (RT) is a crucial but computationally expensive process in numerical weather/climate prediction. We develop neural networks (NN) to emulate a common RT parameterization called the Rapid Radiative Transfer Model (RRTM), with the goal of creating a faster parameterization for the Global Forecast System (GFS) v16. In previous work we emulated a highly simplified version of the shortwave RRTM only—excluding many predictor variables, driven by Rapid Refresh forecasts interpolated to a consistent height grid, using only 30 sites in the Northern Hemisphere. In this work we emulate the full shortwave and longwave RRTM—with all predictor variables, driven by GFSv16 forecasts on the native pressure–sigma grid, using data from around the globe. We experiment with NNs of widely varying complexity, including the U-net++ and U-net3+ architectures and deeply supervised training, designed to ensure realistic and accurate structure in gridded predictions. We evaluate the optimal shortwave NN and optimal longwave NN in great detail—as a function of geographic location, cloud regime, and other weather types. Both NNs produce extremely reliable heating rates and fluxes. The shortwave NN has an overall RMSE/MAE/bias of 0.14/0.08/−0.002 K day−1 for heating rate and 6.3/4.3/−0.1 W m−2 for net flux. Analogous numbers for the longwave NN are 0.22/0.12/−0.0006 K day−1 and 1.07/0.76/+0.01 W m−2. Both NNs perform well in nearly all situations, and the shortwave (longwave) NN is 7510 (90) times faster than the RRTM. Both will soon be tested online in the GFSv16.

Significance Statement

Radiative transfer is an important process for weather and climate. Accurate radiative transfer models exist, such as the RRTM, but these models are computationally slow. We develop neural networks (NNs), a type of machine learning model that is often computationally fast after training, to mimic the RRTM. We wish to accelerate the RRTM by orders of magnitude without sacrificing much accuracy. We drive both the NNs and RRTM with data from the GFSv16, an operational weather model, using locations around the globe during all seasons. We show that the NNs are highly accurate and much faster than the RRTM, which suggests that the NNs could be used to solve radiative transfer inside the GFSv16.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ryan Lagerquist, ralager@colostate.edu

Supplementary Materials

    • Supplemental Materials (PDF 56.576 MB)
Save
  • Anderson, G. P., S. A. Clough, F. X. Kneizys, J. H. Chetwynd, and E. P. Shettle, 1986: AFGL atmospheric constituent profiles (0–120 km). Air Force Geophysics Laboratory Tech. Rep. AFGL-TR-86-0110, 46 pp., https://apps.dtic.mil/sti/citations/ADA175173.

  • Baek, S., 2017: A revised radiation package of G-packed McICA and two-stream approximation: Performance evaluation in a global weather forecasting model. J. Adv. Model. Earth Syst., 9, 16281640, https://doi.org/10.1002/2017MS000994.

    • Search Google Scholar
    • Export Citation
  • Belochitski, A., and V. Krasnopolsky, 2021: Robustness of neural network emulations of radiative transfer parameterizations in a state-of-the-art general circulation model. Geosci. Model Dev., 14, 74257437, https://doi.org/10.5194/gmd-14-7425-2021.

    • Search Google Scholar
    • Export Citation
  • Beucler, T., and Coauthors, 2021: Climate-invariant machine learning. arXiv, 2112.08440v2, https://doi.org/10.48550/arXiv.2112.08440.

  • Boukabara, S.-A., V. Krasnopolsky, J. Q. Stewart, E. S. Maddy, N. Shahroudi, and R. N. Hoffman, 2019: Leveraging modern artificial intelligence for remote sensing and NWP: Benefits and challenges. Bull. Amer. Meteor. Soc., 100, ES473ES491, https://doi.org/10.1175/BAMS-D-18-0324.1.

    • Search Google Scholar
    • Export Citation
  • Chantry, M., P. Dueben, R. Hogan, and P. Ukkonen, 2022: Progress on emulating the radiation scheme via machine learning. ECMWF Newsletter, No. 173, ECMWF, Reading, United Kingdom, 9–10, https://www.ecmwf.int/en/newsletter/173/news/progress-emulating-radiation-scheme-machine-learning.

  • Chantry, M., P. Ukkonen, R. Hogan, and P. Dueben, 2023: Emulating radiative transfer in a numerical weather prediction model. 2023 EGU General Assembly, Vienna, Austria, European Geoscience Union, Abstract EGU23-3256, https://doi.org/10.5194/egusphere-egu23-3256.

  • Chevallier, F., F. Chéruy, N. A. Scott, and A. Chédin, 1998: A neural network approach for a fast and accurate computation of a longwave radiative budget. J. Appl. Meteor., 37, 13851397, https://doi.org/10.1175/1520-0450(1998)037<1385:ANNAFA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Cotronei, A., and T. Slawig, 2020: Single-precision arithmetic in ECHAM radiation reduces runtime and energy consumption. Geosci. Model Dev., 13, 27832804, https://doi.org/10.5194/gmd-13-2783-2020.

    • Search Google Scholar
    • Export Citation
  • ECMWF, 2022: Infero: A lower-level API for machine learning inference in operations. GitHub, https://github.com/ecmwf-projects/infero.

  • Geiss, A., P.-L. Ma, B. Singh, and J. C. Hardin, 2022: Emulating aerosol optics with randomly generated neural networks. Geosci. Model Dev., 16, 23552370, https://doi.org/10.5194/gmd-16-2355-2023.

    • Search Google Scholar
    • Export Citation
  • Gil, Y., and Coauthors, 2019: Intelligent systems for geosciences: An essential research agenda. Commun. ACM, 62, 7684, https://doi.org/10.1145/3192335.

    • Search Google Scholar
    • Export Citation
  • Goodfellow, I., Y. Bengio, and A. Courville, 2016: Deep Learning. MIT Press, 800 pp.

  • Hsu, W.-R., and A. H. Murphy, 1986: The attributes diagram: A geometrical framework for assessing the quality of probability forecasts. Int. J. Forecasting, 2, 285293, https://doi.org/10.1016/0169-2070(86)90048-8.

    • Search Google Scholar
    • Export Citation
  • Huang, H., and Coauthors, 2020: UNet 3+: A full-scale connected UNet for medical image segmentation. arXiv, 2004.08790v1, https://doi.org/10.48550/arXiv.2004.08790.

  • Iacono, M. J., J. S. Delamere, E. J. Mlawer, M. W. Shephard, S. A. Clough, and W. D. Collins, 2008: Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models. J. Geophys. Res., 113, D13103, https://doi.org/10.1029/2008JD009944.

    • Search Google Scholar
    • Export Citation
  • Jensen, E. J., and Coauthors, 2013: Ice nucleation and dehydration in the tropical tropopause layer. Proc. Natl. Acad. Sci. USA, 110, 20412046, https://doi.org/10.1073/pnas.1217104110.

    • Search Google Scholar
    • Export Citation
  • Kim, P. S., and H.-J. Song, 2022: Usefulness of automatic hyperparameter optimization in developing radiation emulator in a numerical weather prediction model. Atmosphere, 13, 721, https://doi.org/10.3390/atmos13050721.

    • Search Google Scholar
    • Export Citation
  • Krasnopolsky, V., A. Belochitski, Y. Hou, S. Lord, and F. Yang, 2012: Accurate and fast neural network emulations of long and short wave radiation for the NCEP Global Forecast System model. NCEP Office Note 471, 36 pp., https://repository.library.noaa.gov/view/noaa/6951.

  • Lagerquist, R., D. Turner, I. Ebert-Uphoff, J. Stewart, and V. Hagerty, 2021: Using deep learning to emulate and accelerate a radiative transfer model. J. Atmos. Oceanic Technol., 38, 16731696, https://doi.org/10.1175/JTECH-D-21-0007.1.

    • Search Google Scholar
    • Export Citation
  • Le, T., C. Liu, B. Yao, V. Natraj, and Y. Yung, 2020: Application of machine learning to hyperspectral radiative transfer simulations. J. Quant. Spectrosc. Radiat. Transfer, 246, 106928, https://doi.org/10.1016/j.jqsrt.2020.106928.

    • Search Google Scholar
    • Export Citation
  • Li, Z., N. Kovachki, K. Azizzadenesheli, B. Liu, A. Stuart, K. Bhattacharya, and A. Anandkumar, 2020: Multipole graph neural operator for parametric partial differential equations. Proc. 34th Int. Conf. on Neural Information Processing Systems, Online, ACM, 6755–6766, https://dl.acm.org/doi/abs/10.5555/3495724.3496291.

  • Liu, Y., R. Caballero, and J. M. Monteiro, 2020: RadNet 1.0: Exploring deep learning architectures for longwave radiative transfer. Geosci. Model Dev., 13, 43994412, https://doi.org/10.5194/gmd-13-4399-2020.

    • Search Google Scholar
    • Export Citation
  • Lu, L., P. Jin, and G. E. Karniadakis, 2019: DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv, 1910.03193v3, https://doi.org/10.48550/arXiv.1910.03193.

  • Meyer, D., R. J. Hogan, P. D. Dueben, and S. L. Mason, 2022: Machine learning emulation of 3D cloud radiative effects. J. Adv. Model. Earth Syst., 14, e2021MS002550, https://doi.org/10.1029/2021MS002550.

    • Search Google Scholar
    • Export Citation
  • Miles, N. L., J. Verlinde, and E. E. Clothiaux, 2000: Cloud droplet size distributions in low-level stratiform clouds. J. Atmos. Sci., 57, 295311, https://doi.org/10.1175/1520-0469(2000)057<0295:CDSDIL>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Mishra, S., D. L. Mitchell, D. D. Turner, and R. P. Lawson, 2014: Parameterization of ice fall speeds in midlatitude cirrus: Results from SPartICus. J. Geophys. Res. Atmos., 119, 38573876, https://doi.org/10.1002/2013JD020602.

    • Search Google Scholar
    • Export Citation
  • Mitchell, D. L., R. P. Lawson, and B. Baker, 2011: Understanding effective diameter and its application to terrestrial radiation in ice clouds. Atmos. Chem. Phys., 11, 34173429, https://doi.org/10.5194/acp-11-3417-2011.

    • Search Google Scholar
    • Export Citation
  • Mlawer, E. J., and D. D. Turner, 2016: Spectral radiation measurements and analysis in the ARM program. The Atmospheric Radiation Measurement (ARM) Program: The First 20 Years, Meteor. Monogr., Vol. 57, Amer. Meteor. Soc., https://doi.org/10.1175/AMSMONOGRAPHS-D-15-0027.1.

  • Mlawer, E. J., S. J. Taubman, P. D. Brown, M. J. Iacono, and S. A. Clough, 1997: Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave. J. Geophys. Res., 102, 16 66316 682, https://doi.org/10.1029/97JD00237.

    • Search Google Scholar
    • Export Citation
  • Muñoz-Esparza, D., C. Becker, J. A. Sauer, D. J. Gagne II, J. Schreck, and B. Kosović, 2022: On the application of an observations-based machine learning parameterization of surface layer fluxes within an atmospheric large-eddy simulation model. J. Geophys. Res. Atmos., 127, e2021JD036214, https://doi.org/10.1029/2021JD036214.

    • Search Google Scholar
    • Export Citation
  • Myhre, G., C. Myhre, B. Samset, and T. Storelvmo, 2013: Aerosols and their relation to global climate and climate sensitivity. Nat. Educ. Knowl., 4, 7, https://www.nature.com/scitable/knowledge/library/aerosols-and-their-relation-to-global-climate-102215345/.

    • Search Google Scholar
    • Export Citation
  • Neubauer, D., U. Lohmann, C. Hoose, and M. G. Frontoso, 2014: Impact of the representation of marine stratocumulus clouds on the anthropogenic aerosol effect. Atmos. Chem. Phys., 14, 11 99712 022, https://doi.org/10.5194/acp-14-11997-2014.

    • Search Google Scholar
    • Export Citation
  • Pal, A., S. Mahajan, and M. R. Norman, 2019: Using deep neural networks as cost-effective surrogate models for super-parameterized E3SM radiative transfer. Geophys. Res. Lett., 46, 60696079, https://doi.org/10.1029/2018GL081646.

    • Search Google Scholar
    • Export Citation
  • Pincus, R., and B. Stevens, 2013: Paths to accuracy for radiation parameterizations in atmospheric models. J. Adv. Model. Earth Syst., 5, 225233, https://doi.org/10.1002/jame.20027.

    • Search Google Scholar
    • Export Citation
  • Pincus, R., H. W. Barker, and J.-J. Morcrette, 2003: A fast, flexible, approximate technique for computing radiative transfer in inhomogeneous cloud fields. J. Geophys. Res., 108, 4376, https://doi.org/10.1029/2002JD003322.

    • Search Google Scholar
    • Export Citation
  • Pincus, R., E. J. Mlawer, and J. S. Delamere, 2019: Balancing accuracy, efficiency, and flexibility in radiation calculations for dynamical models. J. Adv. Model. Earth Syst., 11, 30743089, https://doi.org/10.1029/2019MS001621.

    • Search Google Scholar
    • Export Citation
  • Rasp, S., 2020: Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations: General algorithms and Lorenz 96 case study (v1.0). Geosci. Model Dev., 13, 21852196, https://doi.org/10.5194/gmd-13-2185-2020.

    • Search Google Scholar
    • Export Citation
  • Reichstein, M., G. Camps-Valls, B. Stevens, M. Jung, J. Denzler, N. Carvalhais, and Prabhat, 2019: Deep learning and process understanding for data-driven Earth system science. Nature, 566, 195204, https://doi.org/10.1038/s41586-019-0912-1.

    • Search Google Scholar
    • Export Citation
  • Roh, S., and H.-J. Song, 2020: Evaluation of neural network emulations for radiation parameterization in cloud resolving model. Geophys. Res. Lett., 47, e2020GL089444, https://doi.org/10.1029/2020GL089444.

    • Search Google Scholar
    • Export Citation
  • Ronneberger, O., P. Fischer, and T. Brox, 2015: U-net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention, N. Navab et al. Eds., Lecture Notes in Computer Science, Vol. 9351, Springer, 234–241, https://doi.org/10.1007/978-3-319-24574-4_28.

  • Schmetz, J., 1989: Towards a surface radiation climatology: Retrieval of downward irradiances from satellites. Atmos. Res., 23, 287321, https://doi.org/10.1016/0169-8095(89)90023-9.

    • Search Google Scholar
    • Export Citation
  • Song, H.-J., and S. Roh, 2021: Improved weather forecasting using neural network emulation for radiation parameterization. J. Adv. Model. Earth Syst., 13, e2021MS002609, https://doi.org/10.1029/2021MS002609.

    • Search Google Scholar
    • Export Citation
  • Sonoda, S., and N. Murata, 2017: Neural network with unbounded activation functions is universal approximator. Appl. Comput. Harmonic Anal., 43, 233268, https://doi.org/10.1016/j.acha.2015.12.005.

    • Search Google Scholar
    • Export Citation
  • Stegmann, P. G., B. Johnson, I. Moradi, B. Karpowicz, and W. McCarty, 2022: A deep learning approach to fast radiative transfer. J. Quant. Spectrosc. Radiat. Transfer, 280, 108088, https://doi.org/10.1016/j.jqsrt.2022.108088.

    • Search Google Scholar
    • Export Citation
  • Tang, T., and Coauthors, 2020: Response of surface shortwave cloud radiative effect to greenhouse gases and aerosols and its impact on summer maximum temperature. Atmos. Chem. Phys., 20, 82518266, https://doi.org/10.5194/acp-20-8251-2020.

    • Search Google Scholar
    • Export Citation
  • Turner, D. D., and Coauthors, 2004: The QME AERI LBLRTM: A closure experiment for downwelling high spectral resolution infrared radiance. J. Atmos. Sci., 61, 26572675, https://doi.org/10.1175/JAS3300.1.

    • Search Google Scholar
    • Export Citation
  • Turner, D. D., A. Merrelli, D. Vimont, and E. J. Mlawer, 2012: Impact of modifying the longwave water vapor continuum absorption model on Community Earth System Model simulations. J. Geophys. Res., 117, D04106, https://doi.org/10.1029/2011JD016440.

    • Search Google Scholar
    • Export Citation
  • Turner, D. D., and Coauthors, 2020: A verification approach used in developing the Rapid Refresh and other numerical weather prediction models. J. Oper. Meteor., 8, 3953, https://doi.org/10.15191/nwajom.2020.0803.

    • Search Google Scholar
    • Export Citation
  • Ukkonen, P., 2022: Exploring pathways to more accurate machine learning emulation of atmospheric radiative transfer. J. Adv. Model. Earth Syst., 14, e2021MS002875, https://doi.org/10.1029/2021MS002875.

    • Search Google Scholar
    • Export Citation
  • Ukkonen, P., R. Pincus, R. J. Hogan, K. P. Nielsen, and E. Kaas, 2020: Accelerating radiation computations for dynamical models with targeted machine learning and code optimization. J. Adv. Model. Earth Syst., 12, e2020MS002226, https://doi.org/10.1029/2020MS002226.

    • Search Google Scholar
    • Export Citation
  • Veerman, M., R. Pincus, R. Stoffer, C. V. Leeuwen, D. Podareanu, and C. V. Heerwaarden, 2020: Predicting atmospheric optical properties for radiative transfer computations using neural networks. 2020 EGU General Assembly, Online, European Geoscience Union, Abstract EGU2020-5574, https://doi.org/10.5194/egusphere-egu2020-5574.

  • Wallace, J. M., and P. V. Hobbs, 2006: Atmospheric Science: An Introductory Survey. 2nd ed. Academic Press, 504 pp.

  • Yang, C., J. Chiu, J. Gristey, G. Feingold, and W. Gustafson, 2022: Machine learning emulation of 3D shortwave radiative transfer for shallow cumulus cloud fields. Conf. on Atmospheric Radiation, Atmospheric Radiative Transfer, and Light-Scattering Theory, Madison, WI, Amer. Meteor. Soc., 7.4, https://ams.confex.com/ams/CMM2022/meetingapp.cgi/Paper/406293.

  • Zhou, Z., M. M. R. Siddiquee, N. Tajbakhsh, and J. Liang, 2020: UNet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging, 39, 18561867, https://doi.org/10.1109/TMI.2019.2959609.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 809 699 37
Full Text Views 258 243 19
PDF Downloads 275 256 13