Browse
Abstract
The National Weather Service plays a critical role in alerting the public when dangerous weather occurs. Tornado warnings are one of the most publicly visible products the NWS issues given the large societal impacts tornadoes can have. Understanding the performance of these warnings is crucial for providing adequate warning during tornadic events and improving overall warning performance. This study aims to understand warning performance during the lifetimes of individual storms (specifically in terms of probability of detection and lead time). For example, does probability of detection vary based on if the tornado was the first produced by the storm, or the last? We use tornado outbreak data from 2008 to 2014, archived NEXRAD radar data, and the NWS verification database to associate each tornado report with a storm object. This approach allows for an analysis of warning performance based on the chronological order of tornado occurrence within each storm. Results show that the probability of detection and lead time increase with later tornadoes in the storm; the first tornadoes of each storm are less likely to be warned and on average have less lead time. Probability of detection also decreases overnight, especially for first tornadoes and storms that only produce one tornado. These results are important for understanding how tornado warning performance varies during individual storm life cycles and how upstream forecast products (e.g., Storm Prediction Center tornado watches, mesoscale discussions, etc.) may increase warning confidence for the first tornado produced by each storm.
Significance Statement
In this study, we focus on better understanding real-time tornado warning performance on a storm-by-storm basis. This approach allows us to examine how warning performance can change based on the order of each tornado within its parent storm. Using tornado reports, warning products, and radar data during tornado outbreaks from 2008 to 2014, we find that probability of detection and lead time increase with later tornadoes produced by the same storm. In other words, for storms that produce multiple tornadoes, the first tornado is generally the least likely to be warned in advance; when it is warned in advance, it generally contains less lead time than subsequent tornadoes. These findings provide important new analyses of tornado warning performance, particularly for the first tornado of each storm, and will help inform strategies for improving warning performance.
Abstract
The National Weather Service plays a critical role in alerting the public when dangerous weather occurs. Tornado warnings are one of the most publicly visible products the NWS issues given the large societal impacts tornadoes can have. Understanding the performance of these warnings is crucial for providing adequate warning during tornadic events and improving overall warning performance. This study aims to understand warning performance during the lifetimes of individual storms (specifically in terms of probability of detection and lead time). For example, does probability of detection vary based on if the tornado was the first produced by the storm, or the last? We use tornado outbreak data from 2008 to 2014, archived NEXRAD radar data, and the NWS verification database to associate each tornado report with a storm object. This approach allows for an analysis of warning performance based on the chronological order of tornado occurrence within each storm. Results show that the probability of detection and lead time increase with later tornadoes in the storm; the first tornadoes of each storm are less likely to be warned and on average have less lead time. Probability of detection also decreases overnight, especially for first tornadoes and storms that only produce one tornado. These results are important for understanding how tornado warning performance varies during individual storm life cycles and how upstream forecast products (e.g., Storm Prediction Center tornado watches, mesoscale discussions, etc.) may increase warning confidence for the first tornado produced by each storm.
Significance Statement
In this study, we focus on better understanding real-time tornado warning performance on a storm-by-storm basis. This approach allows us to examine how warning performance can change based on the order of each tornado within its parent storm. Using tornado reports, warning products, and radar data during tornado outbreaks from 2008 to 2014, we find that probability of detection and lead time increase with later tornadoes produced by the same storm. In other words, for storms that produce multiple tornadoes, the first tornado is generally the least likely to be warned in advance; when it is warned in advance, it generally contains less lead time than subsequent tornadoes. These findings provide important new analyses of tornado warning performance, particularly for the first tornado of each storm, and will help inform strategies for improving warning performance.
Abstract
Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. In order to fill the dearth of resources covering neural networks with a meteorological lens, this paper discusses machine learning methods in a plain language format that is targeted for the operational meteorological community. This is the second paper in a pair that aim to serve as a machine learning resource for meteorologists. While the first paper focused on traditional machine learning methods (e.g., random forest), here a broad spectrum of neural networks and deep learning methods are discussed. Specifically this paper covers perceptrons, artificial neural networks, convolutional neural networks and U-networks. Like the part 1 paper, this manuscript discusses the terms associated with neural networks and their training. Then the manuscript provides some intuition behind every method and concludes by showing each method used in a meteorological example of diagnosing thunderstorms from satellite images (e.g., lightning flashes). This paper is accompanied with an open-source code repository to allow readers to explore neural networks using either the dataset provided (which is used in the paper) or as a template for alternate datasets.
Abstract
Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. In order to fill the dearth of resources covering neural networks with a meteorological lens, this paper discusses machine learning methods in a plain language format that is targeted for the operational meteorological community. This is the second paper in a pair that aim to serve as a machine learning resource for meteorologists. While the first paper focused on traditional machine learning methods (e.g., random forest), here a broad spectrum of neural networks and deep learning methods are discussed. Specifically this paper covers perceptrons, artificial neural networks, convolutional neural networks and U-networks. Like the part 1 paper, this manuscript discusses the terms associated with neural networks and their training. Then the manuscript provides some intuition behind every method and concludes by showing each method used in a meteorological example of diagnosing thunderstorms from satellite images (e.g., lightning flashes). This paper is accompanied with an open-source code repository to allow readers to explore neural networks using either the dataset provided (which is used in the paper) or as a template for alternate datasets.
Abstract
This study compares aerosol direct radiative effects on numerical weather forecasts made by the NCEP Global Forecast System (GFS) with two different aerosol datasets, the Optical Properties of Aerosols and Clouds (OPAC) and MERRA-2 aerosol climatologies. The underestimation of aerosol optical depth (AOD) by OPAC over northwest Africa, central to East Africa, the Arabian Peninsula, Southeast Asia, and the Indo-Gangetic Plain, and overestimation in the storm-track regions in both hemispheres are reduced by MERRA-2. Surface downward shortwave (SW) and longwave (LW) fluxes and the top-of-the-atmosphere SW and outgoing LW fluxes from model forecasts are compared with CERES satellite observations. Forecasts made with OPAC aerosols have large radiative flux biases, especially in northwest Africa and the storm-track regions. These biases are also reduced in the forecasts made with MERRA-2 aerosols. The improvements from MERRA-2 are most noticeable in the surface downward SW fluxes. GFS medium-range weather forecasts made with the MERRA-2 aerosols demonstrated slightly improved forecast accuracy of sea level pressure and precipitation over the Indian and East Asian summer monsoon region. A stronger Africa easterly jet is produced, associated with a low pressure over the east Atlantic Ocean and west of northwest Africa. Impacts on large-scale skill scores such as 500-hPa geopotential height anomaly correlation are generally positive in the Northern Hemisphere and the Pacific and North American regions in both the winter and summer seasons.
Abstract
This study compares aerosol direct radiative effects on numerical weather forecasts made by the NCEP Global Forecast System (GFS) with two different aerosol datasets, the Optical Properties of Aerosols and Clouds (OPAC) and MERRA-2 aerosol climatologies. The underestimation of aerosol optical depth (AOD) by OPAC over northwest Africa, central to East Africa, the Arabian Peninsula, Southeast Asia, and the Indo-Gangetic Plain, and overestimation in the storm-track regions in both hemispheres are reduced by MERRA-2. Surface downward shortwave (SW) and longwave (LW) fluxes and the top-of-the-atmosphere SW and outgoing LW fluxes from model forecasts are compared with CERES satellite observations. Forecasts made with OPAC aerosols have large radiative flux biases, especially in northwest Africa and the storm-track regions. These biases are also reduced in the forecasts made with MERRA-2 aerosols. The improvements from MERRA-2 are most noticeable in the surface downward SW fluxes. GFS medium-range weather forecasts made with the MERRA-2 aerosols demonstrated slightly improved forecast accuracy of sea level pressure and precipitation over the Indian and East Asian summer monsoon region. A stronger Africa easterly jet is produced, associated with a low pressure over the east Atlantic Ocean and west of northwest Africa. Impacts on large-scale skill scores such as 500-hPa geopotential height anomaly correlation are generally positive in the Northern Hemisphere and the Pacific and North American regions in both the winter and summer seasons.
Abstract
This study employs a long time series (1997–2017) of reforecasts based on a version of the ECMWF Integrated Forecast System to evaluate the dependence of medium-range (i.e., 3–15 days) precipitation forecast skill over California on the state of the large-scale atmospheric flow. As a basis for this evaluation, four recurrent large-scale flow regimes over the North Pacific and western North America associated with precipitation in a domain encompassing northern and central California were objectively identified in ECMWF ERA5 reanalysis data for November–March 1981–2017. Two of the regimes are characterized by zonal upper-level flow across the North Pacific, and the other two are characterized by wavy, blocked flow. Forecast verification statistics conditioned on regime occurrence indicate considerably lower medium-range precipitation skill over California in blocking regimes than in zonal regimes. Moreover, forecasts of blocking regimes tend to exhibit larger errors and uncertainty in the synoptic-scale flow over the eastern North Pacific and western North America compared with forecasts of zonal regimes. Composite analyses for blocking forecasts reveal a tendency for errors to develop in conjunction with the amplification of a ridge over the western and central North Pacific. The errors in the ridge tend to be communicated through the large-scale Rossby wave pattern, resulting in misforecasting of downstream trough amplification and, thereby, moisture flux and precipitation over California. The composites additionally indicate that error growth in the blocking ridge can be linked to misrepresentation of baroclinic development as well as upper-level divergent outflow associated with latent heat release.
Significance Statement
This study examines the degree to which the medium-range (out to ∼2-week lead time) precipitation forecast skill over California depends on the large-scale atmospheric flow regime over the North Pacific. An evaluation of retrospective model forecasts from ECMWF for 1997–2017 reveals that the skill tends to be considerably lower in regimes featuring a wavy, “blocked” North Pacific jet stream than in regimes featuring a west–east-oriented jet stream. This difference in skill relates to a tendency for forecasts of blocked regimes to exhibit significantly larger errors than forecasts of zonal regimes. The results could aid forecasters by increasing situational awareness and informing the interpretation and application of model forecasts for precipitation affecting California.
Abstract
This study employs a long time series (1997–2017) of reforecasts based on a version of the ECMWF Integrated Forecast System to evaluate the dependence of medium-range (i.e., 3–15 days) precipitation forecast skill over California on the state of the large-scale atmospheric flow. As a basis for this evaluation, four recurrent large-scale flow regimes over the North Pacific and western North America associated with precipitation in a domain encompassing northern and central California were objectively identified in ECMWF ERA5 reanalysis data for November–March 1981–2017. Two of the regimes are characterized by zonal upper-level flow across the North Pacific, and the other two are characterized by wavy, blocked flow. Forecast verification statistics conditioned on regime occurrence indicate considerably lower medium-range precipitation skill over California in blocking regimes than in zonal regimes. Moreover, forecasts of blocking regimes tend to exhibit larger errors and uncertainty in the synoptic-scale flow over the eastern North Pacific and western North America compared with forecasts of zonal regimes. Composite analyses for blocking forecasts reveal a tendency for errors to develop in conjunction with the amplification of a ridge over the western and central North Pacific. The errors in the ridge tend to be communicated through the large-scale Rossby wave pattern, resulting in misforecasting of downstream trough amplification and, thereby, moisture flux and precipitation over California. The composites additionally indicate that error growth in the blocking ridge can be linked to misrepresentation of baroclinic development as well as upper-level divergent outflow associated with latent heat release.
Significance Statement
This study examines the degree to which the medium-range (out to ∼2-week lead time) precipitation forecast skill over California depends on the large-scale atmospheric flow regime over the North Pacific. An evaluation of retrospective model forecasts from ECMWF for 1997–2017 reveals that the skill tends to be considerably lower in regimes featuring a wavy, “blocked” North Pacific jet stream than in regimes featuring a west–east-oriented jet stream. This difference in skill relates to a tendency for forecasts of blocked regimes to exhibit significantly larger errors than forecasts of zonal regimes. The results could aid forecasters by increasing situational awareness and informing the interpretation and application of model forecasts for precipitation affecting California.
Abstract
The impact of assimilating dropsonde data from the 2020 Atmospheric River (AR) Reconnaissance (ARR) field campaign on operational numerical weather forecasts was assessed. Two experiments were executed for the period from 24 January to 18 March 2020 using the National Centers for Environmental Prediction (NCEP) Global Forecast System version 15 (GFSv15) with a four-dimensional hybrid ensemble–variational (4DEnVar) data assimilation system. The control run (CTRL) used all of the routinely assimilated data and included data from 628 ARR dropsondes, whereas the denial run (DENY) excluded the dropsonde data. Results from 17 intensive observing periods (IOPs) indicate a mixed impact for mean sea level pressure and geopotential height over the Pacific–North American (PNA) region in CTRL compared to DENY. The overall local impact over the U.S. West Coast and Gulf of Alaska for the 17 IOPs is neutral (−0.45%) for integrated vapor transport (IVT), but positive for wind and moisture profiles (0.5%–1.0%), with a spectrum of statistically significant positive and negative impacts for various IOPs. The positive dropsonde data impact on precipitation forecasts over U.S. West Coast domains appears driven, in part, by improved low-level moisture and wind fields at short-forecast lead times. Indeed, data gaps, especially for accurate and unbiased moisture profiles and wind fields, can be at least partially mitigated to improve U.S. West Coast precipitation forecasts.
Abstract
The impact of assimilating dropsonde data from the 2020 Atmospheric River (AR) Reconnaissance (ARR) field campaign on operational numerical weather forecasts was assessed. Two experiments were executed for the period from 24 January to 18 March 2020 using the National Centers for Environmental Prediction (NCEP) Global Forecast System version 15 (GFSv15) with a four-dimensional hybrid ensemble–variational (4DEnVar) data assimilation system. The control run (CTRL) used all of the routinely assimilated data and included data from 628 ARR dropsondes, whereas the denial run (DENY) excluded the dropsonde data. Results from 17 intensive observing periods (IOPs) indicate a mixed impact for mean sea level pressure and geopotential height over the Pacific–North American (PNA) region in CTRL compared to DENY. The overall local impact over the U.S. West Coast and Gulf of Alaska for the 17 IOPs is neutral (−0.45%) for integrated vapor transport (IVT), but positive for wind and moisture profiles (0.5%–1.0%), with a spectrum of statistically significant positive and negative impacts for various IOPs. The positive dropsonde data impact on precipitation forecasts over U.S. West Coast domains appears driven, in part, by improved low-level moisture and wind fields at short-forecast lead times. Indeed, data gaps, especially for accurate and unbiased moisture profiles and wind fields, can be at least partially mitigated to improve U.S. West Coast precipitation forecasts.
Abstract
Inland flooding from landfalling tropical cyclones (TCs) is a major cause of death and damage to property and infrastructure worldwide. The mid-Atlantic region of the United States was devastated by Hurricane Irene and Tropical Storm Lee during late August–early September 2011, when the two storms produced sequential heavy rainfall and record flooding. Many rivers and streams reached their all-time record discharge to date. This study aims at 1) better understanding and predicting TC rainfall using various observed rainfall products and a high-resolution coupled atmosphere–wave–ocean model, namely, the Unified Wave Interface-Coupled Model (UWIN-CM), 2) characterizing inland flooding using streamflow data, and 3) improving prediction of TC-induced inland flooding using UWIN-CM and a machine learning K-nearest-neighbor (KNN) model. The results show that there is a wide range of uncertainty in satellite and radar–gauge-observed rainfall products in terms of rain-rate distribution and cumulative rainfall over the mid-Atlantic region. UWIN-CM rainfall is closer to the radar–gauge data than satellite data over land. Streamflow in most large rivers (>500 cfs) peaked after Lee, which reflects the sequential rainfall contributions of the two storms. The rainfall–streamflow–discharge response times were dependent on the size of the stream and the peak rain rates. To better predict rainfall and flooding, UWIN-CM and observed rainfall are used with the machine learning KNN regression model for prediction of severity of TC-induced inland flooding hazard. These results demonstrate the value of a stepped approach for rainfall and flood prediction toward a fully coupled atmosphere–ocean–land/hydrology model in the future.
Abstract
Inland flooding from landfalling tropical cyclones (TCs) is a major cause of death and damage to property and infrastructure worldwide. The mid-Atlantic region of the United States was devastated by Hurricane Irene and Tropical Storm Lee during late August–early September 2011, when the two storms produced sequential heavy rainfall and record flooding. Many rivers and streams reached their all-time record discharge to date. This study aims at 1) better understanding and predicting TC rainfall using various observed rainfall products and a high-resolution coupled atmosphere–wave–ocean model, namely, the Unified Wave Interface-Coupled Model (UWIN-CM), 2) characterizing inland flooding using streamflow data, and 3) improving prediction of TC-induced inland flooding using UWIN-CM and a machine learning K-nearest-neighbor (KNN) model. The results show that there is a wide range of uncertainty in satellite and radar–gauge-observed rainfall products in terms of rain-rate distribution and cumulative rainfall over the mid-Atlantic region. UWIN-CM rainfall is closer to the radar–gauge data than satellite data over land. Streamflow in most large rivers (>500 cfs) peaked after Lee, which reflects the sequential rainfall contributions of the two storms. The rainfall–streamflow–discharge response times were dependent on the size of the stream and the peak rain rates. To better predict rainfall and flooding, UWIN-CM and observed rainfall are used with the machine learning KNN regression model for prediction of severity of TC-induced inland flooding hazard. These results demonstrate the value of a stepped approach for rainfall and flood prediction toward a fully coupled atmosphere–ocean–land/hydrology model in the future.
Abstract
Forecast skill from dynamical forecast models decreases quickly with projection time due to various errors. Therefore, postprocessing methods, from simple bias correction methods to more complicated multiple linear regression–based model output statistics, are used to improve raw model forecasts. Usually, these methods show clear forecast improvement over the raw model forecasts, especially for short-range weather forecasts. However, linear approaches have limitations because the relationship between predictands and predictors may be nonlinear. This is even truer for extended range forecasts, such as week-3–4 forecasts. In this study, neural network techniques are used to seek or model the relationships between a set of predictors and predictands, and eventually to improve week-3–4 precipitation and 2-m temperature forecasts made by the NOAA/NCEP Climate Forecast System. Benefitting from advances in machine learning techniques in recent years, more flexible and capable machine learning algorithms and availability of big datasets enable us not only to explore nonlinear features or relationships within a given large dataset, but also to extract more sophisticated pattern relationships and covariabilities hidden within the multidimensional predictors and predictands. Then these more sophisticated relationships and high-level statistical information are used to correct the model week-3–4 precipitation and 2-m temperature forecasts. The results show that to some extent neural network techniques can significantly improve the week-3–4 forecast accuracy and greatly increase the efficiency over the traditional multiple linear regression methods.
Abstract
Forecast skill from dynamical forecast models decreases quickly with projection time due to various errors. Therefore, postprocessing methods, from simple bias correction methods to more complicated multiple linear regression–based model output statistics, are used to improve raw model forecasts. Usually, these methods show clear forecast improvement over the raw model forecasts, especially for short-range weather forecasts. However, linear approaches have limitations because the relationship between predictands and predictors may be nonlinear. This is even truer for extended range forecasts, such as week-3–4 forecasts. In this study, neural network techniques are used to seek or model the relationships between a set of predictors and predictands, and eventually to improve week-3–4 precipitation and 2-m temperature forecasts made by the NOAA/NCEP Climate Forecast System. Benefitting from advances in machine learning techniques in recent years, more flexible and capable machine learning algorithms and availability of big datasets enable us not only to explore nonlinear features or relationships within a given large dataset, but also to extract more sophisticated pattern relationships and covariabilities hidden within the multidimensional predictors and predictands. Then these more sophisticated relationships and high-level statistical information are used to correct the model week-3–4 precipitation and 2-m temperature forecasts. The results show that to some extent neural network techniques can significantly improve the week-3–4 forecast accuracy and greatly increase the efficiency over the traditional multiple linear regression methods.
Abstract
Tropical cyclone tornadoes (TCTORs) are a hazard to life and property during landfalling tropical cyclones (TCs). The threat is often spread over a wide area within the TC envelope and must be continually evaluated as the TC moves inland and dissipates. To anticipate the risk of TCTORs, forecasters may use high-resolution, rapidly updating model analyses and short-range forecasts such as the Rapid Refresh (RAP) and High-Resolution Rapid Refresh (HRRR), and an ingredients-based approach similar to that used for forecasting continental midlatitude tornadoes. Though RAP and HRRR errors have been identified in typical midlatitude convective environments, this study evaluates the performance of the RAP and the HRRR within the TC envelope, with particular attention given to sounding-derived parameters previously identified as useful for TCTOR forecasting. A sample of 1730 observed upper-air soundings is sourced from 13 TCs that made landfall along the U.S. coastline between 2017 and 2019. The observed soundings are paired with their corresponding model gridpoint soundings from the RAP analysis, RAP 12-h forecast, and HRRR 12-h forecast. Model errors are calculated for both the raw sounding variables of temperature, dewpoint, and wind speed, as well as for the selected sounding-derived parameters. Results show a moist bias that worsens with height across all model runs. There are also statistically significant underpredictions in stability-related parameters such as convective available potential energy (CAPE) and kinematic parameters such as vertical wind shear.
Abstract
Tropical cyclone tornadoes (TCTORs) are a hazard to life and property during landfalling tropical cyclones (TCs). The threat is often spread over a wide area within the TC envelope and must be continually evaluated as the TC moves inland and dissipates. To anticipate the risk of TCTORs, forecasters may use high-resolution, rapidly updating model analyses and short-range forecasts such as the Rapid Refresh (RAP) and High-Resolution Rapid Refresh (HRRR), and an ingredients-based approach similar to that used for forecasting continental midlatitude tornadoes. Though RAP and HRRR errors have been identified in typical midlatitude convective environments, this study evaluates the performance of the RAP and the HRRR within the TC envelope, with particular attention given to sounding-derived parameters previously identified as useful for TCTOR forecasting. A sample of 1730 observed upper-air soundings is sourced from 13 TCs that made landfall along the U.S. coastline between 2017 and 2019. The observed soundings are paired with their corresponding model gridpoint soundings from the RAP analysis, RAP 12-h forecast, and HRRR 12-h forecast. Model errors are calculated for both the raw sounding variables of temperature, dewpoint, and wind speed, as well as for the selected sounding-derived parameters. Results show a moist bias that worsens with height across all model runs. There are also statistically significant underpredictions in stability-related parameters such as convective available potential energy (CAPE) and kinematic parameters such as vertical wind shear.
