Browse
Abstract
The skillful anticipation of tornadoes produced by quasi-linear convective systems (QLCSs) is a well-known forecasting challenge. This study was motivated by the possibility that warning accuracy of QLCS tornadoes depends on the processes leading to tornadogenesis, namely, one that is dominated by an apparent release of horizontal shearing instability [shearing instability dominant (SID)] and one by a pre-tornadic mesocyclone [pre-tornadic mesocyclone dominant (PMD)] and its associated generative mechanisms. The manual classification of the genesis of 530 QLCS tornadoes as either SID or PMD was performed using heuristic, yet process-driven criteria based on single-Doppler radar (WSR-88D) data. This included 214, 213, and 103 tornadoes that occurred during 2019, 2017, and 2016, respectively. As a function of tornadogenesis process, 36% were classified as SID, and 60% were classified as PMD; the remaining 4% could not be classified. Approximately 30% of the SID cases were operationally warned prior to tornadogenesis, compared to 44% of the PMD cases. PMD tornadoes were also more common during the warm season and displayed a diurnal, midafternoon peak in frequency. Finally, SID cases were more likely to be associated with QLCS tornado outbreaks but tended to be slightly shorter lived. A complementary effort to investigate environmental characteristics of QLCS tornadogenesis revealed differences between SID and PMD cases. MLCAPE was relatively larger for warm-season SID cases, and 0–3-km SRH was relatively larger in warm-season PMD cases. Additionally, pre-tornadic frontogenesis was more prominent for cool-season SID cases, suggestive of a more significant role of the larger-scale meteorological forcing in vertical vorticity that fosters tornadogenesis through SID processes.
Abstract
The skillful anticipation of tornadoes produced by quasi-linear convective systems (QLCSs) is a well-known forecasting challenge. This study was motivated by the possibility that warning accuracy of QLCS tornadoes depends on the processes leading to tornadogenesis, namely, one that is dominated by an apparent release of horizontal shearing instability [shearing instability dominant (SID)] and one by a pre-tornadic mesocyclone [pre-tornadic mesocyclone dominant (PMD)] and its associated generative mechanisms. The manual classification of the genesis of 530 QLCS tornadoes as either SID or PMD was performed using heuristic, yet process-driven criteria based on single-Doppler radar (WSR-88D) data. This included 214, 213, and 103 tornadoes that occurred during 2019, 2017, and 2016, respectively. As a function of tornadogenesis process, 36% were classified as SID, and 60% were classified as PMD; the remaining 4% could not be classified. Approximately 30% of the SID cases were operationally warned prior to tornadogenesis, compared to 44% of the PMD cases. PMD tornadoes were also more common during the warm season and displayed a diurnal, midafternoon peak in frequency. Finally, SID cases were more likely to be associated with QLCS tornado outbreaks but tended to be slightly shorter lived. A complementary effort to investigate environmental characteristics of QLCS tornadogenesis revealed differences between SID and PMD cases. MLCAPE was relatively larger for warm-season SID cases, and 0–3-km SRH was relatively larger in warm-season PMD cases. Additionally, pre-tornadic frontogenesis was more prominent for cool-season SID cases, suggestive of a more significant role of the larger-scale meteorological forcing in vertical vorticity that fosters tornadogenesis through SID processes.
Abstract
In an ensemble Kalman filter, when the analysis update of an ensemble member is computed using error statistics estimated from an ensemble that includes the background of the member being updated, the spread of the resulting ensemble systematically underestimates the uncertainty of the ensemble mean analysis. This problem can largely be avoided by applying cross validation: using an independent subset of ensemble members for updating each member. However, in some circumstances cross validation can lead to the divergence of one or more ensemble members from observations. This can culminate in catastrophic filter divergence in which the analyzed or forecast states become unrealistic in the diverging members. So far, such instabilities have been reported only in the context of highly nonlinear low-dimensional models. The first known manifestation of catastrophic filter divergence caused by the use of cross validation in an NWP context is reported here. To reduce the risk of such filter divergence, a modification to the traditional cross-validation approach is proposed. Instead of always assigning the ensemble members to the same subensembles, the members forming each subensemble are randomly chosen at every analysis step. It is shown that this new approach can prevent filter divergence and also brings a cycling ensemble data assimilation system containing divergent members back to a state consistent with Gaussianity. The randomized subensemble approach was implemented in the operational global ensemble prediction system at Environment and Climate Change Canada on 1 December 2021.
Abstract
In an ensemble Kalman filter, when the analysis update of an ensemble member is computed using error statistics estimated from an ensemble that includes the background of the member being updated, the spread of the resulting ensemble systematically underestimates the uncertainty of the ensemble mean analysis. This problem can largely be avoided by applying cross validation: using an independent subset of ensemble members for updating each member. However, in some circumstances cross validation can lead to the divergence of one or more ensemble members from observations. This can culminate in catastrophic filter divergence in which the analyzed or forecast states become unrealistic in the diverging members. So far, such instabilities have been reported only in the context of highly nonlinear low-dimensional models. The first known manifestation of catastrophic filter divergence caused by the use of cross validation in an NWP context is reported here. To reduce the risk of such filter divergence, a modification to the traditional cross-validation approach is proposed. Instead of always assigning the ensemble members to the same subensembles, the members forming each subensemble are randomly chosen at every analysis step. It is shown that this new approach can prevent filter divergence and also brings a cycling ensemble data assimilation system containing divergent members back to a state consistent with Gaussianity. The randomized subensemble approach was implemented in the operational global ensemble prediction system at Environment and Climate Change Canada on 1 December 2021.
Abstract
The skill of NOAA’s official monthly U.S. precipitation forecasts (issued in the middle of the prior month) has historically been low, having shown modest skill over the southern United States, but little or no skill over large portions of the central United States. The goal of this study is to explain the seasonal and regional variations of the North American subseasonal (weeks 3–6) precipitation skill, specifically the reasons for its successes and its limitations. The performances of multiple recent-generation model reforecasts over 1999–2015 in predicting precipitation are compared to uninitialized simulation skill using the atmospheric component of the forecast systems. This parallel analysis permits attribution of precipitation skill to two distinct sources: one due to slowly evolving ocean surface boundary states and the other to faster time-scale initial atmospheric weather states. A strong regionality and seasonality in precipitation forecast performance is shown to be analogous to skill patterns dictated by boundary forcing constraints alone. The correspondence is found to be especially high for the North American pattern of the maximum monthly skill that is achieved in the reforecast. The boundary forcing of most importance originates from tropical Pacific SST influences, especially those related to El Niño–Southern Oscillation. We discuss physical constraints that may limit monthly precipitation skill and interpret the performance of existing models in the context of plausible upper limits.
Significance Statement
Skillful subseasonal precipitation predictions have societal benefits. Over the United States, however, NOAA’s official U.S. monthly precipitation forecast skill has been historically low. Here we explore origins for skill of North American week-3 to week-6 precipitation predictions. Skill arising from initial weather states is compared to that arising from ocean surface boundary states alone. The monthly and seasonally varying pattern of U.S. monthly precipitation skill is appreciably derived from boundary constraints, linked especially with El Niño–Southern Oscillation. Forecasts of opportunity are identified, despite the low skill of monthly precipitation forecasts on average. Potential limits of monthly precipitation skill are explored that provide insight on the juxtaposition of “skill deserts” over the central United States with high skill regions over western North America.
Abstract
The skill of NOAA’s official monthly U.S. precipitation forecasts (issued in the middle of the prior month) has historically been low, having shown modest skill over the southern United States, but little or no skill over large portions of the central United States. The goal of this study is to explain the seasonal and regional variations of the North American subseasonal (weeks 3–6) precipitation skill, specifically the reasons for its successes and its limitations. The performances of multiple recent-generation model reforecasts over 1999–2015 in predicting precipitation are compared to uninitialized simulation skill using the atmospheric component of the forecast systems. This parallel analysis permits attribution of precipitation skill to two distinct sources: one due to slowly evolving ocean surface boundary states and the other to faster time-scale initial atmospheric weather states. A strong regionality and seasonality in precipitation forecast performance is shown to be analogous to skill patterns dictated by boundary forcing constraints alone. The correspondence is found to be especially high for the North American pattern of the maximum monthly skill that is achieved in the reforecast. The boundary forcing of most importance originates from tropical Pacific SST influences, especially those related to El Niño–Southern Oscillation. We discuss physical constraints that may limit monthly precipitation skill and interpret the performance of existing models in the context of plausible upper limits.
Significance Statement
Skillful subseasonal precipitation predictions have societal benefits. Over the United States, however, NOAA’s official U.S. monthly precipitation forecast skill has been historically low. Here we explore origins for skill of North American week-3 to week-6 precipitation predictions. Skill arising from initial weather states is compared to that arising from ocean surface boundary states alone. The monthly and seasonally varying pattern of U.S. monthly precipitation skill is appreciably derived from boundary constraints, linked especially with El Niño–Southern Oscillation. Forecasts of opportunity are identified, despite the low skill of monthly precipitation forecasts on average. Potential limits of monthly precipitation skill are explored that provide insight on the juxtaposition of “skill deserts” over the central United States with high skill regions over western North America.
Abstract
A forecast “bust” or “dropout” can be defined as an intermittent but significant loss of model forecast performance. Deterministic forecast dropouts are typically defined in terms of the 500-hPa geopotential height (Φ500) anomaly correlation coefficient (ACC) in the Northern Hemisphere (NH) dropping below a predefined threshold. This study first presents a multimodel comparison of dropouts in the Navy Global Environmental Model (NAVGEM) deterministic forecast with the ensemble control members from the Environment and Climate Change Canada (ECCC) Global Ensemble Prediction System (GEPS) and the National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System (GEFS). Then, the relationship between dropouts and large-scale pattern variability is investigated, focusing on the temporal variability and correlation of flow indices surrounding dropout events. Finally, three severe dropout events are examined from an ensemble perspective. The main findings of this work are the following: 1) forecast dropouts exhibit some relation between models; 2) although forecast dropouts do not have a single cause, the most severe dropouts in NAVGEM can be linked to specific behavior of the large-scale flow indices, that is, they tend to follow periods of rapidly escalating volatility of the flow indices, and they tend to occur during intervals where the AO and Pacific North American (PNA) indices are exhibiting unusually strong interdependence; and 3) for the dropout events examined from an ensemble perspective, the NAVGEM ensemble spread does not provide a strong signal of elevated potential for very large forecast errors.
Abstract
A forecast “bust” or “dropout” can be defined as an intermittent but significant loss of model forecast performance. Deterministic forecast dropouts are typically defined in terms of the 500-hPa geopotential height (Φ500) anomaly correlation coefficient (ACC) in the Northern Hemisphere (NH) dropping below a predefined threshold. This study first presents a multimodel comparison of dropouts in the Navy Global Environmental Model (NAVGEM) deterministic forecast with the ensemble control members from the Environment and Climate Change Canada (ECCC) Global Ensemble Prediction System (GEPS) and the National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System (GEFS). Then, the relationship between dropouts and large-scale pattern variability is investigated, focusing on the temporal variability and correlation of flow indices surrounding dropout events. Finally, three severe dropout events are examined from an ensemble perspective. The main findings of this work are the following: 1) forecast dropouts exhibit some relation between models; 2) although forecast dropouts do not have a single cause, the most severe dropouts in NAVGEM can be linked to specific behavior of the large-scale flow indices, that is, they tend to follow periods of rapidly escalating volatility of the flow indices, and they tend to occur during intervals where the AO and Pacific North American (PNA) indices are exhibiting unusually strong interdependence; and 3) for the dropout events examined from an ensemble perspective, the NAVGEM ensemble spread does not provide a strong signal of elevated potential for very large forecast errors.
Abstract
We evaluate the short-term weather forecast performance of three flavors of artificial neural networks (NNs): feed forward back propagation, radial basis function, and generalized regression. To prepare the application of the NNs to an operational setting, we tune NN hyperparameters using over two years of historical data. Five objective guidance products serve as predictors to the NNs: North American Mesoscale and Global Forecast System model output statistics (MOS) forecasts, the High-Resolution Rapid Refresh (HRRR) model, National Weather Service forecasts, and the National Blend of Models product. We independently test NN performance using 96 real-time forecasts of temperature, wind, and precipitation across 11 U.S. cities made during the WxChallenge, a weather forecasting competition. We demonstrate that all NNs significantly improve short-range weather forecasts relative to the traditional objective guidance aids used to train the networks. For example, 1-day maximum and minimum temperature forecast error is 20%–30% lower than MOS. However, NN improvement over multiple linear regression for short-term forecasts is not significant. We suggest this may be attributed to the small number of training samples, the operational nature of the experiment, and the short forecast lead times. Regardless, our results are consistent with previous work suggesting that applying NNs to model forecasts can have a positive impact on operational forecast skill and will become valuable tools when integrated into the forecast enterprise.
Significance Statement
We used approximately two years of historical weather data and objective forecasts for a number of cities to tune a series of artificial neural networks (NNs) to forecast 1-day values of maximum and minimum temperature, maximum sustained wind speed, and quantitative precipitation. We compare forecast error against common objective guidance and multiple linear regression. We found that the NNs exhibit about 25% lower error than common objective guidance for temperature forecasting and 50% lower error for wind speed. Our results suggest that NNs will be a valuable contributor to improving weather forecast skill when adopted into the existing forecast enterprise.
Abstract
We evaluate the short-term weather forecast performance of three flavors of artificial neural networks (NNs): feed forward back propagation, radial basis function, and generalized regression. To prepare the application of the NNs to an operational setting, we tune NN hyperparameters using over two years of historical data. Five objective guidance products serve as predictors to the NNs: North American Mesoscale and Global Forecast System model output statistics (MOS) forecasts, the High-Resolution Rapid Refresh (HRRR) model, National Weather Service forecasts, and the National Blend of Models product. We independently test NN performance using 96 real-time forecasts of temperature, wind, and precipitation across 11 U.S. cities made during the WxChallenge, a weather forecasting competition. We demonstrate that all NNs significantly improve short-range weather forecasts relative to the traditional objective guidance aids used to train the networks. For example, 1-day maximum and minimum temperature forecast error is 20%–30% lower than MOS. However, NN improvement over multiple linear regression for short-term forecasts is not significant. We suggest this may be attributed to the small number of training samples, the operational nature of the experiment, and the short forecast lead times. Regardless, our results are consistent with previous work suggesting that applying NNs to model forecasts can have a positive impact on operational forecast skill and will become valuable tools when integrated into the forecast enterprise.
Significance Statement
We used approximately two years of historical weather data and objective forecasts for a number of cities to tune a series of artificial neural networks (NNs) to forecast 1-day values of maximum and minimum temperature, maximum sustained wind speed, and quantitative precipitation. We compare forecast error against common objective guidance and multiple linear regression. We found that the NNs exhibit about 25% lower error than common objective guidance for temperature forecasting and 50% lower error for wind speed. Our results suggest that NNs will be a valuable contributor to improving weather forecast skill when adopted into the existing forecast enterprise.
Abstract
Atmospheric rivers (ARs) are long and narrow regions in the atmosphere of enhanced integrated water vapor transport (IVT) and can produce extreme precipitation and high societal impacts. Reliable and skillful forecasts of landfalling ARs in the western United States are critical to hazard preparation and aid in decision support activities, such as Forecast-Informed Reservoir Operations (FIRO). The purpose of this study is to compare the cool-season water year skill of the NCEP Global Ensemble Forecast System (GEFS) and ECMWF Ensemble Prediction System (EPS) forecasts of IVT along the U.S. West Coast for 2017–20. The skill is analyzed using probability-over-threshold forecasts of IVT magnitudes ≥ 250 kg m−1 s−1 (P 250) using contingency table skill metrics in coastal Northern California and along the west coast of North America. Analysis of P 250 with lead time (dProg/dt) found that the EPS provided ∼1 day of additional lead time for situational awareness over the GEFS at lead times of 6–10 days. Forecast skill analysis highlights that the EPS leads over the GEFS with success ratios 0.10–0.15 higher at lead times > 6 days for P 250 thresholds of ≥25% and ≥50%, while event-based skill analysis using the probability of detection (POD) found that both models were largely similar with minor latitudinal variations favoring higher POD for each model in different locations along the coast. The relative skill of the EPS over the GEFS is largely attributed to overforecasting by the GEFS at longer lead times and an increase in the false alarm ratio.
Significance Statement
The purpose of this study is to evaluate the efficacy of the NCEP Global Ensemble Forecast System (GEFS) and the ECMWF Ensemble Prediction System (EPS) in forecasting enhanced water vapor transport along the U.S. West Coast commonly associated with landfalling atmospheric rivers and heavy precipitation. The ensemble models allow us to calculate the probability that enhanced water vapor transport will occur, thereby providing situational awareness for decision-making, such as in hazard mitigation and water resource management. The results of this study indicate that the EPS model is on average more skillful than the GEFS model at lead times of ∼6–10 days with a higher success ratio and lower false alarm ratio.
Abstract
Atmospheric rivers (ARs) are long and narrow regions in the atmosphere of enhanced integrated water vapor transport (IVT) and can produce extreme precipitation and high societal impacts. Reliable and skillful forecasts of landfalling ARs in the western United States are critical to hazard preparation and aid in decision support activities, such as Forecast-Informed Reservoir Operations (FIRO). The purpose of this study is to compare the cool-season water year skill of the NCEP Global Ensemble Forecast System (GEFS) and ECMWF Ensemble Prediction System (EPS) forecasts of IVT along the U.S. West Coast for 2017–20. The skill is analyzed using probability-over-threshold forecasts of IVT magnitudes ≥ 250 kg m−1 s−1 (P 250) using contingency table skill metrics in coastal Northern California and along the west coast of North America. Analysis of P 250 with lead time (dProg/dt) found that the EPS provided ∼1 day of additional lead time for situational awareness over the GEFS at lead times of 6–10 days. Forecast skill analysis highlights that the EPS leads over the GEFS with success ratios 0.10–0.15 higher at lead times > 6 days for P 250 thresholds of ≥25% and ≥50%, while event-based skill analysis using the probability of detection (POD) found that both models were largely similar with minor latitudinal variations favoring higher POD for each model in different locations along the coast. The relative skill of the EPS over the GEFS is largely attributed to overforecasting by the GEFS at longer lead times and an increase in the false alarm ratio.
Significance Statement
The purpose of this study is to evaluate the efficacy of the NCEP Global Ensemble Forecast System (GEFS) and the ECMWF Ensemble Prediction System (EPS) in forecasting enhanced water vapor transport along the U.S. West Coast commonly associated with landfalling atmospheric rivers and heavy precipitation. The ensemble models allow us to calculate the probability that enhanced water vapor transport will occur, thereby providing situational awareness for decision-making, such as in hazard mitigation and water resource management. The results of this study indicate that the EPS model is on average more skillful than the GEFS model at lead times of ∼6–10 days with a higher success ratio and lower false alarm ratio.
Abstract
The forecast skill for week-2 wintertime surface air temperature (SAT) over the Northern Hemisphere by the Model for Prediction Across Scales–Atmosphere (MPAS-A) is evaluated and compared with operational forecast systems that participate in the Subseasonal to Seasonal Prediction project (S2S). An intercomparison of the MPAS against the China Meteorological Administration (CMA) model and the European Centre for Medium-Range Weather Forecasts (ECMWF) model was performed using 10-yr reforecasts. Comparing the forecast skill for SAT and atmospheric circulation anomalies at a lead of 2 weeks among the three models, the MPAS shows skill lower than the ECMWF model but higher than the CMA model. The gap in skills between the MPAS model and CMA model is not as large as that between the ECMWF model and MPAS model. Additionally, an intercomparison of the MPAS model against 10 S2S models is presented by using real-time forecasts since 2016 stored in the S2S database. The results show that the MPAS model has forecast skill for week-2 to week-4 wintertime SAT comparable to that in most S2S models. The MPAS model tends to be at an intermediate level compared to current operational forecast models.
Abstract
The forecast skill for week-2 wintertime surface air temperature (SAT) over the Northern Hemisphere by the Model for Prediction Across Scales–Atmosphere (MPAS-A) is evaluated and compared with operational forecast systems that participate in the Subseasonal to Seasonal Prediction project (S2S). An intercomparison of the MPAS against the China Meteorological Administration (CMA) model and the European Centre for Medium-Range Weather Forecasts (ECMWF) model was performed using 10-yr reforecasts. Comparing the forecast skill for SAT and atmospheric circulation anomalies at a lead of 2 weeks among the three models, the MPAS shows skill lower than the ECMWF model but higher than the CMA model. The gap in skills between the MPAS model and CMA model is not as large as that between the ECMWF model and MPAS model. Additionally, an intercomparison of the MPAS model against 10 S2S models is presented by using real-time forecasts since 2016 stored in the S2S database. The results show that the MPAS model has forecast skill for week-2 to week-4 wintertime SAT comparable to that in most S2S models. The MPAS model tends to be at an intermediate level compared to current operational forecast models.
Abstract
This study demonstrates an approach to expand and improve the current prediction capability of the National Water Model (NWM). The primary objective is to examine the potential benefit of real-time local stage measurements in streamflow prediction, particularly for local communities that do not benefit from the improved streamflow forecasts due to the current data assimilation (DA) scheme. The proposed approach incorporates real-time local stage measurements into the NWM streamflow DA procedure by using synthetic rating curves (SRC) developed based on an established open-channel flow model. For streamflow DA and its evaluation, we used 6-yr (2016–21) data collected from 140 U.S. Geological Survey (USGS) stations, where quality-assured rating curves are consistently maintained (verification stations), and 310 stage-only stations operated by the Iowa Flood Center and the USGS in Iowa. The evaluation result from NWM’s current DA configuration based on the USGS verification stations indicated that DA improves streamflow prediction skills significantly downstream from the station locations. This improvement tends to increase as the drainage scale becomes larger. The result from the new DA configuration including all stage-only sensors showed an expanded domain of improved predictions, compared to those from the open-loop simulation. This reveals that the real-time low-cost stage sensors are beneficial for streamflow prediction, particularly at small basins, while their utility appears to be limited at large drainage areas because of the inherent limitations of lidar-based channel geometry used for the SRC development. The framework presented in this study can be readily applied to include numerous stage-only stream gauges nationwide in the NWM modeling and forecasting procedures.
Abstract
This study demonstrates an approach to expand and improve the current prediction capability of the National Water Model (NWM). The primary objective is to examine the potential benefit of real-time local stage measurements in streamflow prediction, particularly for local communities that do not benefit from the improved streamflow forecasts due to the current data assimilation (DA) scheme. The proposed approach incorporates real-time local stage measurements into the NWM streamflow DA procedure by using synthetic rating curves (SRC) developed based on an established open-channel flow model. For streamflow DA and its evaluation, we used 6-yr (2016–21) data collected from 140 U.S. Geological Survey (USGS) stations, where quality-assured rating curves are consistently maintained (verification stations), and 310 stage-only stations operated by the Iowa Flood Center and the USGS in Iowa. The evaluation result from NWM’s current DA configuration based on the USGS verification stations indicated that DA improves streamflow prediction skills significantly downstream from the station locations. This improvement tends to increase as the drainage scale becomes larger. The result from the new DA configuration including all stage-only sensors showed an expanded domain of improved predictions, compared to those from the open-loop simulation. This reveals that the real-time low-cost stage sensors are beneficial for streamflow prediction, particularly at small basins, while their utility appears to be limited at large drainage areas because of the inherent limitations of lidar-based channel geometry used for the SRC development. The framework presented in this study can be readily applied to include numerous stage-only stream gauges nationwide in the NWM modeling and forecasting procedures.
Abstract
The Dynamical–Statistical–Analog Ensemble Forecast for Landfalling Typhoon Daily Precipitation (DSAEF_LTP_D) model is introduced in this paper. To improve the DSAEF_LTP_D model’s forecasting ability, tropical cyclone (TC) translation speed was introduced. Taking Supertyphoon Lekima (2019), which produced widespread heavy rainfall from 9 to 11 August 2019 as the target TC, two simulation experiments associated with the prediction of daily precipitation were conducted: the first involving the DSAEF_LTP_D model containing only the TC track (the actual trajectory of the TC center), named DSAEF_LTP_D-1; and the second containing both TC track and translation speed, named DSAEF_LTP_D-2. The results show the following: 1) With TC translation speed added into the model, the forecasting performance for heavy rainfall (24-h accumulated precipitation exceeding 50 and 100 mm) on 9 and 10 August improves, being able to successfully capture the center of heavy rainfall, but the forecasting performance is the same as DSAEF_LTP_D-1 on 11 August. 2) Compared with four numerical weather prediction (NWP) models (i.e., ECMWF, GFS, GRAPES, and SMS-WARMS), the TS100 + TS50 (the sum of TS values for predicting 24-h accumulated precipitation of ≥100 and ≥50 mm) of DSAEF_LTP_D-2 is comparable to the best performer of the NWP models (ECMWF) on 9 and 10 August, while the performance of DSAEF_LTP_D model for predicting heavy rainfall on 11 August is poor. 3) The newly added similarity regions make up for the deficiency that the similarity regions are narrower when the TC track is northward, which leads to DSAEF_LTP_D-2 having a better forecasting performance for heavy rainfall on 11 August, with the TS100 + TS50 increasing from 0.3021 to 0.4286, an increase of 41.87%.
Abstract
The Dynamical–Statistical–Analog Ensemble Forecast for Landfalling Typhoon Daily Precipitation (DSAEF_LTP_D) model is introduced in this paper. To improve the DSAEF_LTP_D model’s forecasting ability, tropical cyclone (TC) translation speed was introduced. Taking Supertyphoon Lekima (2019), which produced widespread heavy rainfall from 9 to 11 August 2019 as the target TC, two simulation experiments associated with the prediction of daily precipitation were conducted: the first involving the DSAEF_LTP_D model containing only the TC track (the actual trajectory of the TC center), named DSAEF_LTP_D-1; and the second containing both TC track and translation speed, named DSAEF_LTP_D-2. The results show the following: 1) With TC translation speed added into the model, the forecasting performance for heavy rainfall (24-h accumulated precipitation exceeding 50 and 100 mm) on 9 and 10 August improves, being able to successfully capture the center of heavy rainfall, but the forecasting performance is the same as DSAEF_LTP_D-1 on 11 August. 2) Compared with four numerical weather prediction (NWP) models (i.e., ECMWF, GFS, GRAPES, and SMS-WARMS), the TS100 + TS50 (the sum of TS values for predicting 24-h accumulated precipitation of ≥100 and ≥50 mm) of DSAEF_LTP_D-2 is comparable to the best performer of the NWP models (ECMWF) on 9 and 10 August, while the performance of DSAEF_LTP_D model for predicting heavy rainfall on 11 August is poor. 3) The newly added similarity regions make up for the deficiency that the similarity regions are narrower when the TC track is northward, which leads to DSAEF_LTP_D-2 having a better forecasting performance for heavy rainfall on 11 August, with the TS100 + TS50 increasing from 0.3021 to 0.4286, an increase of 41.87%.
Abstract
The National Severe Storm Laboratory’s Warn-on-Forecast System (WoFS) is a convection-allowing ensemble with rapidly cycled data assimilation (DA) of various satellite and radar datasets designed for prediction at 0–6-h lead time of hazardous weather. With the focus on short lead times, WoFS predictive accuracy is strongly dependent on its ability to accurately initialize and depict the evolution of ongoing storms. Since it takes multiple DA cycles to fully “spin up” ongoing storms, predictive skill is likely a function of storm age at the time of model initialization, meaning that older storms that have been through several DA cycles will be forecast with greater accuracy than newer storms that initiate just before model initialization or at any point after. To quantify this relationship, we apply an object-based spatial tracking and verification approach to map differences in the probability of detection (POD), in space–time, of predicted storm objects from WoFS with respect to Multi-Radar Multi-Sensor (MRMS) reflectivity objects. Object-tracking/matching statistics are computed for all suitable and available WoFS cases from 2017 to 2021. Our results indicate sharply increasing POD with increasing storm age for lead times within 3 h. PODs were about 0.3 for storm objects that emerge 2–3 h after model initialization, while for storm objects that were at least an hour old at the time of model initialization by DA, PODs ranged from around 0.7 to 0.9 depending on the lead time. These results should aid in forecaster interpretation of WoFS, as well as guide WoFS developers on improving the model and DA system.
Significance Statement
The Warn-on-Forecast System (WoFS) is a collection of weather models designed to predict individual thunderstorms. Before the models can predict storms, they must ingest radar and satellite observations to put existing storms into the models. Because storms develop at different times, more observations will exist for some storms in the model domain than others, which results in WoFS forecasts with different accuracy for different storms. This paper estimates the differences in accuracy for storms that have existed for a long time and those that have not by tracking observed and predicted storms. We find that the likelihood of WoFS accurately predicting a thunderstorm nearly doubles if the storm has existed for over an hour prior to the forecast. Understanding this relationship between storm age and forecast accuracy will help forecasters better use WoFS predictions and guide future research to improve WoFS forecasts.
Abstract
The National Severe Storm Laboratory’s Warn-on-Forecast System (WoFS) is a convection-allowing ensemble with rapidly cycled data assimilation (DA) of various satellite and radar datasets designed for prediction at 0–6-h lead time of hazardous weather. With the focus on short lead times, WoFS predictive accuracy is strongly dependent on its ability to accurately initialize and depict the evolution of ongoing storms. Since it takes multiple DA cycles to fully “spin up” ongoing storms, predictive skill is likely a function of storm age at the time of model initialization, meaning that older storms that have been through several DA cycles will be forecast with greater accuracy than newer storms that initiate just before model initialization or at any point after. To quantify this relationship, we apply an object-based spatial tracking and verification approach to map differences in the probability of detection (POD), in space–time, of predicted storm objects from WoFS with respect to Multi-Radar Multi-Sensor (MRMS) reflectivity objects. Object-tracking/matching statistics are computed for all suitable and available WoFS cases from 2017 to 2021. Our results indicate sharply increasing POD with increasing storm age for lead times within 3 h. PODs were about 0.3 for storm objects that emerge 2–3 h after model initialization, while for storm objects that were at least an hour old at the time of model initialization by DA, PODs ranged from around 0.7 to 0.9 depending on the lead time. These results should aid in forecaster interpretation of WoFS, as well as guide WoFS developers on improving the model and DA system.
Significance Statement
The Warn-on-Forecast System (WoFS) is a collection of weather models designed to predict individual thunderstorms. Before the models can predict storms, they must ingest radar and satellite observations to put existing storms into the models. Because storms develop at different times, more observations will exist for some storms in the model domain than others, which results in WoFS forecasts with different accuracy for different storms. This paper estimates the differences in accuracy for storms that have existed for a long time and those that have not by tracking observed and predicted storms. We find that the likelihood of WoFS accurately predicting a thunderstorm nearly doubles if the storm has existed for over an hour prior to the forecast. Understanding this relationship between storm age and forecast accuracy will help forecasters better use WoFS predictions and guide future research to improve WoFS forecasts.
