1. Introduction
The importance of developing a coupled atmosphere–ocean–ice system for seasonal and longer time scale weather forecasts has been recognized for many years. However, the progress in the short- to medium-range coupled prediction of precipitation is relatively new (e.g., Brassington et al. 2015; Pullen et al. 2017), especially on the regional scale. Considerable effort for performing coupled modeling has focused on the present climate and future climate projections in the context of temperature and precipitation changes (e.g., Ren and Qian 2005; Wang et al. 2015; Larsen et al. 2016; Dong et al. 2017; Su et al. 2020; Minallah and Steiner 2021). Recently, more attention has been paid to the conduct of case studies using the short- to medium-range coupled prediction models (e.g., Brassington et al. 2015; Gu et al. 2016; Umek and Gohm 2016; Fujisaki-Manome et al. 2017).
Despite some incremental improvements in QPFs during the past decades (e.g., Gallus et al. 2008; Lombardo and Colle 2010; Jessup and Colucci 2012; Sukovich et al. 2014), it still remains very challenging to accurately predict precipitation in terms of its amount, location, and timing (e.g., Olson et al. 1995; Applequist et al. 2002; Fritsch and Carbone 2004; Cao and Zhang 2016; Cao et al. 2019; Xia and Zhang 2019; Wang et al. 2021) owing to complicated multiscale dynamic and thermodynamic processes involved in precipitation production. Applications of coupled models to daily QPF have shown some promising results in several operational numerical weather prediction (NWP) centers, such as the Bureau of Meteorology of Australia, the Met Office, the National Centers for Environment Prediction of the United States, the European Centre for Medium-Range Weather Forecasts, the Naval Research Laboratory of the United States, Environment and Climate Change Canada of Canada (ECCC), and Mercator-Océan/Meteo-France of France (Brassington et al. 2015).
A coupled atmosphere–ocean–ice model system has been recently developed by ECCC (Brassington et al. 2015) in an attempt to improve guidance from NWP models, such as QPFs. In this study, we systematically assess benefits and challenges in promoting the improvement of and using this coupled model for daily QPFs over southern Ontario during a 1-yr period of June 2016–May 2017.
The objectives of this study are to (i) evaluate the daily QPF performance over southern Ontario using ECCC’s coupled and uncoupled operational models through verification against the Canadian Precipitation Analysis (CaPA) and two independent observational precipitation datasets; (ii) develop a systematic method to diagnose physical processes at the air–water interface and above to inform on the differences between the coupled and uncoupled models for daily QPFs in order to help understand the impact of the two-way coupling system with respect to QPFs.
The next section describes the data and methodology used in this study. Section 3 presents model verifications and analyzes differences of physical processes resulting in daily QPF differences in the two models. A summary and conclusions are given in section 4.
2. Data and methodology
Five datasets are employed in this work to evaluate the performance of the coupled atmosphere–ocean–ice (GEM-NEMO-CICE) system and uncoupled GEM model in QPFs over southern Ontario region for a 1-yr period of June 2016–May 2017. Here GEM refers to the Global Environmental Multiscale atmospheric model (Côté et al. 1998), NEMO to the Nucleus for European Modeling of the Ocean (Madec et al. 1998; Madec and NEMO Team 2016), and CICE to the Community Ice CodE (e.g., http://www.cesm.ucar.edu/models/cesm1.0/cice/ice_usrdoc.pdf; Roy et al. 2015; Durnford et al. 2018; Smith et al. 2016, 2018). For the sake of convenience, like Smith et al. (2018), here the term “coupled” means the GEM model coupling with the NEMO-CICE model, even though the operational GEM model is also coupled with a land surface model (Bélair et al. 2003). In the uncoupled GEM, surface temperatures over lakes and oceans do not evolve in time, although their initial conditions are provided from real-time analyses (Mailhot et al. 1998). Both the coupled and the uncoupled model QPF data are obtained from the Canadian Centre for Meteorological and Environmental Prediction Centre (CCMEP). The GEM forecasts have a horizontal grid spacing of 10 km, while the NEMO-CICE forecasts have a horizontal grid spacing of 2 km.
The computational spatial domain is the same for comparisons of two models, that is, over the southern Ontario domain (see Fig. 1b), even though the integration domains are different for the two models. The three datasets, i.e., QPFs from the coupled and uncoupled models and the CaPA data, are interpolated onto the same grids with the same horizontal resolution of 10 km.
Boundary conditions of the coupled and uncoupled models have little impact on QPFs over the southern Ontario domain, since the southern Ontario domain is small and is located in the middle of the integration domains of the two models. The integration domain of the uncoupled model covers North American that is larger than the integration domain of the coupled model. The boundaries of the coupled-model integration domain are about 2000–3000 km away form the southern Ontario domain. Besides, there are mature techniques to deal with the boundaries such as sponge boundary conditions in the models.
Coupling GEM with the NEMO-CICE models is achieved through a coupler called the Globally Organized System for Simulation Information Passing (GOSSIP) (see Fig. 1a). This coupler allows a bidirectional transfer of fluxes (Smith et al. 2018). First of all, state variables predicted by the atmospheric model GEM are transferred to the ocean-ice model NEMO-CICE through the coupler where the NEMO-CICE regrids GEM’s atmospheric fields. Then, fluxes are calculated on the computational grid with higher resolution, i.e., from NEMO-CICE, using GEM’s flux formulation library. Finally, the fluxes calculated by the NEMO-CICE model are regridded prior to being used in GEM. These flux exchanges between two models are carried out at every time step using the GOSSIP coupler.
The main differences between the coupled and the uncoupled models is the incorporation of the surface fluxes from NEMO-CICE at the air–water interface, such as the one over the Great Lakes (Cao et al. 2018; Smith et al. 2018). Therefore, more emphasis in this study is given on these fluxes and their association with QPFs (particularly daily QPFs) predicted by the two models.
To verify the two models’ QPFs, the Canadian Precipitation Analysis (CaPA) data (Mahfouf et al. 2007; Lespinas et al. 2015) are used. The CaPA data used in this study are a combination of Canadian and U.S. radar data, rain gauge data, and a first guess provided by the uncoupled GEM regional model with 10-km horizontal grid spacing (Fortin et al. 2015; Lespinas et al. 2015). CaPA generates precipitation accumulations at intervals of 24 and 6 h. The quality of CaPA data not only depends on these observations but also relies on the first guess, which is taken from the uncoupled GEM regional model short-range forecasts in this case. In areas with sparse observations the first guess makes an important contribution to the precipitation analysis, which could be an advantage of the uncoupled model when comparing its QPF performance to that of the coupled model. Because of this, any model performance evaluation based on a comparison against precipitation analyses may have some uncertainty. However, in summer months over a region such as southern Ontario with a relatively dense surface network and a good radar coverage, the role of the first guess is less important.
In winter, this uncertainty in precipitation is greater, since CaPA does not assimilate surface observations for solid precipitation (determined from near-surface air temperature) when near-surface winds are greater than a certain threshold, due to an undercatch problem. Moreover, radar retrievals are currently not used in winter months because there are not enough surface observations at the surface to calibrate or unbias the radar retrievals. Without this unbiasing, the inclusion of radar retrievals leads to deterioration of CaPA data. As shown later in section 3, on the other hand, the differences between the two models’ QPFs in winter are actually small and limited impact results.
Hydrometeorological fields (e.g., 24-h precipitation accumulation) extracted from the coupled and the uncoupled models are based on their 1200 UTC runs since the CaPA data are assimilated daily at 1200 UTC. Spatial and temporal verifications of the QPFs are mainly performed over the southern Ontario domain, which is approximately defined as an area of 84°–75°W and 41°–47°N (Fig. 1b), where dense precipitation observations are available (e.g., Cao et al. 2004), whereas southern Ontario is the Canadian portion of what is shown in Fig. 1b.
We will further employ additional independent observations to assess the verification results against the CaPA data, whenever and wherever the independent observations are available. In this study, we will use two independent observation datasets to further evaluate the two models’ performance for daily QPFs. The first independent dataset is the AmeriFlux (https://ameriflux.lbl.gov/data/) measured half-hourly surface precipitation. Although it is available only at observational stations (while CaPA data are available over certain areal extent), the AmeriFlux observed precipitation fully meets our requirement of its independence of both coupled and uncoupled models. Over southern Ontario, there are three AmeriFlux stations (CA-TP3, CA-TP4, and CA-TPD) having precipitation observations (Arain 2018; Table A1 in appendix A). Since their locations are very close (located near the north shore of Lake Erie) with the same precipitation measurements, we only present evaluations of QPFs of the two models against one station observations at CA-TP4. We have also looked for other AmeriFlux stations in New York, Pennsylvania, Ohio, and Michigan. It turns out that there is no station in New York, one station in Pennsylvania with lots of missing data, stations in Ohio without observations in 2017, and only two stations in Michigan with precipitation observations but one with lots of missing data and the other outside of southern Ontario.
To perform QPF evaluations over areas of interest, we employ another independent precipitation observations of the North American Great Lakes hydrometeorological database, which is developed in National Oceanic and Atmospheric Administration’s Great Lakes Environmental Research Laboratory (NOAA GLERL) (https://www.glerl.noaa.gov/ahps/mnth-hydro.html; Hunter et al. 2015). These GLERL Great Lakes monthly and lake-averaged precipitation data were derived from quality-controlled data collected from the U.S. and Canadian federal agencies’ surface observations near and over lakes (about 700–800 stations over the Great Lakes basin, see Figs. 2 and 3 of Hunter et al. 2015). The original data can be interpolated using the Thiessen polygon method and averaged over areas of interest (Hunter et al. 2015). These data are periodically updated to reflect additional data and to extend the period of record.
It is important to note that statistical uncertainty may be associated with the objective evaluation of the above metrics due mainly to a sampling size. In this work, all spatial averages are calculated with 6700 grid points over the southern Ontario domain, and monthly averages are performed using daily values with sampling at least four forecasts (at 6 h apart) a day.
The equations derived for understanding physical processes and/or variables associated with sensible and latent heat fluxes at the interfaces, their energy partition (i.e., Bowen ratio), temperature at the interface, and vertically integrated water vapor flux convergence that cause differences in QPFs between the two models are presented in the next section.
3. Results
a. Verification of daily QPFs by the coupled and uncoupled models
For the first 24-h lead time of QPFs (i.e., forecasts between 0 and 24 h), the domain and monthly averaged bias in daily QPFs is positive for both the coupled and the uncoupled models, implying that both models overpredict the daily precipitation compared to CaPA’s daily accumulation (Fig. 2a and Table 1). Results also show a seasonal signal, with larger biases of daily QPFs in summer than in winter (Fig. 2a). Similarly, the standard deviation exhibits a seasonal cycle, with larger values mainly in the warm season (Fig. 2b).
Statistic for domain-averaged and monthly averaged daily QPF (mm day−1) of coupled and uncoupled models (bold typefaces denote values of the coupled model less than those of the uncoupled model).
During the months of November and December of 2016, as well as April of 2017, the coupled model predicted daily QPFs (bias, SD) (mm day−1) are, respectively, (0.3, 0.42), (0.37, 0.60), and (0.89, 1.15) whereas the uncoupled model predicted daily QPFs (bias, SD) (mm day−1) are, correspondingly, (0.32, 0.44), (0.45, 0.65), and (0.96, 1.20) (Table 1). This indicates that the coupled model is better than the uncoupled one in reducing the bias and SD of daily precipitation in these three months (Fig. 2 and Table 1).
During the months of July–October 2016, February and May 2017, however, the coupled model is worse than the uncoupled (Fig. 2 and Table 1). As shown in Fig. 2 and Table 1, in July–October 2016 the coupled model predicted daily QPFs (bias, SD) (mm day−1) are (1.08, 1.66), (1.10, 1.71), (0.68, 1.13), and (0.56, 0.95) whereas the uncoupled model predicted daily QPFs (bias, SD) (mm day−1) are, respectively, (0.92, 1.48), (0.81, 1.51), (0.42, 1.01), and (0.26, 0.93). In February and May 2017, the daily QPFs (bias, SD) (mm day−1) are (0.44, 0.64) and (1.01, 1.33) for the coupled model versus (0.31, 0.54) and (0.94, 1.27) for the uncoupled model, respectively.
For the second 24-h lead time of QPFs (i.e., forecasts between 24 and 48 h), the domain and monthly averaged bias and SD in daily QPFs are similar to those at the first 24-h lead time of QPFs, i.e., both models overpredicting the daily precipitation with respect to CaPA’s daily accumulation, plus a slight phase shift (Fig. 2). In other words, the performance of the coupled model is better than the uncoupled model in reducing the bias and SD of daily QPFs over the months of October and November of 2016, as well as May of 2017 while the coupled model is worse than the uncoupled during the other months (Fig. 2). The comparisons indicate that in October and November 2016, and May 2017, the coupled model predicted daily QPFs (bias, SD) (mm day−1) are, respectively, (0.56, 1.09), (0.58, 0.71), and (1.45, 1.76) whereas the uncoupled model predicted daily QPFs (bias, SD) (mm day−1) are, respectively, (0.88, 1.41), (0.63, 0.76), and (1.50, 1.83) (Fig. 2). In the rest of the paper, we will focus on the first 24-h lead time of QPFs.
Over most of months of the 1-yr period, the uncoupled model performance appears better than the coupled model in the domain-averaged and monthly averaged daily QPF over the first and second 24-h lead time, particularly in July–August 2016. Given the identical model physics and data assimilation system, as well as identical initial and boundary conditions, the model forecast accuracy is mainly determined by the type of weather system needed to predict and the forecast lead time.
During the winter, weather systems are usually dominated by large-scale systems while in the summer they are dominated by small scale systems. The larger scale weather systems are more predictable at longer lead times than small-scale and quickly developing weather systems, because the former usually lasts longer and causes slower changes in meteorological variables that can be more easily anticipated ahead of time.
Typically, after initial spinup, weather forecast models’ prediction accuracy increases for hours and then gradually decreases (e.g., Haupt 2018) because effects of initial data assimilation fades with time. Comparisons between Figs. 2a and 2c show that forecasts with lead time of 0–24 h are more accurate than those with lead time of 24–48 h over the period of June 2016–May 2017 except January 2017.
We have directly compared the coupled model performance with the uncoupled model in daily QPFs by calculating RMSE differences of daily QPFs between the coupled and uncoupled models. If the difference is negative, the coupled model is better than the uncoupled model. Otherwise, an opposite is true. Figure 3 shows that the coupled model is better than the uncoupled model for the months of November and December of 2016, and April of 2017, which is consistent with Fig. 2. Figure 3 also shows that the coupled model is slightly better than the uncoupled model in June 2016, which is again consistent with the SD calculation in Fig. 2b. However, the coupled model is worse than the uncoupled model in the other months, especially in July–September 2016, February and May 2017 (Fig. 3). This is consistent with Fig. 2 that larger deterioration of the coupled model occurs mainly during the warm season.
Figure 4 shows the domain-averaged and monthly averaged BS in daily QPFs with a threshold of ≥2 mm day−1 for both the coupled and the uncoupled models. Over the period of June 2016 to May 2017, both models have BS > 1, suggesting that the coupled and uncoupled models overpredict daily precipitation, which is consistent with the above analyses in bias and SD. In general, the differences between the two models are small even though the coupled model slightly improves over the uncoupled model in some months such as July and November 2016, and March 2017. As compared with the bias and SD scores, the BS accounts for a range of precipitation amount above a given threshold, rather than an exact difference between the predicted and observed (or analyzed) precipitation.
To gain insight into the diurnal variations of QPFs in the two models, we further plot their daytime (defined as 1200–0000 UTC) and nighttime (defined as 0000–1200 UTC next day) QPFs, as verified against the sum of two 6-h CaPA data. As shown in Fig. 5, during daytime both models have a positive bias for the whole year except for November and December 2016 with a negative bias (Fig. 5a). During night time both models have a positive bias for the whole year except August 2016, February 2017, and May 2017 with a negative bias (Fig. 5b).
During daytime, the slight improvements from the coupled model over the uncoupled system occur in November and December 2016 (Fig. 5a). It is observed from Fig. 5a that the deterioration of the coupled model in daytime precipitation mainly occurs over the warm season. During nighttime, the slight improvements of the coupled model over the uncoupled model happen in June, August, November, and December 2016, as well as in January to April 2017 while an opposite is true for the rest of the months. In particular, in June, August, November, and December 2016, and February to April 2017, the coupled model-predicted 12-h QPF biases (mm 12 h−1) are, respectively, 0.24, −0.20, 0.33, 0.83, −0.23, 0.28, and 0.23 whereas the uncoupled model-predicted 12-h QPF biases (mm 12 h−1) are, correspondingly, 0.31, −0.27, 0.36, 0.91, −0.34, 0.31, and 0.36. These indicate that the improvements of the coupled model over the uncoupled model in QPFs occurring mostly during the nighttime rather than the daytime.
To understand where in southern Ontario the coupled model improves over the uncoupled model, we compute absolute bias differences in daily QPF between the coupled and the uncoupled models. If the differences are less than zero, the coupled model overforecast in daily QPF is smaller than the uncoupled model. Otherwise, the difference greater than zero indicates that the opposite is true.
Figure 6 shows the spatial distributions of monthly averaged daily precipitation over the southern Ontario domain for the CaPA data, the coupled model, and the uncoupled model forecasts. The overall coupled and uncoupled model daily QPFs (the second and third columns of Fig. 6) are greater than the CaPA (the first column of Fig. 6) especially in the summer, consistent with their overpredicted QPFs mentioned earlier. The entire-year maximum daily QPF is about 5–6 mm day−1, which is consistent with the magnitude mentioned in Cao and Ma (2009).
The bias differences between the two models varied considerably in both space and time (Fig. 7). The negative values (denoted by shaded areas with blue colors) in Fig. 7 represent the coupled model bias less than the uncoupled model bias and hence the improvement of the former over the latter. In June 2016, the coupled model showed improvements over the uncoupled model mainly located at lee sides of Georgian Bay and Lake Huron, over Lake Erie, and part of Lake Ontario, as well as over eastern Pennsylvania (Fig. 7a). In July 2016, the improvement of the coupled model over the uncoupled model was strengthened to the east of Georgian Bay and Lake Huron, over the lee side of Lake Ontario and majority of Lake Ontario itself, and slight improvement to the south of Lake Erie (Fig. 7b). Deteriorations of the coupled model were, on the other hand, mainly observed over Lake Erie and a portion of Lake Huron. Deteriorations occurred in August and September 2016 over most land and Lake Huron and Erie while improvements appeared over Lake Ontario and to its south and part of Georgian Bay, as well as at areas near the interaction of Lake Huron and Erie (Figs. 7c and 7d). In October 2016, regions of improvements were mainly switched to south portion of southern Ontario, covering areas of Lakes Erie and Ontario as well as their vicinity (Fig. 7e). In November, the improvement areas were extended to include the northern portion of the domain (Fig. 7f). The regions of improvement were further expanded in December to include almost entire domain of southern Ontario where the coupled model bias is less than the uncoupled one (Fig. 7g). In January 2017, the areas of improvements still occupied the majority of southern Ontario especially Lake Erie and Ontario, and lee side of Lake Huron and Georgian Bay (Fig. 7h). However, the areas of improvements were substantially shrunk in February, replaced by the areas of deteriorations (Fig. 7i). A sea saw occurred since March 2017 when improvement areas were increased particularly in Georgian Bay, Lake Huron and Ontario, and their lee side (Fig. 7j). Improvement areas were rapidly expanded in April and May, covering almost all water surfaces in southern Ontario, with the areal orientations in zonal and northeast–southwest directions, respectively (Figs. 7k and 7l).
Despite the substantial variation of bias differences between the two models in space and time, QPF improvement associated with the coupling mainly occurs at the lee sides of the water body, and sometimes over the lakes. On the other hand, the deteriorations of the coupled model mostly happen over the land where coupling effect is fading, especially in August, September, and February 2017.
As mentioned in section 2, the AmeriFlux (https://ameriflux.lbl.gov/data/) measured half-hourly surface precipitation data are used to assess both coupled and uncoupled model performance in daily QPFs in order to avoid the CaPA data dependence on the uncoupled model.
Figure 8a shows the monthly averaged daily QPF bias of the two models against 24-h precipitation observations at the CA-TP4 station (located at the north shore of Lake Erie, see Fig. 8b). The two model QPFs are taken as an average of QPFs at 11 grid points enclosing the station location. The same average is applied to sensible and latent heat fluxes later on. During the period of June 2016–May 2017, the coupled model performance in daily QPF is better than the uncoupled model for 11 months except for July 2016. This is consistent with the result shown in Fig. 7 (near the north shore of Lake Erie), indicating that near water body, the coupled model improves over the uncoupled model in daily QPFs at least for this station.
Note that at the north shore of Lake Erie, the verifications of coupled model QPFs against the CaPA deteriorate in September 2016 (Fig. 7) whereas at the same location, the verifications of coupled model QPFs against the AmeriFlux observation improve over the uncoupled model QPFs (Fig. 8a). This is because precipitation observations at the AmeriFlux network are not only independent of the two model QPF but also independent of our ECCC observational network.
At the same location of the CA-TP4 station, the monthly averaged sensible and latent heat fluxes in the coupled model are better than those in the uncoupled model over 10 months and 9 months, respectively (Figs. 9a,b). The improved latent heat flux in the coupled model over that in the uncoupled model occurs in 9 months, including June to July 2016, November 2016 to May 2017 (Fig. 9b). Of the remaining 3 months, the sensible heat flux in the coupled model during August and September 2016 is better than that in the uncoupled model (Fig. 9a), while both sensible and latent fluxes in the uncoupled model during October 2016 are better than those in the coupled model (Figs. 9a,b). It turns out that the two model differences of sensible and latent heat fluxes in October 2016 could not be a key factor leading to the differences in daily QPFs between the coupled and uncoupled models, which is actually related to large-scale differences of vertically integrated water vapor flux convergence between the two models (as shown later in Table 3).
Furthermore, we performed two model QPF evaluations over Lake Erie using the quality-controlled independent precipitation observations of the North American Great Lakes hydrometeorological database developed by NOAA GLERL (https://www.glerl.noaa.gov/ahps/mnth-hydro.html; Hunter et al. 2015). As shown in Fig. 10, the coupled model performance in daily QPF is better than the uncoupled model for the 7 months of June, October, November, and December 2016, as well as January, April, and May 2017. This is consistent with the results presented in Fig. 7.
Unlike situations near and over the water body (i.e., Lake Erie), Fig. 11 shows the monthly averaged daily QPF bias of the two models against 24-h precipitation observations at the U.S.-UMB station of the AmeriFlux network (located in Michigan near western boundary of the southern Ontario domain, see Fig. 8b and Table A1). The coupled model performance in daily QPF is better than the uncoupled model for the 6 months of July, September, November, and December 2016, as well as January and April 2017, whereas the former is worse than the latter for the remaining half year. This implies that away from the water body, the coupled model performance deteriorates (cf. Figs. 8a and 11).
In the next section, we will discuss the physical processes that account for the differences in daily QPFs between the two models and try to understand why the coupled model performs better/worse in daily QPFs than the uncoupled model. Before proceeding to the next section, we examine whether or not the differences in QPFs of the two models are statistically significant using t tests (e.g., Cao 2008; Cao et al. 2021). As shown in Table 2, the monthly averaged daily QPF differences between the two models are statistically significant at the >99.9% level over the eight months of June–October 2016 and March–May 2017 (Table 2). In February 2017, the difference is statistically significant at the 95% level (Table 2). Little statistically significant differences of two models’ QPFs only occur in December 2016 and January 2017, with a statistically significant difference at a 70% level appearing in November 2016 (Table 2).
The t test for monthly averaged daily QPF difference between the coupled and the uncoupled models with degrees of freedom of n − 2(= 6700 − 2 = 6698) (statistical significance denoted by a bold typeface).
b. The physical processes associated with the different daily QPFs
In this case, it may be safe to assume that the major differences in precipitation between the coupled and uncoupled models are related to surface evaporation, i.e., moisture fluxes at the underlying surfaces, and the vertically integrated water vapor flux convergence. Since surface sensible heat fluxes are linked to surface evaporation through a Bowen ratio, the differences in sensible heat fluxes also contribute to the differences of daily QPFs in the two models. Although the two processes differ, changes in both sensible and latent heat fluxes influence precipitation production through their impact on the lower tropospheric stability. Thus, our attention will be first paid to how and to what extent the daily sensible and moisture flux differences in the two models cause different daily QPFs. To this end, we calculate the domain (84°–75°W and 41°–47°N, see Fig. 1) averaged and monthly averaged differences between the two models in daily sensible heat and moisture fluxes over southern Ontario surfaces (including land and water surfaces) during the period from June 2016 to May 2017, and then examine these differences in relation to the daily QPF differences of the two models.
It is evident from Figs. 12a and 12b that the differences in the models’ daily QPFs are positively correlated with the differences in the surface sensible heat and moisture fluxes, with correlation coefficients of 0.89 and 0.75, respectively. It is interesting to note that the surface sensible heat flux has 0.14 higher correlation coefficient with precipitation than the surface evaporation. In other words, the relationship between the evaporation flux difference and the QPF difference has more spread from a linear relationship than the one between the sensible heat flux and QPF differences.
To help further understand the differences between the coupled and the uncoupled model in the context of the surface sensible heat and evaporation fluxes, we plot a time series of their differences during the period of June 2016–May 2017. As shown in Fig. 13a, the differences of domain-averaged and monthly averaged daily sensible heat flux reach a maximum in August 2016 and a minimum in November 2016. The differences in the daily evaporation fluxes follow a similar pattern with a slight phase shifts with a maximum and a minimum appearing in July 2016 and December 2016, respectively.
Meanwhile, the differences of domain-averaged and monthly averaged daily QPFs between the coupled and the uncoupled models show a maximum in August 2016 and a minimum in December 2016 (Fig. 13b). The former is consistent in time with the maximum difference of the daily sensible heat flux in August 2016 while the latter is consistent in time with the minimum difference of the daily evaporation in December 2016. This suggests that in the summer improvements of sensible heat flux may be even more critical than evaporation fluxes in reducing the maximum daily QPF difference between the two models. It is interesting to note that the largest differences of sensible heat and evaporation fluxes occur in summer (Fig. 13a) when the coupled system does not perform as well as the uncoupled model (Fig. 13b). In winter, the small differences in evaporation and sensible heat fluxes between the two models (Fig. 13a) could explain the small differences found for daily QPFs between the two models (Fig. 13b).
To synthesize the roles played by the surface sensible and latent heat fluxes in daily QPFs, we will examine the Bowen ratio differences of the two models and their effects on the daily QPF differences in the two models.
In addition to linking the maximum and minimum differences of QPFs between the two models to the maximum and minimum differences of the sensible and latent heat fluxes in August and December 2016, respectively, it is desirable to explore the QPF differences associated with various physical variables over other months during the period of June 2016 to May 2017. To do so, we have calculated the correlation coefficient (r) between the monthly averaged daily QPF differences of the two models and the monthly averaged two model differences of daily variables such as vertically integrated water vapor flux convergence, sensible and latent heat fluxes, and surface temperature (Table 3). Over the southern Ontario domain (Fig. 1b), there are 6700 grid points where the monthly averaged values of those physical variables and QPFs are obtained. To test statistical significance of the correlation coefficient r, we first obtain a critical correction value rα (= 0.024), given α = 0.05 and degrees of freedom of n − 2 (= 6700 − 2 = 6698). If r > rα, the linear relationship is statistically significant (at a level greater than 95%). Otherwise, an opposite is true when r < rα.
Correlation coefficient r between variable (listed in the table) and QPF differences of coupled and uncoupled models at a level of α = 0.05 with degrees of freedom of n − 2 (= 6700 − 2 = 6698) (statistical significance denoted by a bold typeface, i.e., correlation coefficient r greater than a critical rα = 0.024). Note: IH, AH, AV, and TG stand for vertically integrated water vapor flux convergence, daily accumulated sensible heat flux, daily accumulated latent heat flux, and ground temperature.
As shown in Table 3, the monthly averaged daily QPF differences between the coupled and the uncoupled models are of statistically significant relationship with the monthly averaged two model differences of vertically integrated water vapor flux convergence and sensible heat flux in June and July 2016, respectively. In August 2016, those two factors contribute to daily QPF differences between the two models. In September 2016, the monthly averaged daily QPF differences are not only significantly associated with the monthly averaged two-model differences of sensible heat flux, but also latent heat flux and surface temperature. While in October 2016, the QPF differences are mainly linked to the monthly averaged two-model differences of vertically integrated water vapor flux convergence. In addition to the vertically integrated water vapor flux convergence, in November 2016, and in January and February 2017, the linkages are extended to sensible and latent heat fluxes. Besides sensible and latent heat fluxes, in December 2016, surface temperature differences contribute to daily QPF differences of the two models. During spring 2017 (March, April, and May), the vertically integrated water vapor flux convergence remains a factor contributing to the QPF differences, with an additional factor of sensible heat flux in April 2017.
In short, the daily QPF differences in the two models are mainly determined by the differences of 1) the vertically integrated water vapor flux convergence in all seasons with relatively large r values in winter (0.374 in January 2017), fall (0.264 in November 2016), and spring (0.186 in March 2017); 2) latent heat flux with a positive r value in the winter (0.182 in December 2016); 3) sensible heat flux with a positive r value in the winter (0.133 in December 2016); and 4) surface temperature in the winter (r = 0.099 in December 2016) and the fall (r = 0.090 in September 2016).
In the coupled model, surface evaporation is different from the one in the uncoupled model, since the former includes latent heat flux from the Great Lakes through coupling processes while the latter does not. Because of this, horizontal moisture gradients in the coupled model will be different from the one in the uncoupled model, resulting in different moisture advection in two models. Furthermore, this can lead to differences of vertical moisture gradients in the two models especially in and near large water body such as the Great Lakes. Similarly, sensible heat fluxes and surface temperature in the coupled model are different from those in the uncoupled model, which may result in differences between the two models in thermally induced local circulations and convergence. Therefore, surface temperature as well as sensible and latent heat fluxes, and their improvements can influence VIWVFC and its improvements. These physical processes and their interaction and feedback presented in equations derived in this study are general, while their magnitudes could be unique over the Great Lakes region due to the existence of large scale water bodies.
Since surface temperature increase leads to an increase of sensible and latent heat fluxes, respectively, through amplifying temperature and moisture contrast between the underlying surface and the atmosphere above, this results in an increase of precipitation. On the other hand, precipitation often has a cooling effect on the surface it reaches, such as a lake, through lowering near-surface air temperature, the direct precipitation heat flux into the surface, mechanical and convective mixing the lake surface layer (e.g., Rooney et al. 2018). This negative feedback process is not included in the coupled model yet, but it may be important to reduce positive bias of surface temperature in the coupled model and precipitation thereby. It is, therefore, suggested to make additional efforts to quantify the cooling effect in order to incorporate it into the coupled model to improve weather and environment forecast, especially QPF.
4. Summary and conclusions
Based on the verification of the domain-averaged and monthly averaged daily QPF for both the coupled and uncoupled models against the CaPA product over a 1-yr period, we have shown that the coupled model has both positive and negative impacts on the daily QPF skill over the Great Lakes region. It is found that the negative (positive) impacts mainly occur in the summer (fall, winter, and spring) months. The improvements of the coupled model daily QPFs include reductions of domain-averaged and monthly averaged daily QPF (forecasts between 0 and 24 h) bias and SD in November and December 2016, and April 2017 while some errors occur in the other months especially during the summer. The improvements of the coupled model daily QPFs (forecasts between 24 and 48 h) over the uncoupled model are also observed in October and November 2016, and May 2017 whereas the deterioration of the coupled model occurs in the summer months.
From the diurnal variability viewpoint, the improvements of the coupled model over the uncoupled one in the domain-averaged and monthly averaged QPFs occur mainly during the nighttime instead of daytime. During nighttime, the improvements of the coupled model over the uncoupled one occur in June, August, November, and December 2016, and from February to April 2017. On the other hand, during the daytime the improvements of the coupled model over the uncoupled only happen in November and December 2016. Conversely, increased errors of the coupled model daytime QPFs occur in the other months particularly in the summer.
Using two independent observations at stations and over water areas of interest, we find that near and over Lake Erie, the coupled model performance in daily QPF is, respectively, better than the uncoupled model for 11 and 7 months out of the 1-yr period. In the future, it will be interesting to compare the model QPFs with more independent precipitation observations once they become available over the southern Ontario domain. It will also be worthwhile to make an additional comparison with observed precipitation data such as Stage IV (https://data.eol.ucar.edu/dataset/21.093) over the U.S. portion of the Great Lakes region.
Based on the method developed herein for diagnosing QPF-related physical processes at air–water interface and above, the major differences in the domain-averaged and monthly averaged daily QPFs between the coupled and uncoupled models are mainly attributed to differences of sensible heat flux and evaporation, surface temperature, and vertically integrated water vapor flux convergence.
Since the coupled model incorporates the sensible heat flux and evaporation at the air–water interface through two-way interaction, whereas the uncoupled model does not perform this for the water surface, the differences in both sensible and latent heat fluxes between the two models have a realistic relationship with the QPF differences of the two models. Our results with the 1-yr data demonstrate that the sensible heat flux difference has higher correlation coefficients with the daily QPF difference than the evaporation difference. In the summer (winter), the maximum (minimum) difference of sensible heat flux (evaporation) between the two models is in phase with the maximum (minimum) daily QPF differences between the two models. The strong relationship between the surface flux differences and the daily QPF differences (see Figs. 12 and 13) provides confidence that the main causes are indeed related to the coupling between the atmospheric and ocean–lake models.
In this study, we have derived an analytic formulation of nonlinear effect of surface temperature on precipitation, which builds up a foundation not only for climate research on precipitation under warming conditions but also for weather research/forecast on precipitation through surface temperature influences. These influences are realized through physical processes of low-level buoyancy and local evaporation. Furthermore, these impacts can only be fulfilled in two-way coupled models rather than uncoupled models because the latter specifies the surface temperature but does not predict it.
Our results indicate benefits to promote the future improvement of and challenges to use the coupled model for the daily QPFs. That is, while the coupled model adds more physical processes and complexity than the uncoupled model in the hope that forecast errors could be reduced, the former sometimes offers more possibilities to produce forecast errors than the latter, and those errors could propagate when weather systems evolve. Further improvements are needed, especially in the accurate representation of abovementioned four elements of surface temperature, sensible heat flux and evaporation, and vertically integrated water vapor flux convergence. For example, surface temperature increase leads to increased precipitation via intensifying temperature and moisture contrast between the underlying surface and above. On the other hand, precipitation has cooling effect on surface it reaches such as a lake (e.g., Rooney et al. 2018). Including this negative feedback process (not in the coupled model yet) may be important to reduce positive bias of surface temperature in the coupled model and precipitation thereby. We suggest the cooling effect to be quantified by integrating it into the coupled model to improve weather and environment forecast, particularly QPF.
As shown in Eq. (14), the vertically integrated water vapor flux convergence is determined by spatial distribution of moisture, moisture advection, and convergence/divergence, which are essentially associated with dynamics and moisture. Improvement on these physical processes and/or factors especially at low levels of the troposphere will help advance QPFs in the coupled model.
The coupled model may act as to reduce or amplify the bias caused by the uncoupled model through coupling and nonlinear interactions between the surface and the atmosphere, which involves condensation processes. These condensation processes in the uncoupled model include a grid-resolved scheme, a convective parameterization scheme, and shallow convection. Examining those physical processes (e.g., Cao and Zhang 2016) is important but it is beyond the scope of the current study.
Future studies at ECCC will further examine the impact of the two-way coupling on QPFs and other aspects of short-range NWP, for example, evaluations over a longer period with more recent versions of GEM. The projects are underway to substantially improve snowfall analyses in CaPA, with inclusion of more surface observations (through relaxation of rejection criteria related to near-surface winds and the use of transfer function to compensate for the undercatch problem) as well as radar and satellite products.
Acknowledgments.
We thank Dr. Wei Yu for his constructive comments/suggestions on an early version of the manuscript. We also appreciate three anonymous reviewers for their constructive suggestions and comments that have helped improve the quality of this paper. The AmeriFlux data portal was funded by the U.S. Department of Energy Office of Science.
Data availability statement.
The coupled and uncoupled operational regional model forecasts and Canadian Precipitation Analysis (CaPA) are obtained from the Canadian Meteorological Centre. AmeriFlux data are available at https://ameriflux.lbl.gov/data/how-to-uploaddownloaddata/. GLERL Great Lakes monthly hydrologic data are available at https://www.glerl.noaa.gov/pubs/tech_reports/glerl-083/UpdatedFiles/.
APPENDIX
AmeriFlux Station Observations Used for Verifying Two Model QPFs and Fluxes
Table A1 presents a list of the AmeriFlux stations used in the evaluation.
List of AmeriFlux stations used in the evaluation.
REFERENCES
Applequist, S., G. E. Gahrs, R. L. Pfeffer, and X.-F. Niu, 2002: Comparison of methodologies for probabilistic quantitative precipitation forecasting. Wea. Forecasting, 17, 783–799, https://doi.org/10.1175/1520-0434(2002)017<0783:COMFPQ>2.0.CO;2.
Arain, M. A., 2018: AmeriFlux BASE CA-TP4 Ontario-Turkey Point 1939 Plantation White Pine, Ver. 4-5, AmeriFlux AMP. Accessed 23 July 2022, https://doi.org/10.17190/AMF/1246012.
Bélair, S., L.-P. Crevier, J. Mailhot, B. Bilodeau, and Y. Delage, 2003: Operational implementation of the ISBA land surface scheme in the Canadian regional weather forecast model. Part I: Warm season results. J. Hydrometeor., 4, 352–370, https://doi.org/10.1175/1525-7541(2003)4<352:OIOTIL>2.0.CO;2.
Bolton, D., 1980: The computation of equivalent potential temperature. Mon. Wea. Rev., 108, 1046–1053, https://doi.org/10.1175/1520-0493(1980)108<1046:TCOEPT>2.0.CO;2.
Brassington, G. B., and Coauthors, 2015: Progress and challenges in short- to medium-range coupled prediction. J. Oper. Oceanogr., 8, s239–s258, https://doi.org/10.1080/1755876X.2015.1049875.
Cao, Z., 2008: Severe hail frequency over Ontario, Canada: Recent trend and variability. Geophys. Res. Lett., 35, L14803, https://doi.org/10.1029/2008GL034888.
Cao, Z., and J. Ma, 2009: Summer severe rainfall frequency trend and variability over Ontario, Canada. J. Appl. Meteor. Climatol., 48, 1955–1960, https://doi.org/10.1175/2009JAMC2055.1.
Cao, Z., and D.-L. Zhang, 2016: Analysis of missed summer severe rainfall forecasts. Wea. Forecasting, 31, 433–450, https://doi.org/10.1175/WAF-D-15-0119.1.
Cao, Z., and Coauthors, 2002: On the physical processes associated with the water budget and discharge of the Mackenzie Basin during the 1994/95 water year. Atmos.–Ocean, 40, 125–143, https://doi.org/10.3137/ao.400204.
Cao, Z., P. Pellerin, and H. Ritchie, 2004: Verification of mesoscale modeling for the severe rainfall event over southern Ontario in May 2000. Geophys. Res. Lett., 31, L23108, https://doi.org/10.1029/2004GL020547.
Cao, Z., M. D. Mackay, C. Spence, and V. Fortin, 2018: Variational computation of sensible and latent heat flux over Lake Superior. J. Hydrometeor., 19, 351–373, https://doi.org/10.1175/JHM-D-17-0157.1.
Cao, Z., Q. Xu, and D.-L. Zhang, 2019: A new method to diagnose cyclone–cyclone interaction and its influences on precipitation. J. Appl. Meteor. Climatol., 58, 1821–1851, https://doi.org/10.1175/JAMC-D-18-0344.1.
Cao, Z., H. Cai, and G. J. Zhang, 2021: Geographic shift and environment change of U.S. tornado activities in a warming climate. Atmosphere, 12, 567, https://doi.org/10.3390/atmos12050567.
Côté, J., S. Gravel, A. Méthot, A. Patoine, M. Roch, and A. Staniforth, 1998: The operational CMC–MRB Global Environmental Multiscale (GEM) model. Part I: Design considerations and formulation. Mon. Wea. Rev., 126, 1373–1395, https://doi.org/10.1175/1520-0493(1998)126<1373:TOCMGE>2.0.CO;2.
Dong, B., R.T. Sotton, L. Shaffrey, and N. P. Klingaman, 2017: Attribution of forced decadal climate change in coupled and uncoupled ocean–atmosphere model experiments. J. Climate, 30, 6203–6223, https://doi.org/10.1175/JCLI-D-16-0578.1.
Durnford, D., and Coauthors, 2018: Toward an operational water cycle prediction system for the Great Lakes and St. Lawrence River. Bull. Amer. Meteor. Soc., 99, 521–546, https://doi.org/10.1175/BAMS-D-16-0155.1.
Fortin, V., G. Roy, N. Donaldson, and A. Mahidjiba, 2015: Assimilation of radar quantitative precipitation estimations in the Canadian Precipitation Analysis (CaPA). J. Hydrol., 531, 296–307, https://doi.org/10.1016/j.jhydrol.2015.08.003.
Fritsch, J. M., and R. E. Carbone, 2004: Improving quantitative precipitation forecasts in the warm season: A USWRP research and development strategy. Bull. Amer. Meteor. Soc., 85, 955–966, https://doi.org/10.1175/BAMS-85-7-955.
Fujisaki-Manome, A., and Coauthors, 2017: Turbulent heat fluxes during an extreme lake-effect snow event. J. Hydrometeor., 18, 3145–3163, https://doi.org/10.1175/JHM-D-17-0062.1.
Gallus, W. A., Jr., N. A. Snook, and E. V. Johnson, 2008: Spring and summer severe weather reports over the Midwest as a function of convective mode: A preliminary study. Wea. Forecasting, 23, 101–113, https://doi.org/10.1175/2007WAF2006120.1.
Gu, H., Z. Ma, and M. Li, 2016: Effect of a large and very shallow lake on local summer precipitation over the Lake Taihu basin in China. J. Geophys. Res. Atmos., 121, 8832–8848, https://doi.org/10.1002/2015JD024098.
Haupt, S. E., 2018: Short-range forecasting for energy. Weather and Climate Services for the Energy Industry, 1st ed. A. Troccoli, Eds., Springer, 97–107 https://doi.org/10.1007/978-3-319-68418-5_7.
Hunter, T. S., A. H. Clites, A. D. Gronewold, and K. B. Campbell, 2015: Development and application of a North American Great Lakes hydrometeorological database. Part I: Precipitation, evaporation, runoff, and air temperature. J. Great Lakes Res., 41, 65–77, https://doi.org/10.1016/j.jglr.2014.12.006.
Jessup, S. M., and S. J. Colucci, 2012: Organization of flash-flood-producing precipitation in the northeast United States. Wea. Forecasting, 27, 345–361, https://doi.org/10.1175/WAF-D-11-00026.1.
Larsen, M. A. D., and Coauthors, 2016: Local control on precipitation in a fully coupled climate-hydrology model. Sci. Rep., 6, 22927, https://doi.org/10.1038/srep22927.
Lespinas, F., V. Fortin, G. Roy, P. Rasmussen, and T. Stadnyk, 2015: Performance evaluation of the Canadian Precipitation Analysis (CaPA). J. Hydrometeor., 16, 2045–2064, https://doi.org/10.1175/JHM-D-14-0191.1.
Lombardo, K. A., and B. A. Colle, 2010: The spatial and temporal distribution of organized convective structures over the northeast and their ambient conditions. Mon. Wea. Rev., 138, 4456–4474, https://doi.org/10.1175/2010MWR3463.1.
Madec, G., P. Delecluse, M. Imbard, and C. Lévy, 1998: OPA 8.1: Ocean general circulation model reference manual. IPSL Note du Pôle de Modélisation, Note 11, 91 pp.
Madec, G., and NEMO Team, 2016: NEMO ocean engine. IPSL Note du Pôle de Modélisation, Note 27, 386 pp., https://doi.org/10.5281/zenodo.1472492.
Mahfouf, J.-F., B. Brasnett, and S. Gagnon, 2007: A Canadian Precipitation Analysis (CaPA) project: Description and preliminary results. Atmos.-Ocean, 45, 1–17, https://doi.org/10.3137/ao.v450101.
Mailhot, J., and Coauthors, 1998: Scientific description of RPN physics library. Version 3.6, Recherche en Prévision Numérique, 188 pp.
Minallah, S., and A. Steiner, 2021: The effects of lake representation on the regional hydroclimate in the ECMWF reanalyses. Mon. Wea. Rev., 149, 1747–1766, https://doi.org/10.1175/MWR-D-20-0421.1.
Olson, D. A., N. W. Junker, and B. Korty, 1995: Evaluation of 33 years of quantitative precipitation forecasting at the NMC. Wea. Forecasting, 10, 498–511, https://doi.org/10.1175/1520-0434(1995)010<0498:EOYOQP>2.0.CO;2.
Priestley, C. H. B., and R. J. Taylor, 1972: On the assessment of surface heat flux and evaporation using large-scale parameters. Mon. Wea. Rev., 100, 81–92, https://doi.org/10.1175/1520-0493(1972)100<0081:OTAOSH>2.3.CO;2.
Pullen, J., and Coauthors, 2017: Coupled ocean-atmosphere forecasting at short and medium time scales. J. Mar. Res., 75, 877–921, https://doi.org/10.1357/002224017823523991.
Rasmusson, E. M., 1968: Atmospheric water vapor transport and the water balance of North American II. Large-scale water balance investigations. Mon. Wea. Rev., 96, 720–734, https://doi.org/10.1175/1520-0493(1968)096<0720:AWVTAT>2.0.CO;2.
Ren, X., and Y. Qian, 2005: A coupled regional air-sea model, its performance and climate drift in simulation of the east Asian summer monsoon in 1998. Int. J. Climatol., 25, 679–692, https://doi.org/10.1002/joc.1137.
Rooney, G. G., N. V. Lipzig, and W. Thiery, 2018: Estimating the effect of rainfall on the surface temperature of a tropical lake. Hydrol. Earth Syst. Sci., 22, 6357–6369, https://doi.org/10.5194/hess-22-6357-2018.
Roy, F., and Coauthors, 2015: Arctic sea ice and freshwater sensitivity to the treatment of the atmosphere–ice–ocean surface layer. J. Geophys. Res. Oceans, 120, 4392–4417, https://doi.org/10.1002/2014JC010677.
Smith, G. C., and Coauthors, 2016: Sea ice forecast verification in the Canadian global ice ocean prediction system. Quart. J. Roy. Meteor. Soc., 142, 659–671, https://doi.org/10.1002/qj.2555.
Smith, G. C., and Coauthors, 2018: Impact of coupling with an ice–ocean model on global medium-range NWP forecast skill. Mon. Wea. Rev., 146, 1157–1180, https://doi.org/10.1175/MWR-D-17-0157.1.
Su, D., L. Wen, X. Gao, M. Leppäranta, X. Song, Q. Shi, and G. Kirillin, 2020: Effects of the largest lake of the Tibetan Plateau on the regional climate. J. Geophys. Res. Atmos., 125, e2020JD033396, https://doi.org/10.1029/2020JD033396.
Sukovich, E. M., F. M. Ralph, F. E. Barthold, D. W. Reynolds, and D. R. Novak, 2014: Extreme quantitative precipitation forecast performance at the Weather Prediction Center from 2001 to 2011. Wea. Forecasting, 29, 894–911, https://doi.org/10.1175/WAF-D-13-00061.1.
Umek, L., and A. Gohm, 2016: Lake and orographic effects on a snowstorm at Lake Constance. Mon. Wea. Rev., 144, 4687–4707, https://doi.org/10.1175/MWR-D-16-0032.1.
Wang, G., D.-L. Zhang, and J. Sun, 2021: A multiscale analysis of a nocturnal extreme rainfall event of 14 July 2017 in northeast China. Mon. Wea. Rev., 149, 173–187, https://doi.org/10.1175/MWR-D-20-0232.1.
Wang, S., C. Dieterich, R. Döscher, A. Höglund, R. Hordoir, H. E. Markus Meier, P. Samuelsson, and S. Schimanke, 2015: Development and evaluation of a new regional coupled atmosphere–ocean model in the North Sea and Baltic Sea. Tellus, 67A, 24284, https://doi.org/10.3402/tellusa.v67.24284.
Xia, R., and D.-L. Zhang, 2019: An observational analysis of three extreme rainfall episodes of 19–20 July 2016 along the Taihang Mountains in North China. Mon. Wea. Rev., 147, 4199–4220, https://doi.org/10.1175/MWR-D-18-0402.1.