Improving Predictions of Surface Air Temperature Anomalies over Japan by the Selective Ensemble Mean Technique

J. V. Ratnam Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by J. V. Ratnam in
Current site
Google Scholar
PubMed
Close
,
Takeshi Doi Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by Takeshi Doi in
Current site
Google Scholar
PubMed
Close
,
Yushi Morioka Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by Yushi Morioka in
Current site
Google Scholar
PubMed
Close
,
Pascal Oettli Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by Pascal Oettli in
Current site
Google Scholar
PubMed
Close
,
Masami Nonaka Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by Masami Nonaka in
Current site
Google Scholar
PubMed
Close
, and
Swadhin K. Behera Application Laboratory, Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan

Search for other papers by Swadhin K. Behera in
Current site
Google Scholar
PubMed
Close
Full access

Abstract

The selective ensemble mean (SEM) technique is applied to the late spring and summer months (May–August) surface air temperature anomaly predictions of the Scale Interaction Experiment–Frontier Research Center for Global Change, version 2 (SINTEX-F2), coupled general circulation model over Japan. Using the Köppen–Geiger climatic classification we chose four regions over Japan for applying the SEM technique. The SINTEX-F2 ensemble members for the SEM are chosen based on the anomaly correlation coefficients (ACC) of the SINTEX-F2 predicted and observed surface air temperature anomalies. The SEM technique is applied to generate the forecasts of the surface air temperature anomalies for the period 1983–2018 using the selected members. Analysis shows the ACC skill score of the SEM prediction to be higher compared to the ACC skill score of predictions obtained by averaging all the 24 members of the SINTEX-F2 (ENSMEAN). The SEM predicted surface air temperature anomalies also have higher hit rate and lower false alarm rate compared to the ENSMEAN predicted anomalies over a range of temperature anomalies. The results indicate the SEM technique to be a simple and easy to apply method to improve the SINTEX-F2 predictions of surface air temperature anomalies over Japan. The better performance of the SEM in generating the surface air temperature anomalies can be partly attributed to realistic prediction of 850-hPa geopotential height anomalies over Japan.

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: J. V. Ratnam, jvratnam@jamstec.go.jp

Abstract

The selective ensemble mean (SEM) technique is applied to the late spring and summer months (May–August) surface air temperature anomaly predictions of the Scale Interaction Experiment–Frontier Research Center for Global Change, version 2 (SINTEX-F2), coupled general circulation model over Japan. Using the Köppen–Geiger climatic classification we chose four regions over Japan for applying the SEM technique. The SINTEX-F2 ensemble members for the SEM are chosen based on the anomaly correlation coefficients (ACC) of the SINTEX-F2 predicted and observed surface air temperature anomalies. The SEM technique is applied to generate the forecasts of the surface air temperature anomalies for the period 1983–2018 using the selected members. Analysis shows the ACC skill score of the SEM prediction to be higher compared to the ACC skill score of predictions obtained by averaging all the 24 members of the SINTEX-F2 (ENSMEAN). The SEM predicted surface air temperature anomalies also have higher hit rate and lower false alarm rate compared to the ENSMEAN predicted anomalies over a range of temperature anomalies. The results indicate the SEM technique to be a simple and easy to apply method to improve the SINTEX-F2 predictions of surface air temperature anomalies over Japan. The better performance of the SEM in generating the surface air temperature anomalies can be partly attributed to realistic prediction of 850-hPa geopotential height anomalies over Japan.

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: J. V. Ratnam, jvratnam@jamstec.go.jp

1. Introduction

Japan experiences a hot and humid climate in the summer season. The combination of high temperatures and humidity in the season increases the wet bulb temperatures, enhancing the likelihood of heatstroke and related illnesses (Akihiko et al. 2015). Predicting surface air temperatures over Japan well in advance would benefit planners and society as a whole. Numerical models are often used to predict temperatures at seasonal time scales. Usually an ensemble of model predictions with varying initial and boundary conditions is generated to quantify the uncertainty in the predictions. The mean of the ensemble of the model predictions is taken as a more reliable prediction compared to the prediction by individual members of the ensemble (Palmer and Anderson 1994). However, there is a likelihood of some members of the ensemble performing better than others in predicting the surface air temperatures over a region. Identifying and generating a mean of those members of the ensemble may enhance the skill of the regional predictions of surface air temperatures (SAT). This technique of selectively averaging the members of a seasonal forecasting system to improve predictions is called the selective ensemble mean (SEM; Qi et al. 2014; Nishimura and Yamaguchi 2015). This technique is similar to the method often adopted by researchers in choosing a particular model from a large number of Coupled Model Intercomparison Project (CMIP) models for analysis (Sabeerali et al. 2013).

Qi et al. (2014) and Nishimura and Yamaguchi (2015) applied the SEM technique to improve the predictions of the tracks of tropical cyclones of an ensemble prediction system. The ensemble members that have smaller positional errors at short lead times of 6 or 12 h were considered for the SEM in their studies. Their studies found that the SEM technique improves the track predictions compared to the ensemble mean of all the members of the ensemble prediction system. Scher and Messori (2019) applied the SEM technique to improve the predictions of severe European windstorms. Their study found that the SEM technique could improve the prediction of extreme windstorm events up to a lead time of 36–48 h. We apply such a technique of SEM to late spring and summer (May–August) seasonal predictions of the Scale Interaction Experiment–Frontier Research Center for Global Change, version 2 (SINTEX-F2) (Doi et al. 2016, 2017), over Japan in this study. The anomaly correlation coefficient (ACC), which is widely used to verify model predictions (Miyakoda et al. 1986; Jolliffe and Stephenson 2012), is the value of correlation between the predicted anomalies and the verifying or observed anomalies. Positive (negative) values of ACC indicate the predicted anomalies to have same sign (opposite sign) as the verifying anomalies. The predictions with positive ACC values are considered skillful. Thus, ACC is a good measure for identifying the members for the SEM.

The Köppen–Geiger climatic classification (Peel et al. 2007; Beck et al. 2018) classifies the climate of Japan into three climatic zones. The northernmost island of Japan, Hokkaido, falls under the category of a cold, without dry season, and warm summer (Dfb) climate. The region of Japan between 38° and 41°N latitudes (hereafter north) falls under the category of a cold, without dry season, hot summer (Dfa) climate. The region of Japan to the west of 137°E (hereafter west) has a temperate, without dry season, hot summer (Cfa) climate. The region between 137°–141°E and 34°–38°N (hereafter central) has a combination of Cfa and Dfa climates. Based on the above climatic classification types, we choose the four regions of Hokkaido, north, central, and west (Fig. 1) of Japan in this study for applying the technique of SEM to the SAT anomaly predictions of SINTEX-F2.

Fig. 1.
Fig. 1.

The regions of study shown on the map of Japan as rectangular boxes.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

In the following sections we analyze if the SEM technique has advantages over the traditional method of averaging all the members of the ensemble when applied to SAT anomaly predictions over Japan.

2. Model and methodology

In this study, SAT predictions of the 24 members of the SINTEX-F2 forecasting system initialized in April are analyzed. The period of analysis is the late spring and summer months, May–August, which correspond to 1–4-month lead predictions from April initial conditions, covering the years 1983–2018. The area of interest are the four regions (viz. Hokkaido, north, central, and west; Fig. 1) of Japan. The SINTEX-F2 seasonal forecasting system is a coupled ocean–atmosphere global model (Masson et al. 2012; Sasaki et al. 2013) and is used for generating experimental seasonal predictions every month at Japan Agency for Marine-Earth Science and Technology (JAMSTEC). The atmospheric component of the SINTEX-F2 coupled system is the fifth generation ECHAM model (Roeckner et al. 2003) and the oceanic component is the Nucleus for European Modeling of the Ocean (NEMO) (Madec 2008). The atmospheric component has a horizontal resolution of about 100 km and 31 vertical levels. The oceanic component also has 31 vertical levels but has a horizontal resolution of 0.5° × 0.5° (~50 × 50 km2). The atmospheric and oceanic components of SINTEX-F2 forecasting system are coupled using the Ocean Atmosphere Sea Ice Soil coupler (OASIS3; Valcke et al. 2004) and fluxes are exchanged between the models every 2 h. The SINTEX-F2 predictions are initialized by updating the oceanic state by three-dimensional assimilation and also by nudging technique. The 24 members of the SINTEX-F2 differ in the way the oceanic conditions are initialized by applying various nudging strengths; 1) two kinds of observational SST datasets: the low-resolution weekly data and the high-resolution daily; 2) three large negative feedback values for the nudging (Luo et al. 2005); 3) two different modeling ways for the ocean vertical mixing (Sasaki et al. 2012); and 4) with/without monthly three-dimensional variational ocean data assimilation (3DVAR) correction (Doi et al. 2017). Therefore, the 24-ensemble prediction system considers to some extent uncertainties of both initial conditions and model physics. The details of the model spin up and retrospective prediction experiments are given in Doi et al. (2016, 2017). The SINTEX-F2 model predictions are available for the years 1983–2018 and we used those predictions in this study.

As mentioned in the previous section, the members for the selective ensemble mean are identified based on the anomaly correlation coefficient of the predictions with respect to a validation data. The detailed procedure followed for the selection of SINTEX-F2 members for the SEM is as given below:

  1. The monthly anomalies of the predicted surface air temperature are generated for each of the 24 SINTEX-F2 ensemble members by removing the monthly climatology of that member. The anomalies are detrended by removing the linear trend. The period 1983–2018 is used for the calculation of the monthly climatology.

  2. The Global Historical Climatological Network, version 3 and the Climate Anomaly Monitoring System (GHCN-CAMS; Fan and van den Dool 2008), a product of Climate Prediction Center, National Centers for Environmental Prediction, United States, surface air temperature is used as the validation dataset. The gridded data are at 0.5° × 0.5° horizontal resolution and is available on real time. The monthly verifying SAT anomalies are derived by removing the monthly climatology. The anomalies are detrended by removing the linear trend. The period for the calculations of climatology is 1983–2018.

  3. Leave-one-out or the jackknife cross validation technique is used in the calculation of ACC for identification of the SINTEX-F2 members for the SEM. In this technique the data are repeatedly divided into calibration (35 years) and independent validation period (1 year). The ACC between the GHCN-CAMS and SINTEX-F2 surface air temperature anomalies is calculated for each training period.

  4. Bootstrapping (Efron and Tibshirani 1994) with replacement is used in the calculation of the ACC. The bootstrapping technique is useful to estimate the confidence intervals (Mason 2008) of the calculated ACC. A bootstrap sample of size 500 is used to generate 500 ACC values for each training period in step 3. In the resampling, the forecast and observations pairs are kept together, so that confidence levels for the ACC are obtained. The 500 ACC values are sorted in descending order of magnitude. We choose those members of SINTEX-F2 as members suitable for the SEM ensemble that have at least 90% of the 500 ACC values, leaving the top 5% and bottom 5% values, greater than 0.0 in the training period.

  5. Initial analysis showed the SINTEX-F2 members to vary among training periods in step 4 with some SINTEX-F2 members being common in most of the training periods. So, we selected those SINTEX-F2 members that were common in at least 80% of the training periods as the members of the SEM. This step is a slight modification of the traditional application of leave-one-out approach in which the weights obtained in the training period are applied to get the value in the validation year. The traditional application of leave-one-out approach assumes that the relations between the variables do not change much with time, which is not strictly true in our case. This step is useful for applying the SEM technique to predictions beyond the study period 1983–2018.

  6. After identifying the SINTEX-F2 members for SEM in step 5, the SEM predicted surface temperature anomalies are generated for the period 1983–2018.

  7. Steps 3–6 are applied to generate SEM forecasts over the Hokkaido, north, central, and west regions of Japan and for the months May–August.

3. Results

a. Selective ensemble mean of SINTEX-F2 members

Table 1 shows the members of the SINTEX-F2 used in the SEM forecasts of SAT anomalies over the four regions and over the months May–August. It is interesting to note that the SINTEX-F2 members of SEM vary among all the regions and over all the months May–August (Table 1). The variation of the SINTEX-F2 members in the SEM among the regions indicates that the SEM technique is more suitable for application to regional forecasts.

Table 1.

Ensemble members of SINTEX-F2 model used for the SEM.

Table 1.

The surface air temperature predicted anomalies obtained from the ensemble mean of the 24 members of SINTEX-F2 (ENSMEAN) and the mean of the selected members (SEM) (Table 1) for all the four months and the four regions are calculated for the years 1983–2018 and presented in Figs. 2a–h and 3a–h. In the month of May, positive SAT anomalies greater than 1°C were observed in 1990, 1991, 1994, 1995, 2004, and 2016 over Hokkaido (Fig. 2a). Both the ENSMEAN and SEM predictions failed to capture SAT anomalies with magnitude greater than 1°C in all the six years i.e., the number of hits were 0 and number of misses were 6 leading to a hit rate [hit rate = hits/(hits + misses); HR] of 0 for both ENSMEAN and SEM. The false alarm, i.e., the number of years in which the predicted temperature anomalies were greater than 1°C but the observed anomalies were less than 1°C, is 0 for ENSMEAN and 1 in SEM (Fig. 2a). SEM predicted the temperature anomalies to be greater than 1°C in 2018 (Fig. 2a). The number of correct rejections, i.e., the number of years in which the observed temperature anomalies as well as predicted were less than 1°C, is 30 for ENSMEAN and 29 for SEM. Thus, the false alarm rate {false alarm rate = [false alarm/(false alarm + correct rejections)]; FAR hereafter} is 0.0 for ENSMEAN and 0.03 for SEM. The calculations of HR and FAR are based on the definitions of Mason and Graham (1999). Plots of HR versus FAR are shown in Figs. 4a–d and 4e–h, respectively, for a range of positive (>1°, >0.8°, >0.5°, >0.4°, >0.3°, >0.2°, >0.1°, and >0.0°C) and negative (<−1.0°, <−0.8°, <−0.5°, <−0.4°, <−0.3°, <−0.2°, <−0.1°, <0.0°C) temperature anomalies for the months May–August over the four regions (Figs. 2 and 3). From Fig. 4, it is evident that SEM has higher hit rate and lower false alarm rate compared to ENSMEAN over most ranges of temperature anomalies in all the months May–August and over all the four regions. However, SEM predicted SAT anomalies similar to ENSMEAN predicted values have lower hit rate for temperature anomalies over 1°C and below 1°C in all the regions and in all the months (Fig. 4). In the month of May, the positive temperature anomalies predicted by ENSMEAN over central and north regions have higher FAR compared to HR (Fig. 4a). Similarly, in the month of August, the ENSMEAN predicted negative temperature anomalies over Hokkaido and north regions have higher FAR compared to HR over most of the temperature ranges (Fig. 4h). These results indicate that the ENSMEAN predicted positive temperature anomalies over the central and north in May, and negative surface temperature anomalies over Hokkaido and north regions in August, are not very useful.

Fig. 2.
Fig. 2.

(a) Observed (black), ENSMEAN (orange), and SEM (blue) surface air temperature anomalies (°C) over Hokkaido in May of 1983–2018. (b)–(d) As in (a), but for the north, central, and west regions. (e)–(h) As in (a)–(d), but for the month of June.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

Fig. 3.
Fig. 3.

(a) Observed (black), ENSMEAN (orange), and SEM (blue) surface air temperature anomalies (°C) over Hokkaido in July of 1983–2018. (b)–(d) As in (a), but for the north, central, and west regions. (e)–(h) As in (a)–(d), but for August.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

Fig. 4.
Fig. 4.

(a) Hit rate vs false alarm rate plot of ENSMEAN (dashed lines) and SEM (solid lines) in May of positive temperature anomaly ranges over the four regions of Hokkaido, north, central, and west. The numbers correspond to the ranges of temperature anomalies as indicated at the top of each panel. (b)–(d) As in (a), but for the months June, July, and August, respectively. (e)–(h) As in (a)–(d), but for various ranges of negative temperature anomalies.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

The ACC and RMSE values of ENSMEAN and SEM predicted SAT anomalies with respect to GHCN-CAMS surface temperature anomalies over the four regions and over the months May–August are given in Table 2. As seen from Table 2, the ACC skill score of SEM predicted SAT anomalies is higher compared to that of ENSMEAN predicted values over all the regions and in all the months May–August (Table 2). However, the RMSE of the SEM predicted SAT anomalies are higher than that of ENSMEAN predicted SAT anomalies in some of the months and over some regions (Table 2). In May, the ACC of ENSMEAN over north and central is low with values of 0.09 and −0.05, respectively (Table 2). This may partly be attributed to the high FAR compared to HR over these regions (Fig. 4a). The ACC in May over north and central regions is much improved to 0.33 and 0.46 in SEM along with the increase in HR and reduction of FAR values over these regions (Figs. 4a,e). The ACC of the ENSMEAN over Hokkaido, north, and central regions in June are low, 0.09, 0.08, and 0.08 (Table 2). The HR is almost equal to FAR over these regions in predicting the positive SAT anomalies in ENSMEAN (Fig. 4b) though the HR is higher than FAR in forecasting the negative temperature anomalies (Fig. 4f). The ACC increased to 0.45, 0.38, and 0.35 over those regions in SEM predictions for June over Hokkaido as well as over north and central regions (Table 2). The HR is also higher in SEM predictions compared to that of ENSMEAN in June over these regions (Figs. 4b,f). The ENSMEAN has higher ACC over west in predicted SAT anomalies compared to the other three regions in May and June (Table 2) though the ACC is less than that of SEM predicted values. In July, the ACC of the ENSMEAN prediction over Hokkaido, north, and central is higher than that in May and June (Table 2). Also, the HR of ENSMEAN predictions is higher over these regions in July compared to that in May and June (Figs. 4c,g). However, the SEM predicted SAT anomalies have higher ACC values (Table 2) and HR (Figs. 4c,g) compared to that of ENSMEAN in July. In August, the ACC values are higher for the SEM predicted SAT anomalies compared to the ENSMEAN predicted values (Table 2). The HR is higher and FAR is lesser in the SEM predictions compared to that of ENSMEAN prediction of SAT anomalies over all of the four regions (Figs. 4d,h).

Table 2.

Anomaly correlation coefficient and RMSE of ENSMEAN (SEM) for all the regions and for the months May–August.

Table 2.

The above results indicate that the SEM technique is useful for improving the sign and amplitude of the SAT anomaly predictions of SINTEX-F2 over different regions of Japan in the late spring and summer months (May–August).

b. Causes of differences between ENSMEAN and SEM predictions

In this section, we try to understand the causes of better performance of SEM compared to ENSMEAN in predicting SAT anomalies over the four regions of Japan. The sign and location of 850-hPa geopotential height anomalies can to some extent explain the sign of the SAT anomalies. Positive (negative) 850-hPa geopotential height anomalies located over a region indicate open sky (cloudy) conditions and hence can lead to increase (decrease) of incoming solar radiation thereby increase (decrease) the SAT anomalies over the region. Also, the circulation anomalies associated with the 850-hPa height anomalies can advect warm or cold air from the surrounding seas and contribute to the variation of the SAT anomalies. Thus, to understand the causes for the better performance of SEM compared to ENSMEAN, we correlated the 850-hPa geopotential height detrended anomalies of NCEP–NCAR reanalysis (Kalnay et al. 1996), ENSMEAN, and SEM with the GHCN-CAMS estimated SAT detrended anomalies over the four regions Hokkaido, north, central, and west regions of Japan for the months May–August. Correlating the observed SAT values with the predicted 850-hPa geopotential anomalies would bring out the biases in the prediction of 850-hPa geopotential height anomalies in ENSMEAN and SEM and thereby partly explain the performances of ENSMEAN and SEM in predicting the SAT anomalies.

The spatial distribution of ACC of SAT anomalies over Hokkaido with the NCEP 850-hPa geopotential height anomalies shows a region of positive values over Japan and over the western North Pacific (Fig. 5a) in the month of May. However, the spatial distribution of the ACC values of ENSMEAN predictions shows negative values over Japan and over the surrounding regions (Fig. 5b). The SEM prediction of 850-hPa geopotential height anomalies is positively correlated with the observed SAT values over parts of Japan and western North Pacific (Fig. 5c). In the months of June, July, and August, which are similar to May, the correlation of SAT anomalies over Hokkaido with the NCEP 850-hPa anomalies over Japan are positive. The ACC values are also positive over the surrounding regions to the east, west, and south of Japan (Figs. 5d,g,j). The spatial distribution of correlation coefficients of SAT anomalies over Hokkaido and the 850-hPa anomalies of ENSMEAN predictions though positive over all regions Japan (Figs. 5e,h,k) are negative over Hokkaido in the months of June and August (Figs. 5e,k). The spatial distribution of ACC values of SEM predictions shows positive values over Japan and the surrounding regions similar to the spatial distribution of the counterparts with NCEP though with some biases in the months of June, July, and August (Figs. 5f,i,l). The spatial distribution of ACC values shows the SEM predictions to better predict the sign of the 850-hPa geopotential height anomalies compared to the ENSMEAN predictions thereby partly explain the better performance of SEM in predicting the SAT anomalies over Hokkaido compared to the SAT predictions by ENSMEAN.

Fig. 5.
Fig. 5.

(a)–(c) Spatial distribution of ACC values of correlation between the GHCN-CAMS estimated temperature anomalies in May over Hokkaido with the 850-hPa geopotential height (m) anomalies of (a) NCEP–NCAR reanalysis, (b) ENSMEAN, and (c) SEM. (d)–(f) As in (a)–(c), but for June; (g)–(i) as in (a)–(c), but for July; (j)–(l) as in (a)–(c), but for August. The hashed region is significant at 90% using Student’s two-tailed t test.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

The SAT anomalies over north are positively correlated with the NCEP estimated 850-hPa geopotential height anomalies over Japan in all the months May–August (Figs. 6a,d,g,j) indicating the sign of the 850-hPa geopotential height anomalies to explain the sign of the SAT anomalies over the region. The ENSMEAN predicted 850-hPa geopotential height anomalies are negatively correlated with the GHCN-CAMS estimated SAT anomalies over north in the months of May and July (Figs. 6b,h). However, the ACC values are positive over Japan in the months of June and August though small in magnitude (Figs. 6e,k). The spatial distribution of ACC values of the SEM predictions over north region is positive over Japan in all the months May–August (Figs. 6c,f,i,l) similar to the distribution of the distribution of observed ACC values (Figs. 6a,d,g,j).

Fig. 6.
Fig. 6.

As in Fig. 5, but for the north region.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

Over the central region, the correlation of GHCN-CAMS estimated SAT anomalies and the NCEP estimated 850-hPa geopotential height anomalies is positive over Japan (Figs. 7a,d,g,j). The ENSMEAN predictions show negative ACC values in May and July (Figs. 7b,h) and positive ACC values over Japan in June and August (Figs. 7e,k) over Japan. On the other hand, the SEM predictions have positive ACC values over Japan in all the months (Figs. 7c,f,i,l).

Fig. 7.
Fig. 7.

As in Fig. 5, but for the central region.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

Similar to the other three regions, the correlation of GHCN-CAMS estimated SAT anomalies over west are positively correlated with the 850-hPa NCEP geopotential height anomalies over Japan (Figs. 8a,d,g,j). The ACC values of the ENSMEAN over Japan are negative in May and July (Figs. 8b,h) and positive in June and August (Figs. 8e,k). The ACC values over Japan are positive in all the months in the SEM forecasts (Figs. 8c,f,i,l).

Fig. 8.
Fig. 8.

As in Fig. 5, but for the west region.

Citation: Weather and Forecasting 36, 1; 10.1175/WAF-D-20-0109.1

The above analysis indicates that the ENSMEAN forecasts have large biases in the prediction of the 850-hPa geopotential height anomalies. The SEM predictions, compared to ENSMEAN predictions, have less biases in the prediction of 850-hPa geopotential height anomalies thereby are better at predicting the SAT anomalies over the four regions in the months of May–August.

4. Conclusions

In this study, we investigated if the technique of SEM has any advantages over the ENSMEAN technique in the prediction of SAT anomalies over four regions of Japan: Hokkaido, north, central, and west (Fig. 1) in the months May–August. The predictions of the SINTEX-F2 seasonal forecasting model with 24 ensemble members for the period 1983–2018 are used in the study. The SINTEX-F2 members for the SEM are selected based on the ACC values computed between the GHCN-CAMS SAT estimates and the SINTEX-F2 predicted anomalies. After the selection of the members, the SEM predicted SAT anomalies are generated for the period 1983–2018. The SINTEX-F2 members used for the SEM are shown in Table 1. The understanding of physical processes responsible for the better performance of certain members over a particular region in a particular month is challenging, and we would be taking up such an exercise in future.

A detailed calculation of the HR and FAR for different ranges of positive and negative temperature anomalies showed the SEM technique to better predict the SAT anomalies compared to the ENSMEAN predicted SAT anomalies. The HR (FAR) of SEM forecast is higher (lower) compared to ENSMEAN over most temperature ranges (Fig. 4). The ACC values of the SEM are also higher compared to that of ENSMEAN in all the months of May–August and for all four study regions (Table 2). Analysis of the spatial distribution of the correlation between the GHCN-CAMS estimated surface temperature anomalies and the predicted 850-hPa geopotential height anomalies shows the ENSMEAN to have larger biases in forecasting the 850-hPa geopotential height anomalies compared to SEM, which could have led to the smaller ACC scores in ENSMEAN.

Even though there are many statistical methods to improve the mean surface air temperature forecasts, there are only a few techniques to improve the amplitude and sign of anomalies of seasonal forecasts (Feudale and Tompkins 2011; Ratnam et al. 2019a,b). Our study shows the SEM is a promising technique for improving the prediction of SAT anomalies over Japan.

The results of the study encourage us to further investigate the technique of SEM to improve regional predictions of temperature anomalies over other parts of the globe. The results are also useful for improving the predictions using dynamical downscaling. The SEM technique may be used as one of the techniques to generate optimum boundary conditions for the dynamical downscaling models to improve the regional predictions. We plan to carry out such studies in future. One of the caveats of the SEM technique is that it is highly dependent on the choice of the region and the members need to be selected for changes in the area of interest.

Acknowledgments

The research was partly supported by Japan Agency for Marine-Earth Science and Technology (JAMSTEC) under Project-B, an initiative to develop AI techniques for climate predictions. The authors thank the three anonymous reviewers for their insightful comments, which improved the manuscript substantially. The NOAA_OI_SST_V2, NCEP reanalysis, and GHCN-CAMS data were provided by NOAA/OAR/ESRL PSD, Boulder, Colorado, from their website at https://www.esrl.noaa.gov/psd/.

Data availability statement

Due to confidentiality agreements, supporting SINTEX-F2 model data can only be made available to bona fide researchers subject to a nondisclosure agreement. Details of the data and how to request access are available from the authors.

REFERENCES

  • Akihiko, T., Y. Morioka, and S. K. Behera, 2015: Role of climate variability in the heatstroke death rates of Kanto region in Japan. Sci. Rep., 4, 5655, https://doi.org/10.1038/srep05655.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Beck, H. E., N. E. Zimmermann, T. R. McVicar, N. Vergopolan, A. Berg, and E. F. Wood, 2018: Present and future Köppen-Geiger climatic classification maps at 1-km resolution. Sci. Data, 5, 180214, https://doi.org/10.1038/sdata.2018.214.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doi, T., S. K. Behera, and T. Yamagata, 2016: Improved seasonal prediction using the SINTEX-F2 coupled model. J. Adv. Model. Earth Syst., 8, 18471867, https://doi.org/10.1002/2016MS000744.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doi, T., A. Storto, S. K. Behera, A. Navarra, and T. Yamagata, 2017: Improved prediction of the Indian Ocean dipole mode by use of subsurface ocean observations. J. Climate, 30, 79537970, https://doi.org/10.1175/JCLI-D-16-0915.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Efron, B., and R. J. Tibshirani, 1994: An Introduction to the Bootstrap. Chapman and Hall, 456 pp.

    • Crossref
    • Export Citation
  • Fan, Y., and H. van den Dool, 2008: A global monthly land surface air-temperature analysis for 1948–present. J. Geophys. Res., 113, D01103, https://doi.org/10.1029/2007JD008470.

    • Search Google Scholar
    • Export Citation
  • Feudale, L., and A. M. Tompkins, 2011: A simple bias correction technique for modeled monsoon precipitation applied to West Africa. Geophys. Res. Lett., 38, L03803, https://doi.org/10.1029/2010GL045909.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jolliffe, I. T., and D. B. Stephenson, 2012: Forecast Verification: A Practioner’s Guide in Atmospheric Sciences. 2nd ed. Wiley, 292 pp.

    • Crossref
    • Export Citation
  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc., 77, 437471, https://doi.org/10.1175/1520-0477(1996)077<0437:TNYRP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Luo, J. J., S. Masson, S. Behera, S. Shingu, and T. Yamagata, 2005: Seasonal climate predictability in a coupled OAGCM using a different approach for ensemble forecasts. J. Climate, 18, 44744497, https://doi.org/10.1175/JCLI3526.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Madec, G., 2008: NEMO ocean engine, version 3.0. Note du Pôle de modélisation de l’Institut Pierre?Simon Laplace 27, 209 pp.

  • Mason, S. J., 2008: Understanding forecast verification statistics. Meteor. Appl., 15, 3140, https://doi.org/10.1002/met.51.

  • Mason, S. J., and N. E. Graham, 1999: Conditional probabilities, relative operating characteristics, and relative operating levels. Wea. Forecasting, 14, 713725, https://doi.org/10.1175/1520-0434(1999)014<0713:CPROCA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Masson, S., P. Terray, G. Madec, J. J. Luo, T. Yamagata, and K. Takahashi, 2012: Impact of intra-daily SST variability on ENSO characteristics in a coupled model. Climate Dyn., 39, 681707, https://doi.org/10.1007/s00382-011-1247-2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Miyakoda, K., J. Sirutis, and J. Ploshay, 1986: One-month forecast experiments—Without anomaly boundary forcings. Mon. Wea. Rev., 114, 23632401, https://doi.org/10.1175/1520-0493(1986)114<2363:OMFEAB>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nishimura, M., and M. Yamaguchi, 2015: Selective ensemble mean technique for tropical cyclone track predictions using multi-model ensemble. Trop. Cyclone Res. Rev., 4, 7178, https://doi.org/10.6057/2015TCRR02.03.

    • Search Google Scholar
    • Export Citation
  • Palmer, T. N., and D. L. T. Anderson, 1994: The prospects for seasonal forecasting—A review paper. Quart. J. Roy. Meteor. Soc., 120, 755793, https://doi.org/10.1002/QJ.49712051802.

    • Search Google Scholar
    • Export Citation
  • Peel, M. C., B. L. Finlayson, and T. A. Mcmahon, 2007: Updated world map of Köppen–Geiger climatic classification. Hydrol. Earth Syst. Sci., 11, 16331644, https://doi.org/10.5194/hess-11-1633-2007.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Qi, L., H. Yu, and P. Chen, 2014: Selective ensemble-mean technique for tropical cyclone track forecast by using ensemble prediction systems. Quart. J. Roy. Meteor. Soc., 140, 805813, https://doi.org/10.1002/qj.2196.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ratnam, J. V., T. Doi, and S. K. Behera, 2019a: Improving austral summer precipitation forecasts of SINTEX-F2 coupled ocean-atmosphere general circulation model over southern Africa by simple bias correction technique. Atmos. Sci. Lett., 20, 3885, https://doi.org/10.1002/asl.885.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ratnam, J. V., H. A. Dijkstra, T. Doi, Y. Morioka, M. Nonaka, and S. K. Behera, 2019b: Improving seasonal forecasts of air temperature using a genetic algorithm. Sci. Rep., 9, 12781, https://doi.org/10.1038/s41598-019-49281-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roeckner, E., and Coauthors, 2003: The atmospheric general circulation model ECHAM5. Part I: Model description. Max-Planck-Institut fur Meteorologie Rep. 349, 127 pp., http://www.mpimet.mpg.de/fileadmin/models/echam/mpi_report_349.pdf.

  • Sabeerali, C. T., A. Ramu Dandi, A. Dhakate, K. Salunke, S. Mahapatra, and S. A. Rao, 2013: Simulation of boreal summer intraseasonal oscillations in the latest CMIP5 coupled GCMs. J. Geophys. Res. Atmos., 118, 44014420, https://doi.org/10.1002/jgrd.50403.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sasaki, W., K. J. Richards, and J. J. Luo, 2012: Role of vertical mixing originating from small vertical scale structures above and within the equatorial thermocline in an OGCM. Ocean Modell., 57–58, 2942, https://doi.org/10.1016/j.ocemod.2012.09.002.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sasaki, W., K. J. Richards, and J. J. Luo, 2013: Impact of vertical mixing induced by small vertical scale structures above and within the equatorial thermocline on the tropical Pacific in a CGCM. Climate Dyn., 41, 443453, https://doi.org/10.1007/s00382-012-1593-8.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Scher, S., and G. Messori, 2019: Selective ensemble mean technique for severe European windstorms. Quart. J. Roy. Meteor. Soc., 145, 376385, https://doi.org/10.1002/QJ.3408.

    • Search Google Scholar
    • Export Citation
  • Valcke, S., A. Caubel, R. Vogelsang, and D. Declat, 2004: OASIS3 ocean atmosphere sea ice soil user’s guide. CERFACS Tech. Rep. TR/CMGC/04/68, 70 pp.

Save
  • Akihiko, T., Y. Morioka, and S. K. Behera, 2015: Role of climate variability in the heatstroke death rates of Kanto region in Japan. Sci. Rep., 4, 5655, https://doi.org/10.1038/srep05655.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Beck, H. E., N. E. Zimmermann, T. R. McVicar, N. Vergopolan, A. Berg, and E. F. Wood, 2018: Present and future Köppen-Geiger climatic classification maps at 1-km resolution. Sci. Data, 5, 180214, https://doi.org/10.1038/sdata.2018.214.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doi, T., S. K. Behera, and T. Yamagata, 2016: Improved seasonal prediction using the SINTEX-F2 coupled model. J. Adv. Model. Earth Syst., 8, 18471867, https://doi.org/10.1002/2016MS000744.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doi, T., A. Storto, S. K. Behera, A. Navarra, and T. Yamagata, 2017: Improved prediction of the Indian Ocean dipole mode by use of subsurface ocean observations. J. Climate, 30, 79537970, https://doi.org/10.1175/JCLI-D-16-0915.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Efron, B., and R. J. Tibshirani, 1994: An Introduction to the Bootstrap. Chapman and Hall, 456 pp.

    • Crossref
    • Export Citation
  • Fan, Y., and H. van den Dool, 2008: A global monthly land surface air-temperature analysis for 1948–present. J. Geophys. Res., 113, D01103, https://doi.org/10.1029/2007JD008470.

    • Search Google Scholar
    • Export Citation
  • Feudale, L., and A. M. Tompkins, 2011: A simple bias correction technique for modeled monsoon precipitation applied to West Africa. Geophys. Res. Lett., 38, L03803, https://doi.org/10.1029/2010GL045909.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jolliffe, I. T., and D. B. Stephenson, 2012: Forecast Verification: A Practioner’s Guide in Atmospheric Sciences. 2nd ed. Wiley, 292 pp.

    • Crossref
    • Export Citation
  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc., 77, 437471, https://doi.org/10.1175/1520-0477(1996)077<0437:TNYRP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Luo, J. J., S. Masson, S. Behera, S. Shingu, and T. Yamagata, 2005: Seasonal climate predictability in a coupled OAGCM using a different approach for ensemble forecasts. J. Climate, 18, 44744497, https://doi.org/10.1175/JCLI3526.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Madec, G., 2008: NEMO ocean engine, version 3.0. Note du Pôle de modélisation de l’Institut Pierre?Simon Laplace 27, 209 pp.

  • Mason, S. J., 2008: Understanding forecast verification statistics. Meteor. Appl., 15, 3140, https://doi.org/10.1002/met.51.

  • Mason, S. J., and N. E. Graham, 1999: Conditional probabilities, relative operating characteristics, and relative operating levels. Wea. Forecasting, 14, 713725, https://doi.org/10.1175/1520-0434(1999)014<0713:CPROCA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Masson, S., P. Terray, G. Madec, J. J. Luo, T. Yamagata, and K. Takahashi, 2012: Impact of intra-daily SST variability on ENSO characteristics in a coupled model. Climate Dyn., 39, 681707, https://doi.org/10.1007/s00382-011-1247-2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Miyakoda, K., J. Sirutis, and J. Ploshay, 1986: One-month forecast experiments—Without anomaly boundary forcings. Mon. Wea. Rev., 114, 23632401, https://doi.org/10.1175/1520-0493(1986)114<2363:OMFEAB>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nishimura, M., and M. Yamaguchi, 2015: Selective ensemble mean technique for tropical cyclone track predictions using multi-model ensemble. Trop. Cyclone Res. Rev., 4, 7178, https://doi.org/10.6057/2015TCRR02.03.

    • Search Google Scholar
    • Export Citation
  • Palmer, T. N., and D. L. T. Anderson, 1994: The prospects for seasonal forecasting—A review paper. Quart. J. Roy. Meteor. Soc., 120, 755793, https://doi.org/10.1002/QJ.49712051802.

    • Search Google Scholar
    • Export Citation
  • Peel, M. C., B. L. Finlayson, and T. A. Mcmahon, 2007: Updated world map of Köppen–Geiger climatic classification. Hydrol. Earth Syst. Sci., 11, 16331644, https://doi.org/10.5194/hess-11-1633-2007.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Qi, L., H. Yu, and P. Chen, 2014: Selective ensemble-mean technique for tropical cyclone track forecast by using ensemble prediction systems. Quart. J. Roy. Meteor. Soc., 140, 805813, https://doi.org/10.1002/qj.2196.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ratnam, J. V., T. Doi, and S. K. Behera, 2019a: Improving austral summer precipitation forecasts of SINTEX-F2 coupled ocean-atmosphere general circulation model over southern Africa by simple bias correction technique. Atmos. Sci. Lett., 20, 3885, https://doi.org/10.1002/asl.885.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ratnam, J. V., H. A. Dijkstra, T. Doi, Y. Morioka, M. Nonaka, and S. K. Behera, 2019b: Improving seasonal forecasts of air temperature using a genetic algorithm. Sci. Rep., 9, 12781, https://doi.org/10.1038/s41598-019-49281-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roeckner, E., and Coauthors, 2003: The atmospheric general circulation model ECHAM5. Part I: Model description. Max-Planck-Institut fur Meteorologie Rep. 349, 127 pp., http://www.mpimet.mpg.de/fileadmin/models/echam/mpi_report_349.pdf.

  • Sabeerali, C. T., A. Ramu Dandi, A. Dhakate, K. Salunke, S. Mahapatra, and S. A. Rao, 2013: Simulation of boreal summer intraseasonal oscillations in the latest CMIP5 coupled GCMs. J. Geophys. Res. Atmos., 118, 44014420, https://doi.org/10.1002/jgrd.50403.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sasaki, W., K. J. Richards, and J. J. Luo, 2012: Role of vertical mixing originating from small vertical scale structures above and within the equatorial thermocline in an OGCM. Ocean Modell., 57–58, 2942, https://doi.org/10.1016/j.ocemod.2012.09.002.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sasaki, W., K. J. Richards, and J. J. Luo, 2013: Impact of vertical mixing induced by small vertical scale structures above and within the equatorial thermocline on the tropical Pacific in a CGCM. Climate Dyn., 41, 443453, https://doi.org/10.1007/s00382-012-1593-8.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Scher, S., and G. Messori, 2019: Selective ensemble mean technique for severe European windstorms. Quart. J. Roy. Meteor. Soc., 145, 376385, https://doi.org/10.1002/QJ.3408.

    • Search Google Scholar
    • Export Citation
  • Valcke, S., A. Caubel, R. Vogelsang, and D. Declat, 2004: OASIS3 ocean atmosphere sea ice soil user’s guide. CERFACS Tech. Rep. TR/CMGC/04/68, 70 pp.

  • Fig. 1.

    The regions of study shown on the map of Japan as rectangular boxes.

  • Fig. 2.

    (a) Observed (black), ENSMEAN (orange), and SEM (blue) surface air temperature anomalies (°C) over Hokkaido in May of 1983–2018. (b)–(d) As in (a), but for the north, central, and west regions. (e)–(h) As in (a)–(d), but for the month of June.

  • Fig. 3.

    (a) Observed (black), ENSMEAN (orange), and SEM (blue) surface air temperature anomalies (°C) over Hokkaido in July of 1983–2018. (b)–(d) As in (a), but for the north, central, and west regions. (e)–(h) As in (a)–(d), but for August.

  • Fig. 4.

    (a) Hit rate vs false alarm rate plot of ENSMEAN (dashed lines) and SEM (solid lines) in May of positive temperature anomaly ranges over the four regions of Hokkaido, north, central, and west. The numbers correspond to the ranges of temperature anomalies as indicated at the top of each panel. (b)–(d) As in (a), but for the months June, July, and August, respectively. (e)–(h) As in (a)–(d), but for various ranges of negative temperature anomalies.

  • Fig. 5.

    (a)–(c) Spatial distribution of ACC values of correlation between the GHCN-CAMS estimated temperature anomalies in May over Hokkaido with the 850-hPa geopotential height (m) anomalies of (a) NCEP–NCAR reanalysis, (b) ENSMEAN, and (c) SEM. (d)–(f) As in (a)–(c), but for June; (g)–(i) as in (a)–(c), but for July; (j)–(l) as in (a)–(c), but for August. The hashed region is significant at 90% using Student’s two-tailed t test.

  • Fig. 6.

    As in Fig. 5, but for the north region.

  • Fig. 7.

    As in Fig. 5, but for the central region.

  • Fig. 8.

    As in Fig. 5, but for the west region.

All Time Past Year Past 30 Days
Abstract Views 197 0 0
Full Text Views 1441 1036 406
PDF Downloads 398 84 6