1. Introduction
Earth's surface has experienced unprecedented warming since the Industrial Revolution began in the 1850s. The global mean surface air temperature over land rose 0.76°C during 1901–2006 (Solomon et al. 2007). This global warming has been neither spatially uniform nor persistent in time. The warming is faster in the high latitudes than in the tropics and greater in winter than summer, largely due to snowmelt–albedo feedbacks (Holland and Bitz 2003). It is also widely reported that the nighttime temperature rose more than the daytime temperature because of cloud cover and other feedback processes (Karl et al. 1993). Furthermore, high mountain regions warmed more than low-lying regions (Liu and Chen 2000).
On regional scales, temperature changes often deviate from the above discussed general warming patterns. There are some special geographical regions where a lack of warming or even a cooling has occurred. The central and southeastern United States (CSE) actually cooled in the twentieth century, most notably during the second half of the century, while global mean temperature warmed at an increasing rate. The cooling or lack of warming regions is referred to as “warming holes” (WHs) (Pan et al. 2004; Kunkel et al. 2006). Attention has been paid to this abnormal cooling trend both observationally and in modeling (Tett et al. 2002; Portmann et al. 2009; Meehl et al. 2012). Kalnay and Cai (2003) have attributed this cooling trend to land surface processes by reconciling the temperature difference between upper-air and surface observations. Combining observations with a regional climate model's results, Pan et al. (2004) suggested that regional hydrological processes coupled with the low-level jet contribute to the cooling. Other studies have attributed the cooling to the internal dynamics (Kunkel et al. 2006; Liang et al. 2006; Weaver 2013). A number of modeling studies have attributed the mechanisms for this abnormal trend to large-scale decadal oscillations such as the Pacific decadal oscillation (PDO) and the Atlantic multidecadal oscillation (AMO) (Robinson et al. 2002; Kunkel et al. 2006; Wang et al. 2009; Meehl et al. 2012).
While seeking reasons why only this part of the United States experienced cooling, Pan et al. (2009) found other similar WHs: one in south-central China and the other in central South America. Some features common to these WHs are their presence 1) on the eastern slope of major mountain ranges where the climatic warming gradient exists, 2) at low-level jet termini where warm moist air converges, and 3) in intense agricultural regions where the deep crop roots can extract soil moisture.
The midcontinental cooling goes against the common belief that the middle of continents, far from oceans, should warm faster than coastal regions. Also, it was a challenge for the great majority of models in phase 3 of the Coupled Model Intercomparison Project (CMIP3) to reproduce the WHs (Kunkel et al. 2006). It is of interest to see how well phase 5 of the Coupled Model Intercomparison Project (CMIP5; Taylor et al. 2012) models reproduce WHs in the twentieth-century simulations as well as how they predict the WH fate in the twenty-first century. The purposes of this paper are to 1) see how well CMIP5 models reproduce this abnormal cooling, 2) find the common features of models that simulated WHs well (or not), and 3) determine what mechanisms are responsible for the WHs as simulated in the new generation of the atmosphere–ocean coupled general circulation models (AOGCMs). A companion paper (Kumar et al. 2013a) investigates east–west gradient and multidecadal aspects of the WH trends in North America as in Meehl et al. (2012). More general results regarding North American climate in the CMIP5 models are reported in Sheffield et al. (2013a,b).
2. Model and data
The design of CMIP5 includes the new short-term decadal experiments hindcasting the interannual variability, emission-driven (versus concentration driven) earth system model (ESM) simulations exploring the sensitivity of the carbon cycle feedback, and time-evolving land use runs allowing for the dynamic vegetation feedback (Taylor et al. 2012). The core long-term CMIP5 simulations include historical and projection experiments. The historical experiments include all-forcing (historical), greenhouse gas (GHG) forcing only (historicalGHG), natural forcing only (historicalNat), and other specific forcing (such as aerosols). The projection experiments consist of four new representative concentration pathway (RCP) emission scenarios, RCP2.6 through RCP8.5, representing anthropogenic radiative forcing stabilizing at 2.6–8.5 W m−2 by 2100 (Moss et al. 2010). In this study, we focus on the all-forcing historical and RCP4.5 experiments, with limited exploration of the historicalGHG and historicalNat (natural forcing, such as volcanic eruption, only) runs. The historical runs are forced by observed atmospheric composition changes (reflecting both anthropogenic and natural sources). The historicalGHG and historicalNat runs are the same as the historical run except that they are forced by greenhouse gases alone or natural variability alone. The temporal span of the historical experiment covers 1850–2005, and thus is sometimes referred to as “20th century” simulations (Taylor et al. 2012). The RCP4.5 scenario assumes that anthropogenic forcing will essentially level off at 4.5 W m−2 around the mid-twenty-first century and represents the intermediate range of the four scenarios. RCP4.5 runs cover 2005–2100 (some model groups extend it to 2300; see Thomson et al. 2011 for details).
In this study, we analyze all model ensemble members presently available in the historical and RCP4.5 experiments, totaling 28 models and 175 members. The historical experiment has 25 models available with 100 members and the RCP4.5 experiment encompasses 22 models with 63 members. The historicalNat and historicalGHG runs each have six single-member simulations. Fifteen out of 25 models in the historical experiment and 8 out of 22 models in the RCP4.5 experiment have multiple ensemble members of 2–16 (Table 1). Monthly mean of daily maximum and minimum surface temperatures1 from all models were mapped to a 1° × 1° grid, the highest resolution of the models. The linear trends are computed based on a least squares regression. The horizontal resolution of the models ranges from 3.75° to 1.0°.
Characteristics of models participated in the historical and RCP4.5 experiments. Listed are 25 models in the historical experiment and 22 models in the RCP4.5 experiment. The first number in the first column before the slash is the model ID in the historical experiment and the second is the corresponding ensemble member ID.


The observed daily temperatures used in this study were obtained from the Global Historical Climatology Network (GHCN) as compiled into monthly means and interpolated onto regular latitude/longitude grids by the Climate Research Unit (CRU). The dataset includes monthly mean surface daily maximum and minimum temperatures on a 0.5° × 0.5° latitude–longitude grid over land for the period 1901–2009 (New et al. 2000; Vose et al. 2005). Since data stations before the 1950s were somewhat sparse (see New et al. 2000 for details), our analyses mainly focus on the temperature changes after the 1950s, although prior temperatures are also used to determine longer-term trends.
3. Observed cooling characteristics
Since temperature variations are not monotonic but rather fluctuate, the trend values will depend on the evaluation periods. While longer periods can give larger sample sizes, they may obscure underlying physical processes during different periods. For example, the second half of the twentieth century, an often-used period of recent studies (Wang et al. 2009), includes a period of global slight cooling before 1975 and a strong warming period after that. To reduce the effect of arbitrarily choosing the lengths of periods, we evaluated trends in three durations: 100 (1901–2000), 50 (1951–2000), and 25 yr (1951–75 and 1976–2000). The 100-yr duration represents the longest available dataset and the 50-yr period corresponds to the data-rich period. The separation of the second half of the century into two equal 25-yr periods is not chosen for simplicity, but is based on following considerations: 1) The year 1976 is around the turning point of two climate epochs when the PDO shifted from a negative to a positive phase (Miller et al. 1994); 2) the global temperature trend changed from a slight decrease to a strong increase around 1975 (Folland et al. 2002); and 3) the year 1979 was the beginning of the satellite era when the incorporation of satellite data introduces some discontinuity in datasets (Kalnay and Cai 2003).
During the twentieth century, the southeastern (SE) and central (CN) United States cooled up to 2°C (0.2°C decade−1), while most regions of the United States warmed slightly (Fig. 1). On the half-century scale (1951–2000), the cooling along the southeast coast is more scattered, while summer cooling expanded in the central United States. On the quarter-century scale (1976–2000), the summer WH became more concentrated in the central United States with a cooling rate of over 0.6°C decade−1. It should be pointed out that this decrease of up to 1.5°C for the 25-yr period (0.6°C decade−1 for 2.5 decades) occurred when the global warming peaked. Almost all the global warming in the twentieth century occurred in this period (Solomon et al. 2007). Compared to summer when the WH and global temperature trends went in opposite directions, the winter temperature in the whole eastern United States warmed by more than 3°C during the period, reflecting the sharp difference in forcing mechanisms between summer and winter temperatures.

Linear trends of observed mean surface air temperature on (top)–(bottom) 100-, 50-, and 25-yr scales during periods of the twentieth century for (left) summer and (right) winter. The southeastern and central U.S. experienced cooling, while the globe experienced unprecedented warming.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Linear trends of observed mean surface air temperature on (top)–(bottom) 100-, 50-, and 25-yr scales during periods of the twentieth century for (left) summer and (right) winter. The southeastern and central U.S. experienced cooling, while the globe experienced unprecedented warming.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Linear trends of observed mean surface air temperature on (top)–(bottom) 100-, 50-, and 25-yr scales during periods of the twentieth century for (left) summer and (right) winter. The southeastern and central U.S. experienced cooling, while the globe experienced unprecedented warming.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Figure 2 shows the daily maximum temperature (Tmax) trends in the second half of the twentieth century corresponding, respectively, to the global cooling (1951–75) and warming (1976–2000) periods. During 1951–75, when global mean temperature actually decreased slightly, the southeast coastal region experienced sharp cooling of over 0.6°C decade−1 along a wide swath in summer (Fig. 2, top left). The Tmax trend pattern in 1976–2000 was similar to that of the Tmean (mean of Tmax and Tmin in Fig. 1). Interestingly from 1951 to 1975, when the PDO index was negative (Mantua et al. 1997), the SE coastal region experienced sharp cooling, which seems to run against the established negative correlation between PDO and coastal temperature. During the last 25 years (1976–2000), which coincides with the peak global warming period, the cooling shifted to the central section of the United States with cooling up to 0.6°C decade−1. Also during the 1976–2000 period, the summer and winter trends are in opposite directions, with sharp warming in winter (see Fig. 1). The empirical orthogonal function (EOF) analysis of the 50-yr (1951–2000) period shows two leading modes corresponding to the southeast (first) and central (second) cooling, explaining more than 50% combined variance (Fig. 2, bottom; see also Pan et al. 2009). The time series of the principal components (PCs) corresponding to the two EOF showed that PC1 was large (positive) in the 1970s–1980s while PC2 decreased from positive in 1950s and negative in early 1980s before returning to positive in late 1990s (not shown).

(a) Linear trends of observed Tmax during two periods between 1951–2000. The red rectangles represent the (left) SE and (right) CN warming holes (WHs), respectively. The SE WH covers 30°–40°N, 105°–80°W while the CN WH covers 38°–48°N, 105°–90°W. (bottom) The leading two EOF patterns of Tmax during the whole 1951–2000 period.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

(a) Linear trends of observed Tmax during two periods between 1951–2000. The red rectangles represent the (left) SE and (right) CN warming holes (WHs), respectively. The SE WH covers 30°–40°N, 105°–80°W while the CN WH covers 38°–48°N, 105°–90°W. (bottom) The leading two EOF patterns of Tmax during the whole 1951–2000 period.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
(a) Linear trends of observed Tmax during two periods between 1951–2000. The red rectangles represent the (left) SE and (right) CN warming holes (WHs), respectively. The SE WH covers 30°–40°N, 105°–80°W while the CN WH covers 38°–48°N, 105°–90°W. (bottom) The leading two EOF patterns of Tmax during the whole 1951–2000 period.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
One of global climate change signals is the widespread decline of daily temperature range (DTR). This is true especially in winter starting from the 1950s and is the result of more rapid nocturnal warming than daytime warming (Karl et al. 1993; Dai et al. 1999; Vose et al. 2005). Global annual Tmin over land increased 0.20°C decade−1 while Tmax increased 0.14°C decade−1 from 1950 to 2004, resulting in a DTR decrease (−0.07°C decade−1; Vose et al. 2005). During the same period over North American land (15°–75°N, 175°–60°W), summer Tmax and Tmin increased by 0.07 and 0.12°C decade−1, respectively, resulting in −0.05°C decade−1 in DTR change. A similar decrease (−0.06°C decade−1) occurred in winter. Over the central and southeast United States (30°–45°N, 105°–80°W), summer Tmax actually decreased sharply (−0.13°C decade−1), while Tmin increased slightly (0.05°C decade−1), yielding a DTR decrease of 0.18°C decade−1. Winter DTR also decreased by 0.13°C decade−1.
Figure 3 shows the time series of surface temperature over CN and SE regions delineated in Fig. 2. The U.S. temperature (both CN and SE) of the twentieth century is characterized by the hot Dust Bowl period in 1930s when the Southern Plains experienced extreme droughts and thus dusty soil for eight years (Schubert et al. 2004), followed by slight cooling until the mid-1970s, and fast warming after that. This overall pattern is similar to the global mean, but with large fluctuations. Separating temperatures into summer and winter as well as Tmax and Tmin shows that the U.S. temperatures deviate from the global ones notably. In terms of summer daytime Tmax, the 1930s is still over 1°C warmer than other decades, including the globally warmest 2010s. On the other hand, winter Tmin was greatest in the later 1990s and early 2000s. Globally, the temporal variations of Tmax and Tmin during winter and summer follow similar patterns (dotted blue lines), while those of the U.S. (both CN and SE) deviate from each other notably. Winter Tmin trends follow the global mean quite well (lower right panel, Fig. 3). However, the Tmax trends deviate from the global mean (top left). During 1985–95, when global warming was quite fast, the U.S. Tmax decreased sharply, indicative of the complex forcing in daytime during summer.

Time series of surface (left) Tmax and (right) Tmin for (top) winter and (bottom) summer in the CN and SE WH regions as compared with the global land means. The CN and SE regions are identified in Fig. 2. The global means are over land only. Values plotted are the anomalies from the 109-yr (1901–2009) mean. The cosine of latitude is used in space weighted averaging.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Time series of surface (left) Tmax and (right) Tmin for (top) winter and (bottom) summer in the CN and SE WH regions as compared with the global land means. The CN and SE regions are identified in Fig. 2. The global means are over land only. Values plotted are the anomalies from the 109-yr (1901–2009) mean. The cosine of latitude is used in space weighted averaging.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Time series of surface (left) Tmax and (right) Tmin for (top) winter and (bottom) summer in the CN and SE WH regions as compared with the global land means. The CN and SE regions are identified in Fig. 2. The global means are over land only. Values plotted are the anomalies from the 109-yr (1901–2009) mean. The cosine of latitude is used in space weighted averaging.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
4. CMIP5 model-simulated twentieth-century cooling—Historical experiment
Here we present the model simulated temperature variations from 100 members of 25 models in the historical experiment. In this section, presentation is based on individual members (not model based), meaning that ensemble means are contributed by each member equally. This way we can avoid the mutual cancellation of temperature variations among ensemble members within a model.
a. Model ensemble means
On the 100-yr scale, the 100-member mean seems to mimic the pattern of the SE cooling by showing slightly less warming than surroundings in winter (top panels, Fig. 4). The region warms by <0.1°C decade−1, which is less than the warming in the rest of country. The presence of a WH is less evident in summer than winter. On the 50-yr scale (1951–2000), the models showed no cooling during summer in the central and southeast United States (middle panels). The winter pattern shows a clear north–south (N–S) warming gradient as observed. On the quarter-century scale (1976–2000), the models simulated more extensive warming in both summer and winter (bottom panels). The trend variance among the 100 members generally follows the trend magnitude itself (contours in Fig. 4). Larger variance tends to coincide with larger warming or cooling values themselves and vice versa. This seems to suggest that the weak warming or slight cooling over WH region is unlikely due to the cancellations of strong warming and cooling among the members, offering some confidence in the simulations.

Twenty-five-model mean (100 members) of linear trends (°C decade−1) of mean surface air temperature on (top) 100-, (middle) 50-, and (bottom) 25-yr time scales of the twentieth century for (left) summer and (right) winter. Each model equally contributes to the ensemble mean regardless of whether it has multiple or single ensemble members. The contours are the variance (°C decade−1) among all the model ensemble members. The H and L denote the high and low centers of the variance, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Twenty-five-model mean (100 members) of linear trends (°C decade−1) of mean surface air temperature on (top) 100-, (middle) 50-, and (bottom) 25-yr time scales of the twentieth century for (left) summer and (right) winter. Each model equally contributes to the ensemble mean regardless of whether it has multiple or single ensemble members. The contours are the variance (°C decade−1) among all the model ensemble members. The H and L denote the high and low centers of the variance, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Twenty-five-model mean (100 members) of linear trends (°C decade−1) of mean surface air temperature on (top) 100-, (middle) 50-, and (bottom) 25-yr time scales of the twentieth century for (left) summer and (right) winter. Each model equally contributes to the ensemble mean regardless of whether it has multiple or single ensemble members. The contours are the variance (°C decade−1) among all the model ensemble members. The H and L denote the high and low centers of the variance, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
b. Intermodel variability
The model ensemble mean represents all individual members that simulated diverse temperature patterns. As an example, Fig. 5 depicts the 25 individual Tmax trend during the 50-yr period (1951–2000) simulated by the first ensemble member of each model. About half of the models simulated a variant of the WH pattern (less warming) although simulated WH locations vary across models. For example, CanESM2 shows a cooling trend in the central United States, consistent with the observation, whereas GISS-E2-H model simulates a cooling trend in the western United States (expansions of all model names can be found in Table 1). A couple of models (e.g., HadGEM3-AO and IPSL-CM5A-LR) show an excessive warming maximum around the observed WH region. As expected, within individual model families, the trend patterns are more similar. For example, the HadGEM2 family consisting of three models-versions (-AO, -CC, and -ES) generally simulated mid-Atlantic warming and Pacific Northwest cooling. The only exception to the model family similarity is GFDL-ESM2 (-G and -M), whose two versions simulated opposite trends in the southeastern coastal region.

Linear trends of summer Tmax (°C decade−1) simulated by the first member of the 25 models listed at the top of each panel during 1951–2000. For those models with multiple members, the panel is the first member (r1i1p1) of the model.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Linear trends of summer Tmax (°C decade−1) simulated by the first member of the 25 models listed at the top of each panel during 1951–2000. For those models with multiple members, the panel is the first member (r1i1p1) of the model.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Linear trends of summer Tmax (°C decade−1) simulated by the first member of the 25 models listed at the top of each panel during 1951–2000. For those models with multiple members, the panel is the first member (r1i1p1) of the model.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
To quantify the model skill in reproducing the WH phenomena, Fig. 6 shows the trends of 25 models' first ensemble member in summer and winter for Tmax and Tmin averaged over the SE WH region. On the century scale in summer (top left panel), the observed cooling only occurred in Tmax (rightmost red bar denoted by an O on the x axis). Eight out of 25 models simulated negative trends ranging from 0.005° to 0.06°C decade−1 in summer. The remaining models simulated warming trends from 0.001° to 0.20°C decade−1. The all-model mean is +0.06°C decade−1. The observed winter temperatures in the SE WH region warmed during the century by 0.01°–0.02°C decade−1 (top right panel). The model means simulated slightly stronger warming (0.03°–0.04°C decade−1) although a number of models simulated larger positive and negative trends.

Trends of Tmax and Tmin (°C) over the southeast WH in (left) summer and (right) winter during (top) 1901–2000 and (bottom) 1951–2000 periods. The model names and expansions are listed in Table 1. The rightmost dual-bars represents the all-model mean (M) and observations (O), respectively. Only the first member of each model is used.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Trends of Tmax and Tmin (°C) over the southeast WH in (left) summer and (right) winter during (top) 1901–2000 and (bottom) 1951–2000 periods. The model names and expansions are listed in Table 1. The rightmost dual-bars represents the all-model mean (M) and observations (O), respectively. Only the first member of each model is used.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Trends of Tmax and Tmin (°C) over the southeast WH in (left) summer and (right) winter during (top) 1901–2000 and (bottom) 1951–2000 periods. The model names and expansions are listed in Table 1. The rightmost dual-bars represents the all-model mean (M) and observations (O), respectively. Only the first member of each model is used.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
On the 50-yr scale (bottom panels), the observed cooling on Tmax reached −0.17°C decade−1 in summer. The majority of models simulated warming on both Tmax (and Tmin) with an all-model mean of +0.13°C decade−1 (marked by an M on the x axis). Only six models produced negative trends of Tmax (bottom left). In winter, eight models simulated sizeable negative trends of temperatures.
The intermodel variability is further quantified using a box-and-whisker plot (Fig. 7). All the model medians are positive for both periods in winter and summer. Note that Tmax is slightly more dispersed than Tmin, especially on the 100-yr scale in summer. On the 100-yr scale, the summer middle 50 percentile spans about 0.04°C decade−1 for Tmin and 0.08°C decade−1 for Tmax. On the 50-yr scale, middle half summer Tmax warming is around 50% more dispersed than Tmin. The skews are generally small.

Box-and-whisker plots of 100-member simulated SE WH (left) maximum and (right) minimum temperature trends (°C) in summer and winter during the whole (100 yr) and half (50 yr) of the twentieth century (x axis): 1901–2000 summer 100yS (blue) and winter 100yW (red); and 1951–2000 summer 50yS (green) and winter 50yW (orange). Vertical bars represent the first, second (median), and third quantiles, respectively. The vertical extremes represent maximum and minimum values.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Box-and-whisker plots of 100-member simulated SE WH (left) maximum and (right) minimum temperature trends (°C) in summer and winter during the whole (100 yr) and half (50 yr) of the twentieth century (x axis): 1901–2000 summer 100yS (blue) and winter 100yW (red); and 1951–2000 summer 50yS (green) and winter 50yW (orange). Vertical bars represent the first, second (median), and third quantiles, respectively. The vertical extremes represent maximum and minimum values.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Box-and-whisker plots of 100-member simulated SE WH (left) maximum and (right) minimum temperature trends (°C) in summer and winter during the whole (100 yr) and half (50 yr) of the twentieth century (x axis): 1901–2000 summer 100yS (blue) and winter 100yW (red); and 1951–2000 summer 50yS (green) and winter 50yW (orange). Vertical bars represent the first, second (median), and third quantiles, respectively. The vertical extremes represent maximum and minimum values.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
c. Contrast between the best and worst ensemble members


List of top quartile of ensemble member performance and their member ID (mID) ranked according to the SE WH Tmax trend bias that is alternatively measured by the trend (TR; °C decade−1), U.S. Tmax pattern correlation (ρ), WH Tmax temporal correlation (r), PDO region temperature (r_PDO), and AMO region temperature (r_AMO). Bias is directly measured by member trend itself (see text for explanation). The bolded numbers (0, 4, 29, and 88) appear in all three left mID columns, meaning that they ranked among the top quartile measured by all the three metrics. The observed TR is −0.17°C decade−1, which is between the first two TR values, which are in italic.






Figure 8 contrasts model skills between the top and bottom quartiles of 100 members based on the three metrics defined in (1)–(3). As expected, the best-bias (b or TR) members collectively simulated a well-defined cooling region in the south-central United States, matching observed WHs quite well (Fig. 8a). The worst-TR 25 members, however, simulated a clear warming in the region. While the sharp parity in bias performance between the two quartiles is somewhat expected, this demonstrates that quite a portion of members can reproduce the WH phenomenon, which at least allows for the opportunity to diagnose what caused the two quartiles to differ. The best temporal correlation (r) members did not reproduce the resemblance of the observed WH (Fig. 8b), indicating the secondary role of r in simulating the WH. On the other hand, the best spatial correlation (ρ) members produced well the southeast WH relative cooling (i.e., lack of warming, Fig. 8c), suggesting that capturing the correct ρ is the key for the WH simulation.

Mean linear trends of Tmax (°C) among the (left) best and (right) worst quartile members during 1951–2000 period sorted by (a) bias b, (b) temporal correction r, and (c) spatial correlation ρ as defined in (1)–(3).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Mean linear trends of Tmax (°C) among the (left) best and (right) worst quartile members during 1951–2000 period sorted by (a) bias b, (b) temporal correction r, and (c) spatial correlation ρ as defined in (1)–(3).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Mean linear trends of Tmax (°C) among the (left) best and (right) worst quartile members during 1951–2000 period sorted by (a) bias b, (b) temporal correction r, and (c) spatial correlation ρ as defined in (1)–(3).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
It could be argued that it should be apparent that ρ is more important than r in determining the WH pattern, so we also compared its relative role in determining the temporal variations of WH temperature. Figure 9 contrasts the best and worst model performance measured by r. The shaded area represents the spread (maximum minus minimum) of the top 25 best-r members and the eight lines are the best eight members. [We chose eight best (worst) members mainly for plot clarity.] The members captured the temporal variation of the WH Tmax very well, especially during the latter half of the twentieth century, as indicated by both the shading envelope and eight-member means (thick solid red line in Fig. 9a). On the other hand, the 25 worst-r members simulated decadal variations that are largely out of phase with the observations (Fig. 9b). The eight best-TR members simulated mainly smoothed decadal variations with a gentle cooling during the second half of the twentieth century (Fig. 9c). Finally, the eight best-ρ members captured the decadal trend and sharp cooling in the 1950–60s reasonably well (Fig. 9d).

Time series of SE WH maximum surface temperature during summer. (a) Best and (b) worst members measured by temporal correlation. Eight best members based on (c) bias and (d) on spatial correlation. Shading in (a) and (b) indicates the spread of the best and worst 25 members, respectively. The model mean is the average over the eight members.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Time series of SE WH maximum surface temperature during summer. (a) Best and (b) worst members measured by temporal correlation. Eight best members based on (c) bias and (d) on spatial correlation. Shading in (a) and (b) indicates the spread of the best and worst 25 members, respectively. The model mean is the average over the eight members.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Time series of SE WH maximum surface temperature during summer. (a) Best and (b) worst members measured by temporal correlation. Eight best members based on (c) bias and (d) on spatial correlation. Shading in (a) and (b) indicates the spread of the best and worst 25 members, respectively. The model mean is the average over the eight members.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Table 2 ranks the top quartile members sorted by various metrics. The first three paired columns are sorted by the SE WH temperature trend (bias), U.S. temperature trend pattern correlation (ρ), and the WH temperature temporal correlation (r), respectively. The last two paired columns are ranked by temporal correlations of observed and modeled temperature over the PDO (20°–70°N, 110°E–80°W) and AMO (0°–60°N, 60°–10°W) regions, r_PDO and r_AMO, respectively. The following can be seen from Table 2:
Among the first three paired columns (TR, ρ, and r) that directly measure temperature simulation skill in or around the WH region, only four members (0, 4, 29, and 88) made all the three top-25 lists and the orders of the first three columns bear little resemblance, implying that the ensemble members hardly get all three metrics in a consistent manner. They may simulate one metric well, but for incorrect reasons. For example, correct bias or TR (i.e., cooling trend) might be caused by a model's cold bias globally.
The temporal correlation varies from 0.82 to 0.53 among the 25 members, higher than the spatial correlation (0.59–0.24), suggesting that the models captured the temporal variation better.
Model members simulated temperature PDO (AMO) regions quite well with temporal correlation of 0.87–0.67 (0.82–0.67). However, member ID rank lists of PDO and AMO temperature bear no resemblance to the other three columns, indicative of disconnection between WH temperature and PDO/AMO temperature in these coupled CMIP5 models. This is in disagreement with some uncoupled modeling studies that show strong association between WH temperatures and the PDO index (Robinson et al. 2002; Wang et al. 2009).
To further partition error characteristics, we quantify the top and bottom quartile members' performance collectively. Table 3 lists the mean of the three metrics averaged over the best and worst 25 members of various sorting categories. The lists also include temperatures over the PDO and AMO regions ranking. Each row represents a sorting according to a parameter and columns are the average of the top and bottom quartile members. For example, sorted by TR (first two rows), the average spatial correlation of the top and bottom 25 models are +0.19 and −0.13, respectively, while the temporal correlation values just differ slightly (0.42 vs 0.31), indicating that the separation of the best and worst members measured by trend bias is more caused by spatial than temporal correlations. Similarly, if sorted by the spatial correlation (third and fourth rows), the bias difference between the top and bottom quintiles is still large, but the temporal correlation has no difference. Finally, if sorted by temporal correlation, the separation in bias is smaller while the spatial correlation is essentially the same. This leads us to believe that 1) the spatial and temporal correlations do not collaborate well in the models and 2) temporal variation, compared to spatial, is less important in contributing to the model bias. To further substantiate this, we also computed temperature over the PDO and AMO regions and their temporal correlation with observed ones. The PDO–AMO sorting does separate the spatial correlation somewhat, but they reverse parity of the temporal correlations (r).
Contrast of various metrics between means of the top and bottom quartile members in the first and second row for a given entry, respectively. The ranking and thus quartiles are sorted by individual metrics; TR is WH Tmax trend, ρ is U.S. Tmax spatial correlation, and r is WH Tmax temporal correlation; r_PDO and r_AMO are temporal correlations of PDO and AMO temperatures, respectively. See text for details.


d. Intramodel variability—Internal dynamics
This subsection will compare results within individual models that have multiple member realizations. Since the model's integration physics (and numerics) and external forcing remain the same, different initial conditions only represent internal variability or model noise. In the CMIP5 experimental design, individual members are named rNiMpL where the triad (N, M, and L) denotes ways in which each initial condition is formed: N denotes different starting times from the same realistic time series; M, the initializing method; and L, the way of physical perturbation. All models but two have only varying N (i.e., changing only in starting times). GISS-E2-H and GISS-E2-R runs have members with two ways of varying initial conditions (N and L). Figure 10 shows the Tmax trends during 1951–2000 simulated by all 15 ensemble members in GISS-E2-H. The three panels in a given row (e.g., r1i1p1-p3 on the top row) represent same initial time and initializing method, but with three different physical perturbations. Similarly, the five rows represent different initial times. The 15 members vary significantly, but some patterns are still identifiable. The physical perturbation method has larger impacts than the starting time.2 The middle column (L = 2) tends to have sharp cooling comparable to the observed WH extent, but located too far west as compared with the observations. On the other hand, in the right column strong warming occurred over the observed cooling region. The box-and-whisker plots demonstrate that the intramodel variability of GISS-E2-H (along with the other five models that have the largest ensemble members) is similar to that of the 100 members, but with less spread (not shown).

Linear trends of summer Tmax (°C decade−1) simulated by the 15 individual members of the GISS-E2-H models listed during 1951–2000. The triad of integers in ensemble member (each panel) name rNiMpL (N, M, and L) denote initial time, initiation method, and perturbation physics, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Linear trends of summer Tmax (°C decade−1) simulated by the 15 individual members of the GISS-E2-H models listed during 1951–2000. The triad of integers in ensemble member (each panel) name rNiMpL (N, M, and L) denote initial time, initiation method, and perturbation physics, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Linear trends of summer Tmax (°C decade−1) simulated by the 15 individual members of the GISS-E2-H models listed during 1951–2000. The triad of integers in ensemble member (each panel) name rNiMpL (N, M, and L) denote initial time, initiation method, and perturbation physics, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
e. External forcing
Globally, it is very likely that the climatic warming observed over the past decades is attributable to human influences, primarily to an increase in concentrations of well-mixed greenhouse gases (Meehl et al. 2004; Solomon et al. 2007). The anthropogenic signal was detected in each of 14 regions of the globe except for one in central North America, although the results were more uncertain when anthropogenic and natural signals were considered together (Taylor et al. 2012). To attribute observed climate change to particular causes, it is essential to perform simulations of the historical period with only a subset of known forcing.
Like in CMIP3, CMIP5 designed the so-called attribution and detection experiments consisting of historicalNat and historicalGHG, among others. The historical (all forcing) runs presented so far impose changing conditions (consistent with observations), which include atmospheric composition (including CO2), due to both anthropogenic and volcanic influences, solar forcing, emissions or concentrations of short-lived species and natural and anthropogenic aerosols or their precursors, and land use change (Taylor et al. 2012). The natural forcing only experiment imposes natural variations (e.g., volcanoes and solar variability) evolving as in the historical run. Correspondingly, the GHG forcing only experiment includes greenhouse gas forcing alone evolving as in the historical run.
Whether the abnormal cooling in the central and southeastern United States is caused by internal variability of the climate system or forced by external forcing is a long-standing issue (Wang et al. 2009; Meehl et al. 2012). If the cooling is transient internal, the WH regions would become warmer when the transient masking mechanism is gone in the future and the WH regions will “catch up” the missed warming (Kunkel et al. 2006). If, on the other hand, they are a response to the global warming forced by an external forcing, they will likely continue to exist in the future. Several studies suggest the WHs are related to the PDO and AMO indices, an internal variation of the atmosphere–ocean coupled system (Kunkel et al. 2006; Wang et al. 2009; Meehl et al. 2012). Others suggest that land surface processes and regional hydrological processes contribute to the cooling (Kalnay and Cai, 2003; Pan et al. 2004; Liang et al. 2006). Here we analyze the CMIP5 attribution experiments that include historicalNat and historicalGHG experiments.
Fewer models carried out these attribution experiments with fewer ensemble members compared with the historical and RCP4.5 runs. We evaluated six models with a single member (r1i1p1): CCSM4, GFDL-ESM2M, GISS-E2-H, GISS-E2-R, MRI-CGCM3, and NorESM1-M. Figures 11a and 11b show that on the century scale, natural forcing has a cooling effect only in the central and northern United States in summer. The position matches quite well the observed CN WH. In the second half of the twentieth century, the northern tier of the United States cooled considerably. Conversely, GHG forcing only would make the central United States warmer, particularly during the latter half of the century in summer (Figs. 11c,d). This suggests that GHGs would counteract the WH, rather than causing or enhancing it. The forcing difference between the historical and historicalNat should reflect land use evolution, among other factors such as aerosols. Interestingly, the difference showed a clear WH feature, especially in summer (Figs. 11e,f). On the century scale, a large area of 0°–0.05°C decade−1 cooling over the southeastern-central United States resembles the observed central WH very well. On the 50-yr scale, the cooling extent retreated to the southeast coast. The larger cooling difference between the two experiments in the whole twentieth century, rather than the latter half-century, perhaps reflects that major land use change in the region occurred during the earlier decades of the twentieth century (Kumar et al. 2013b). The larger impacts in summer rather than winter (not show) may be due to the larger roles that land surface processes play in the warm season due to greater evapotranspiration than in winter. If this is the case, the summer WH in the central and southeastern United States in the twentieth century is at least influenced by local/regional land surface processes, consistent with previous studies (Kalnay and Cai 2003; Pan et al. 2004; Liang et al. 2006), disregarding forcing from other factors such as aerosols (Leibensperger et al. 2011).

Six-model ensemble mean of linear trends of summer Tmean (°C decade−1) during (left) 1901–2000 and (right) 1951–2000 simulated in the (a),(b) historicalNat and (c),(d) historicaGHG experiments; and (e),(f) the difference between the historical and historicalNat experiments.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Six-model ensemble mean of linear trends of summer Tmean (°C decade−1) during (left) 1901–2000 and (right) 1951–2000 simulated in the (a),(b) historicalNat and (c),(d) historicaGHG experiments; and (e),(f) the difference between the historical and historicalNat experiments.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Six-model ensemble mean of linear trends of summer Tmean (°C decade−1) during (left) 1901–2000 and (right) 1951–2000 simulated in the (a),(b) historicalNat and (c),(d) historicaGHG experiments; and (e),(f) the difference between the historical and historicalNat experiments.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Figure 12 compares trends under different scenarios over different periods and seasons. The GHG forcing only has strong warming effects (0.12°–0.22°C decade−1) that may have partly compensated for cooling effects from the natural forcing in the all-forcing historical experiment. The historical experiment that incorporates both natural and anthropogenic forcing resulted in moderate warming as seen in the historical experiment.

Comparison of Tmean trends (°C decade−1) in the SE WH under different scenarios for different durations in summer and winter.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Comparison of Tmean trends (°C decade−1) in the SE WH under different scenarios for different durations in summer and winter.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Comparison of Tmean trends (°C decade−1) in the SE WH under different scenarios for different durations in summer and winter.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
5. Fate of warming holes in the twenty-first century as simulated in RCP4.5
This section discusses the RCP4.5 simulations from 22 models with 63 ensemble members. These 22 models include all the historical models except for FGOALS-S2.0, GFDL-CM3, GFDL-ESM2G, GISS-E2-H, HadCM3, and MPI-ESM-P. The list also includes BNU-ESM, INM-CM4, and IPSL-CM5B-LR that did not appear in historical run, each of which has one member (Volodin et al. 2010). One-third (8) of the models had multiple members, ranging from 3 to 15 (Table 1). For simplicity, in this section the analysis is based on individual models (not members), meaning that each model contributes equally to the ensemble mean. Figure 13 shows the model ensemble mean of the projected Tmean over the first half of the twenty-first century (2006–55). During summer, the northern section of the United States warmed more than both lower and higher latitudes. The largest warming is located in the Great Lakes across to the mountain region where Tmean would warm by 0.4–0.5°C decade−1. In winter, the strongest warming is over the northern United States all the way to the north with a magnitude of more than 0.5°C decade−1. This warming pattern both in winter and summer is very similar to the simulated trend distributions for 1976–2000 (Fig. 4), the peak global warming period of the twentieth century.

Linear trend of daily Tmean (°C decade−1) during 2006–55 averaged among 22 models with 63 members in the RCP4.5 experiment for (left) June–August and (right) December–February. The contours are the intermodel spread (°C decade−1). The H and L denote the high and low centers of the spread, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Linear trend of daily Tmean (°C decade−1) during 2006–55 averaged among 22 models with 63 members in the RCP4.5 experiment for (left) June–August and (right) December–February. The contours are the intermodel spread (°C decade−1). The H and L denote the high and low centers of the spread, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Linear trend of daily Tmean (°C decade−1) during 2006–55 averaged among 22 models with 63 members in the RCP4.5 experiment for (left) June–August and (right) December–February. The contours are the intermodel spread (°C decade−1). The H and L denote the high and low centers of the spread, respectively.
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
If we view intermodel variance as a measure of the uncertainty in the projection, generally the areas of large uncertainty tend to coincide with large trends themselves. Perhaps the ratio of trend to intermodel variance would be a better measure of model uncertainty. The highest ratios (or confidence) are over high latitudes in winter with large trends and slightly large spread (right panel) and the lowest confidences in summer over the U.S.–Mexico border are likely related to the complex topography in the region.
The warming is faster during the first half of the twenty-first century and then slows down after about the 2050s (not shown), consistent with the leveling off of the atmospheric CO2 concentration under the RCP4.5 scenario. The diminishing warming and even cooling during the latter periods of the twenty-first century suggest the likely return of the WH, considering the models' underestimation of WHs in the twentieth century in the historical simulation. However, given the large intermodel variability and models' limited capability in reproducing the observed WH in the twentieth-century simulations, cautions are warranted in interpreting the fate of WH in the twenty-first century.
During the first 50 years of the twenty-first century, the model ensemble mean showed a 0.3°–0.4°C decade−1 warming over SE region, ranging from −0.01° to 0.9°C decade−1 (Fig. 14); Tmax and Tmin warm at a similar rate, which differs from the twentieth-century simulations where Tmax rose slower than Tmin (Fig. 6). In fact, the summer Tmax rises faster than Tmin, a phenomenon rarely observed.

Twenty-two model projected SE WH temperature trends during 2006–55 for (top) winter and (bottom) summer. The rightmost bars are the model mean. The x axis is model ID that is numbered in accordance with the alphabetically ordered model names (from Table 1).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1

Twenty-two model projected SE WH temperature trends during 2006–55 for (top) winter and (bottom) summer. The rightmost bars are the model mean. The x axis is model ID that is numbered in accordance with the alphabetically ordered model names (from Table 1).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
Twenty-two model projected SE WH temperature trends during 2006–55 for (top) winter and (bottom) summer. The rightmost bars are the model mean. The x axis is model ID that is numbered in accordance with the alphabetically ordered model names (from Table 1).
Citation: Journal of Climate 26, 17; 10.1175/JCLI-D-12-00559.1
6. Conclusions and discussion
A total of 175 ensemble members of long-term simulations from 28 AOGCMs available in the historical suite and RCP4.5 experiments are analyzed to examine the models' skill in reproducing the twentieth-century observed U.S. temperature trends. The focus is on the southeast and central regions where abnormal cooling occurred despite the fact that global warming accelerated during the twentieth century. To the author's knowledge, this work is one of the studies that analyzed the largest number of AOGCM members to evaluate the collective skills of the climate models. Unlike most climate studies with this kind of model evaluation, we evaluated maximum and minimum surface air temperatures (Tmax and Tmin) separately rather than the mean of the two, although observational studies often separate the two temperatures. Surface temperature is affected by many factors, some of which affect Tmax and Tmin more symmetrically than others (Durre and Wallace 2001; Zhou et al. 2007). For example, longwave radiation tends to affect equally Tmax and Tmin, whereas evapotranspiration and sensible heat flux mainly affect Tmax (Dai et al. 1999; Zhou et al. 2007). With the separation, more detailed physical and dynamical processes can be revealed. We did not examine these forcing contrasts between Tmax and Tmin because of the unavailability of those data associated with these processes.
We evaluated model skills in three periods, 1901–2000, 1951–2000, and 1976–2000, corresponding to the whole twentieth century, the data-rich period, and the peak global warming period, respectively. The 100-ensemble-member mean in the historical experiment hardly shows regional cooling in the central and southeast United States for any of the three periods. Focusing on Tmax over the southeast United States in summer during 1951–2000, 19 out of 100 members did simulate a negative trend (cooling), with 99 members underpredicting the cooling amplitude. If measured by one of the three metrics (bias, spatial correlation, and temporal correlation), at least the top quartile of the 100 ensemble members were able to capture reasonably well the anomalous cooling trends in the southeastern United States. For example, the top quartile based on bias sorting or spatial correlation sorting can reproduce a warming hole–like feature quite well. The two rank lists, however, consist of almost two entirely different sets of member sets. In fact, there are only four members fall into all the three top-quartile lists sorted by bias, spatial pattern correlation, and temporal correlation, respectively. This seems to imply that a model's high skill in one metric is not achieved in a consistent manner. For example, a smaller bias in cooling is not due to the model's better performance in capturing spatial pattern or temporal variation. In other words, a single correct metric could be achieved for wrong reasons. For instance, one member simulates cooling rate better than others in the warming hole region might be due to its global cooling bias (less warming) rather than to its correct simulation of regional temporal correlation or spatial pattern. Thus it would be preferable to have multiple metrics in measuring model performance even though one deals with a cooling trend in a specific region such as the warming hole (WH) area.
The model members had more difficulty in producing the spatial trend pattern than (decadal) temporal variations, as indicated by larger parity in the former among the top and bottom quartile members measured by bias and by higher temporal correlation than spatial one. The model members simulated decadal variation represented by temperature in PDO and AMO regions quite well with the best temporal correlation higher than 0.87 despite the fact that only a small portion of members (19/100) simulated trend sign correctly in the southeast region. This disconnection between the WH region temperature and PDO–AMO region temperature in the coupled AOGCMs differs from some uncoupled modeling studies (Robinson et al. 2002; Wang et al. 2009) that showed strong correlation between the U.S. warming hole and PDO index. Further studies are needed to reconcile the difference, particularly for individual models in these studies.
Whether the abnormal cooling is due to the atmospheric internal variability or external forcing is the focus of a number of studies (Robinson et al. 2002; Wang et al. 2009; Meehl et al. 2012). The historical suite experiments in CMIP5 consisting of all forcing (historical), GHG forcing only (historicalGHG), and natural forcing only (historicalNat) runs provide an opportunity to look into this issue. The GHG forcing has a warming effect in the central United States, implying that the WH is not due to the GHG forcing. The difference between the all forcing and natural forcing only runs showed a well-defined cooling region resembling the WH location, implying that local and regional surface processes may contribute to the WH. The fate of central and southeast WHs would likely depend on the relative magnitudes of GHG forcing that contributes to warming and the natural forcing that contributes to cooling. If the GHG forcing is strong enough, the WHs will likely disappear in the future.
Acknowledgments
We acknowledge the modeling groups, the Program for Climate Model Diagnosis and Intercomparison (PCMDI), and the WCRP's Working Group on Coupled Modelling (WGCM) for their roles in making available the WCRP CMIP5 multimodel dataset. Support of this dataset is provided by the Office of Science, U.S. Department of Energy. The U.S. authors acknowledge the support of NOAA Climate Program Office “Modeling, Analysis, Predictions and Projections” (MAPP Grant NA11OAR4310094) Program as part of the CMIP5 Task Force. This research is also supported partly by the CAS/SAFEA International Partnership Program for Creative Research Teams (KZZD-EW-TZ-03) and WKC foundation. We are thankful to two anonymous reviewers for their constructive and insightful suggestions. We are thankful to the two anonymous reviewers whose constructive comments strengthened this paper.
REFERENCES
Arora, V. K., and Coauthors, 2011: Carbon emission limits required to satisfy future representative concentration pathways of greenhouse gases. Geophys. Res. Lett., 38, L05805, doi:10.1029/2010GL046270.
Collins, M., S. F. B. Tett, and C. Cooper, 2001: The internal climate variability of HadCM3, a version of the Hadley Centre coupled model without flux adjustments. Climate Dyn., 17, 61–81.
Dai, A., K. E. Trenberth, and T. R. Karl, 1999: Effects of clouds, soil moisture, precipitation, and water vapor on diurnal temperature range. J. Climate, 12, 2451–2473.
Donner, L. J., and Coauthors, 2011: The dynamical core, physical parameterizations, and basic simulation characteristics of the atmospheric component AM3 of the GFDL global coupled model CM3. J. Climate, 24, 3484–3519.
Dunne, J. P., and Coauthors, 2012: GFDL's ESM2 global coupled climate–carbon earth system models. Part I: Physical formulation and baseline simulation characteristics. J. Climate, 25, 6646–6665.
Durre, I., and J. M. Wallace, 2001: Factors influencing the cold-season diurnal temperature range in the United States. J. Climate, 14, 3263–3278.
Folland, C. K., and Coauthors, 2002: Observed climate variability and change. Climate Change 2001: The Scientific Basis, J. T. Houghton et al., Eds., Cambridge University Press, 99–181.
Gent, P. R., and Coauthors, 2011: The Community Climate System Model version 4. J. Climate, 24, 4973–4991.
Holland, M. M., and C. M. Bitz, 2003: Polar amplification of climate change in coupled models. Climate Dyn., 21, 221–232.
Hourdin, F., and Coauthors, 2006: The LMDZ4 general circulation model: Climate performance and sensitivity to parametrized physics with emphasis on tropical convection. Climate Dyn.,27, 787–813.
Jones, C. D., and Coauthors, 2011: The HadGEM2-ES implementation of CMIP5 centennial simulations. Geosci. Model Dev., 4, 543–570, doi:10.5194/gmd-4-543-2011.
Kalnay, E., and M. Cai, 2003: Impact of urbanization and land-use change on climate. Nature, 423, 528–531.
Karl, T. R., and Coauthors, 1993: A new perspective on recent global warming: Asymmetric trends of daily maximum and minimum temperature. Bull. Amer. Meteor. Soc., 74, 1007–1024.
Kumar, S., J. L. Kinter III, P. A. Dirmeyer, Z. Pan, and J. Adams, 2013a: Multi-decadal climate variability and the “warming hole” in North America: Results from CMIP5 twentieth- and twenty-first-century climate simulations. J. Climate,26, 3511–3527.
Kumar, S., V. Merwade, S. Rao, B. C. Pijanowski, 2013b: Characterizing long-term land use/cover change in the United States from 1850 to 2000 using a nonlinear bi-analytical model. Ambio,42, 285–297, doi:10.1007/s13280-012-0354-6.
Kunkel, K. E., X.-Z. Liang, J. Zhu, and Y. Lin, 2006: Can CGCMs simulate the twentieth century “warming hole” in the central United States. J. Climate, 19, 4137–4153.
Leibensperger, E. M., and Coauthors, 2011: Climatic effects of 1950–2050 changes in US anthropogenic aerosols—Part 1: Aerosol trends and radiative forcing. Atmos. Chem. Phys. Discuss., 11, 24 085–24 125, doi:10.5194/acpd-11-24085-2011.
Liang, X.-Z., J. Pan, J. Zhu, K. E. Kunkel, J. X. L. Wang, and A. Dai, 2006: Regional climate model downscaling of the U.S. summer climate and future change. J. Geophys. Res., 111, D10108, doi:10.1029/2005JD006685.
Liu, X. D., and B. D. Chen, 2000: Climatic warming in the Tibetan Plateau during recent decades. Int. J. Climatol., 20, 1729–1742.
Mantua, N. J., S. R. Hare, Y. Zhang, J. M. Wallace, and R. C. Francis, 1997: A Pacific interdecadal climate oscillation with impacts on salmon production. Bull. Amer. Meteor. Soc., 78, 1069–1079.
Meehl, G. A., W. M. Washington, C. M. Ammann, J. M. Arblaster, T. M. L. Wigley, and C. Tebaldi, 2004: Combinations of natural and anthropogenic forcings in twentieth-century climate. J. Climate, 17, 3721–3727.
Meehl, G. A., J. M. Arblaster, and G. Branstator, 2012: Mechanisms contributing to the warming hole and the consequent U.S. east–west differential of heat extremes. J. Climate, 25, 6394–6408.
Miller, A., D. Cayan, T. Barnett, N. Graham, and J. Oberhuber, 1994: The 1976–77 climate shift of the Pacific Ocean. Oceanography, 7, 21–26.
Moss, R. H., and Coauthors, 2010: The next generation of scenarios for climate change research and assessment. Nature, 463, 747–756, doi:10.1038/nature08823.
New, M. G., M. Hulme, and P. D. Jones, 2000: Representing twentieth-century space–time climate variability. Part II: Development of 1901–96 monthly grids of terrestrial surface climate. J. Climate, 13, 2217–2238.
Pan, Z., R. W. Arritt, E. S. Takle, W. J. Gutowski Jr., C. J. Anderson, and M. Segal, 2004: Altered hydrologic feedback in a warming climate introduces a “warming hole.” Geophys. Res. Lett., 31, L17109, doi:10.1029/2004GL020528.
Pan, Z., M. Segal, X.-Z. Li, and B. Zib, 2009: Global climate change impact on the Midwestern U.S.—A summer cooling trend. Regional Climate Variability, Predictability, and Change in Midwestern USA, S. Pryor, Ed., Indiana University Press, 29–41.
Portmann, R. W., S. Solomon, and G. C. Hegel, 2009: Spatial and seasonal patterns in climate change, temperatures, and precipitation across the United States. Proc. Natl. Acad. Sci. USA, 106, 7324–7329.
Raddatz, T. J., and Coauthors, 2007: Will the tropical land biosphere dominate the climate–carbon cycle feedback during the twenty first century? Climate Dyn., 29, 565–574, doi:10.1007/s00382-007-0247-8.
Robinson, W. A., R. Reudy, and J. E. Hansen, 2002: General circulation model simulations of recent cooling in the east-central United States. J. Geophys. Res., 107, 4748, doi:10.1029/2001JD001577.
Rotstayn, L., M. Collier, M. Dix, Y. Feng, H. Gordon, S. O'Farrell, I. Smith, and J. Syktus, 2010: Improved simulation of Australian climate and ENSO-related climate variability in a GCM with an interactive aerosol treatment. Int. J. Climatol.,30, 1067–1088, doi:10.1002/joc.1952.
Schmidt, G. A., and Coauthors, 2006: Present day atmospheric simulations using GISS ModelE: Comparison to in situ, satellite and reanalysis data. J. Climate, 19, 153–192.
Schubert, S. D., M. J. Suarez, P. J. Region, R. D. Koster, and J. T. Bacmeister, 2004: On the cause of the 1930s Dust Bowl. Science, 303, 1855–1859.
Sheffield, J., and Coauthors, 2013a: North American climate in CMIP5 experiments. Part I: Evaluation of 20th century continental and regional climatology. J. Climate, in press.
Sheffield, J., and Coauthors, 2013b: North American climate in CMIP5 experiments. Part II: Evaluation of 20th century intra-seasonal to decadal variability. J. Climate, in press.
Solomon, S., D. Qin, M. Manning, M. Marquis, K. Averyt, M. M. B. Tignor, H. L. Miller Jr., and Z. Chen, Eds., 2007: Climate Change 2007: The Physical Science Basis. Cambridge University Press, 996 pp.
Taylor, K. E., R. J. Stouffer, and G. A. Meehl, 2012: An overview of CMIP5 and the experiment design. Bull. Amer. Meteor. Soc., 93, 485–498.
Tett, S. F. B., and Coauthors, 2002: Estimation of natural and anthropogenic contributions to twentieth century temperature change. J. Geophys. Res., 107 (D16), doi:10.1029/2000JD000028.
Thomson, A., and Coauthors, 2011: RCP4.5: A pathway for stabilization of radiative forcing by 2100. Climatic Change, 109, 77–94, doi:10.1007/s10584-011-0151-4.
Voldoire, A., and Coauthors, 2013: The CNRM-CM5.1 global climate model: Description and basic evaluation. Climate Dyn., 40, 2091–2121, doi:10.1007/s00382-011-1259-y.
Volodin, E. M., N. A. Dianskii, and A. V. Gusev, 2010: Simulating present-day climate with the INMCM4.0 coupled model of the atmospheric and oceanic general circulations. Atmos. Oceanic Phys., 46, 414–431.
Vose, R. S., D. R. Easterling, and B. Gleason, 2005: Maximum and minimum temperature trends for the globe: An update through 2004. Geophys. Res. Lett., 32, L23822, doi:10.1029/2005GL024379.
Wang, H., S. Schubert, M. Suarez, J. Chen, M. Hoerling, A. Kumar, and P. Pegion, 2009: Attribution of the seasonality and regionality in climate trends over the United States during 1950–2000. J. Climate, 22, 2571–2590.
Watanabe, M., and Coauthors, 2010: Improved climate simulation by MIROC5: Mean states, variability, and climate sensitivity. J. Climate, 23, 6312–6335.
Weaver, S. J., 2013: Factors associated with decadal variability in Great Plains summertime surface temperatures. J. Climate, 26, 343–350.
Wu, T., and Coauthors, 2010: The Beijing Climate Center atmospheric general circulation model: Description and its performance for the present-day climate. Climate Dyn., 34, 123–147.
Yukimoto, S., and Coauthors, 2011: Meteorological Research Institute-Earth System Model version 1 (MRI-ESM1)—Model description. Meteorological Research Institute Tech. Rep. 64, 83 pp. [Available online at www.mri-jma.go.jp/Publish/Technical/DATA/VOL_64/index_en.html.]
Zhou, L., R. E. Dickinson, Y. Tian, R. Vose, and Y. Dai, 2007: Impact of vegetation removal and soil aridation on diurnal temperature range in a semiarid region—Application to the Sahel. Proc. Natl. Acad. Sci. USA, 104, 17 937–17 942.
Zhou, T. J., and Coauthors, 2005: The climate system model FGOALS using LASG/IAP spectral AGCM SAMIL as its atmospheric component (in Chinese). Acta Meteor. Sin., 63, 702–715.
Most studies of GCM intercomparison use mean surface air temperature, masking the difference in maximum and minimum temperatures.
The extent of the member spread may have been underestimated in CMIP5 experiments since the great majority of the models used varying start time only, not the perturbation method.