1. Introduction
The city of Olympia, which is the capital of Washington and is located at the southern end of Puget Sound about 100 km south of Seattle, is facing an increasing threat of sea level rise. There is disagreement about how quickly it will happen and how drastic it will be. Planning for a 15-cm rise is very different from planning for an 80-cm rise. It may take years to get approval for any adaptation effort, such as building a sea wall, and thus planning must start early (Craig 1993). We aim to provide tools to aid planning efforts by recognizing that point estimates of future sea level rise do not capture the full range of possible outcomes. As we will discuss, under different climate scenarios there are ranges of both timing and estimated sea level that will occur in Olympia with given confidence. Although the data used in our analysis are focused to a particular region of the United States, the same underlying strategy to identify confidence ranges around expected time frames and their associated sea level remains transferable as a sound tool for decision making. The financial impact of different scenarios of sea level rise can be assessed using the methods of Hallegatte et al. (2013), who estimate the vulnerability of a city by comparing its annual average loss from flooding with its annual gross domestic product. Using our approach, one can translate the distribution of projected sea level increase into a distribution of annual financial loss and hence of vulnerability, rather than focusing on averages. This approach can, in turn, be used to assess the likely effect of and need for investments in adaptation measures.
Systematic quantification of uncertainty gives policymakers a better idea of what to prepare for in the future (Reilly et al. 2001; Katz 2002; Stephenson et al. 2012). Instead of point estimates (often without uncertainty measures; e.g., Mote et al. 2008) for each scenario, we calculate simultaneous confidence sets of sea level projections. These are realistic benchmarks for when preventive measures need to be taken against the threat of sea level rise and how long one can afford to wait before taking action. For example, in an Olympia city report (Simpson 2011), various types of sea walls were proposed in response to different rises in mean sea level. To plan adequately for building these walls, our projections give policymakers a range of years for when they can expect certain levels of sea level rise. Building the sea walls in the earlier years of this range would be advisable, since the projections are intended to help the city avoid excessive flooding. Such flooding typically occurs at spring tide. In 1978 the city encountered a high tide of over 5.5 m (the mean sea level is 2.5 m), and the range of tides (from lowest low to highest high) can reach 6.8 m (see online at http://tidesandcurrents.noaa.gov/benchmarks/9446969.html). Thus, even a small increase in mean sea level is likely to change the characteristics of flooding, such as the design-life level (Rootzén and Katz 2013) of a sea wall.
2. Data
In our analysis we use 18 climate models from phase 5 of the Coupled Model Intercomparison Project (CMIP5; Taylor et al. 2012) that project global mean temperatures for each of the four representative concentration pathways (RCPs; Moss et al. 2010) used in the Fifth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC; Stocker et al. 2013) (at the time of writing, information on the climate models used could be found online at http://courses.washington.edu/statclim/GCMs_used.html). The projected global mean temperatures for each model in this ensemble are then used to project global sea level using a relationship [Eq. (1), below], fitted to historical data: the Goddard Institute for Space Studies global annual mean temperature series (Hansen et al. 2001) and global sea level data from the Commonwealth Scientific and Industrial Research Organisation (Church and White 2011). The former is computed from archives of land and sea air temperature measurements, and the latter is based on tide gauge readings using a spatial structure determined by satellite data. Using a long time series of annual tide gauge data for Seattle from the National Oceanic and Atmospheric Administration (Zervas 2009), we relate the global sea level to Seattle sea level, and, because Olympia does not have a long record of reliable sea level data, we use tide gauge calibration data (http://tidesandcurrents.noaa.gov/inventory.html?id=9446807) for Budd Inlet (the southern part of Puget Sound where Olympia is located) to relate Olympia to Seattle. [All data used are available (as links in the R software code file) at http://www.statmos.washington.edu/datacode.html.]
3. Methods
a. Predicting global mean sea level from global mean temperature





(a) Observed and fitted global sea level anomalies and (b) the corresponding residual plot. (c) Seattle sea level anomalies plotted against global sea level anomalies for 1899–2009 with fitted line and (d) its residual plot. (e) Budd Inlet sea level plotted against Seattle sea level for calibration data in 1996 with fitted line and (f) the residual plot. Note that the time scale for (f) is days rather than years.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1

(a) Observed and fitted global sea level anomalies and (b) the corresponding residual plot. (c) Seattle sea level anomalies plotted against global sea level anomalies for 1899–2009 with fitted line and (d) its residual plot. (e) Budd Inlet sea level plotted against Seattle sea level for calibration data in 1996 with fitted line and (f) the residual plot. Note that the time scale for (f) is days rather than years.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
(a) Observed and fitted global sea level anomalies and (b) the corresponding residual plot. (c) Seattle sea level anomalies plotted against global sea level anomalies for 1899–2009 with fitted line and (d) its residual plot. (e) Budd Inlet sea level plotted against Seattle sea level for calibration data in 1996 with fitted line and (f) the residual plot. Note that the time scale for (f) is days rather than years.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
b. Predicting Seattle sea level from global sea level




c. Predicting Olympia sea level from Seattle sea level




d. Propagation of variability
To project future sea levels in southern Puget Sound, we employ an ensemble of climate models from CMIP5 (Taylor et al. 2012). The climate model projections are used to get an idea of the variability due to model uncertainty. We then apply the fitted regression Eq. (1) to the temperature projections. Last, we use the joint distribution of the two downscaling estimates (to Seattle and to Olympia) and apply the downscaling Eqs. (2) and (3) to the estimated global sea level projections. When estimating confidence range, it is important to take all of the known uncertainties into account. Each prediction step above increases the uncertainty and widens the range. The final step is to use the work of Bolin and Lindgren (2014) to widen the pointwise intervals so as to make them simultaneous. This step enables us to produce valid projection intervals for the timing of a particular amount of sea level rise as well as estimating the probability of not exceeding a particular level before a given year. We use 90% confidence level to conform to the usage in the latest IPCC report (Stocker et al. 2013).
e. Simultaneous confidence regions





4. Results
Figure 2 shows a simultaneous 90% confidence region for the sea level projections and the projections based on each of the 18 climate models. There is considerable uncertainty (due to local and global statistical model fitting) beyond the ensemble variability. The pointwise confidence intervals (dashed purple lines) are only correct when looking at sea level at a given individual year, whereas the simultaneous confidence intervals (black lines) are valid for all years at the same time, giving policymakers the tools to make informed decisions on phenomena that may span multiple years without having to perform any additional calculations.

Olympia sea level projection simultaneous 90% confidence set (thick black lines) for the years 2000–2100 for four climate scenarios. The sea level data are shown in blue and end in 2009, and the average projections are the thick dark blue lines. The thin red lines are the projections without uncertainty that are based on each of the climate models. The dashed purple lines connect pointwise confidence intervals for each year.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1

Olympia sea level projection simultaneous 90% confidence set (thick black lines) for the years 2000–2100 for four climate scenarios. The sea level data are shown in blue and end in 2009, and the average projections are the thick dark blue lines. The thin red lines are the projections without uncertainty that are based on each of the climate models. The dashed purple lines connect pointwise confidence intervals for each year.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
Olympia sea level projection simultaneous 90% confidence set (thick black lines) for the years 2000–2100 for four climate scenarios. The sea level data are shown in blue and end in 2009, and the average projections are the thick dark blue lines. The thin red lines are the projections without uncertainty that are based on each of the climate models. The dashed purple lines connect pointwise confidence intervals for each year.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
Looking across the confidence set vertically at a given year (here 2075), we can visualize the additional contribution of each part of the chain of models to the overall uncertainty (Fig. 3). There is very little additional uncertainty added in going from Seattle to Olympia, and therefore the blue and purple lines are almost on top of each other.

2075 Olympia sea level projections with uncertainty due to different sources for four climate scenarios. The black line is the median projection (with no uncertainty), and the histogram corresponds to the spread of the climate models. The red curve adds the uncertainty due to the relation between global temperature and global sea level, the blue line adds the additional uncertainty due to downscaling global sea level to Seattle, and the purple line adds the additional uncertainty due to the projection of Budd Inlet (Olympia) sea level. The purple lines are on top of the blue lines almost everywhere.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1

2075 Olympia sea level projections with uncertainty due to different sources for four climate scenarios. The black line is the median projection (with no uncertainty), and the histogram corresponds to the spread of the climate models. The red curve adds the uncertainty due to the relation between global temperature and global sea level, the blue line adds the additional uncertainty due to downscaling global sea level to Seattle, and the purple line adds the additional uncertainty due to the projection of Budd Inlet (Olympia) sea level. The purple lines are on top of the blue lines almost everywhere.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
2075 Olympia sea level projections with uncertainty due to different sources for four climate scenarios. The black line is the median projection (with no uncertainty), and the histogram corresponds to the spread of the climate models. The red curve adds the uncertainty due to the relation between global temperature and global sea level, the blue line adds the additional uncertainty due to downscaling global sea level to Seattle, and the purple line adds the additional uncertainty due to the projection of Budd Inlet (Olympia) sea level. The purple lines are on top of the blue lines almost everywhere.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
Looking across the bands in the horizontal direction we obtain a 90% confidence interval for the time when Olympia may see a given level of sea level rise over the 1970–99 average sea level. As an example, Table 1 shows high and low estimates together with the mean first-occurrence year for each of the RCPs and two different levels. For example, a 50-cm rise is reached earlier under RCP 8.5 than for the other scenarios.
Projected 90% confidence intervals for reaching particular mean sea level rise in comparison with 1970–99 averages.


Figure 4 shows the probability of staying below a given level until a particular year. The probability of not exceeding 25 cm is hardly affected by the RCP used, whereas there are substantial differences between RCPs for staying below 50-cm sea level rise. The city planners in Olympia have agreed to plan for the high end (Mulkern 2013), which in our analysis would correspond to RCP 8.5. The price of building a sea wall needs to be weighed against the potential price of the cleanups due to the flooding that a 50-cm mean sea level rise (in conjunction with a storm surge, spring tide, and low pressure) could cause. Similar computations can easily be done for any sea level rise of interest.

Projected probability of Olympia sea level rise staying below a given level [(left) 25 cm; (right) 50 cm] for four climate scenarios. The abscissa corresponds to the quantity t in the header.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1

Projected probability of Olympia sea level rise staying below a given level [(left) 25 cm; (right) 50 cm] for four climate scenarios. The abscissa corresponds to the quantity t in the header.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
Projected probability of Olympia sea level rise staying below a given level [(left) 25 cm; (right) 50 cm] for four climate scenarios. The abscissa corresponds to the quantity t in the header.
Citation: Journal of Applied Meteorology and Climatology 53, 9; 10.1175/JAMC-D-13-0308.1
5. Discussion
The estimation of variability in the model projections using an ensemble may not be all that accurate, since climate models, particularly from the same modeling group, tend to be statistically dependent (Jun et al. 2008; Knutti et al. 2010). Furthermore, the selection of models submitted to CMIP5 is perhaps not representative of all modeling efforts. Both of these effects may lead to a biased estimate of the variability. Because there is no obvious approach that enables more accurate estimation of the model variability, we will just argue conditionally upon the projections.
In this work we use frequentist methods, but similar calculations can be done using Bayesian analyses. In either case, the approach uses a hierarchical model, which is the predominant statistical approach to analyze complicated systems (Katz et al. 2013). One could extend the uncertainty analysis by including historical climate simulations in the modeling of global sea level from global mean temperature as done in Bhat et al. (2011). To apply the method to other cities, one just needs to develop a model that relates global sea level to the particular local sea level (Tebaldi et al. 2012). This is easiest when tide data are available at the particular location but may need a spatiotemporal prediction model at locations at which no such data have been collected.
In this paper, we have used CMIP5 temperature projections together with a semiempirical model relating historical global mean sea level to global mean temperature. Our method can be applied to any projection of global mean sea level, such as a combination of steric sea level rise from climate models and glacial models driven by climate model temperature projections as used in Stocker et al. (2013); see also Moore et al. (2013) and Orlić and Pasarić (2013) for comparisons between semiempirical and process-based projections and Church et al. (2013) for an evaluation of process-based projections. The uncertainty analysis in the process-based case would require, at a minimum, a sensitivity analysis of the glacial models. The resolution of global models is insufficient to project local sea level rise, and we are not aware of any dynamic downscaling approaches for local sea levels. Hence, regardless of how global sea level is projected, a statistical approach to downscaling appears to be necessary.
Acknowledgments
We thank Claudia Tebaldi for proposing this project and helping us to get started. We acknowledge the World Climate Research Programme’s Working Group on Coupled Modelling for CMIP5 data. The project had partial support from the NSF Research Network on Statistics in the Atmosphere and Ocean Sciences (STATMOS) through Grant DMS-1106862 and by the Knut and Alice Wallenberg Foundation. The research was part of a class in statistical climatology at the University of Washington. Further material can be found at http://courses.washington.edu/statclim.
REFERENCES
Bhat, K., M. Haran, A. Terando, and K. Keller, 2011: Climate projections using Bayesian model averaging and space-time dependence. J. Agric. Biol. Environ. Stat., 16, 606–628, doi:10.1007/s13253-011-0069-3.
Bolin, D., 2012: Models and methods for random fields in spatial statistics with computational efficiency from Markov properties. Doctoral thesis, Lund University, 223 pp.
Bolin, D., and F. Lindgren, 2014: Excursion and contour uncertainty regions for latent Gaussian models. J. Roy. Stat. Soc., doi:10.1111/rssb.12055, in press.
Box, G., and G. Jenkins, 1970: Time Series Analysis: Forecasting and Control. Holden-Day, 553 pp.
Church, J. A., and N. J. White, 2011: Sea-level rise from the late 19th to the early 21st century. Surv. Geophys., 32, 585–602, doi:10.1007/s10712-011-9119-1.
Church, J. A., D. Monselesan, J. M. Gregory, and B. Marzelon, 2013: Evaluating the ability of process based models to project sea-level change. Environ. Res. Lett., 8, 014051, doi:10.1088/1748-9326/8/1/014051.
Craig, D. P., 1993: Preliminary assessment of sea level rise in Olympia, Washington: Technical and policy implications. City of Olympia Policy and Program Development Division, Olympia Public Works Department Tech. Rep., 52 pp.
Guttorp, P., and Coauthors, 2014: Statistical prediction of global sea level from global temperature. Stat. Sin., doi:10.5705/ss.2013.222w, in press.
Hallegatte, S., C. Green, R. Nicholls, and J. Corfee-Morlot, 2013: Future flood losses in major coastal cities. Nat. Climate Change, 3, 802–806, doi:10.1038/nclimate1979.
Hansen, J., R. Rued, M. Sato, M. Imhoff, W. Lawrence, D. Easterling, T. Peterson, and T. Karl, 2001: A closer look at United States and global surface temperature change. J. Geophys. Res., 106, 23 947–23 963, doi:10.1029/2001JD000354.
Hyndman, R. J., G. Athanasopoulos, S. Razbash, D. Schmidt, Z. Zhou, Y. Khan, and C. Bergmeir, 2013: Forecast: Forecasting functions for time series and linear models, version 4.06. R package. [Available online at http://CRAN.R-project.org/package=forecast.]
Jun, M., R. Knutti, and D. Nychka, 2008: Spatial analysis to quantify numerical model bias and dependence: How many climate models are there? J. Amer. Stat. Assoc., 103, 934–947, doi:10.1198/016214507000001265.
Katz, R. W., 2002: Techniques for estimating uncertainty in climate change scenarios and impact studies. Climate Res., 20, 167–185, doi:10.3354/cr020167.
Katz, R. W., P. Craigmile, P. Guttorp, M. Haran, B. Sansó, and M. Stein, 2013: Uncertainty analysis in climate change assessments. Nature Climate Change, 3, 769–771, doi:10.1038/nclimate1980.
Knutti, R., G. Abramowitz, M. Collins, V. Eyring, P. J. Gleckler, B. Hewitson, and L. Mearns, 2010: Good practice guidance paper on assessing and combining multi model climate projections. Intergovernmental Panel on Climate Change Expert Meeting on Assessing and Combining Multi Model Climate Projections Meeting Rep., T. Stocker et al., Eds., 15 pp. [Available online at https://www.ipcc-wg1.unibe.ch/guidancepaper/IPCC_EM_MME_GoodPracticeGuidancePaper.pdf.]
Moore, J. C., A. Grinsted, T. Zwinger, and S. Jevrejeva, 2013: Semiempirical and process-based global sea level projections. Rev. Geophys., 51, 484–522, doi:10.1002/rog.20015.
Moss, R. H., and Coauthors, 2010: The next generation of scenarios for climate change research and assessment. Nature, 463, 747–756, doi:10.1038/nature08823.
Mote, P., A. Petersen, S. Reeder, H. Shipman, and L. W. Binder, 2008: Sea level rise in the coastal waters of Washington State. University of Washington Climate Impacts Group Tech. Rep., 11 pp. [Available online at http://www.cses.washington.edu/db/pdf/moteetalslr579.pdf.]
Mulkern, A., cited 2013: ADAPTATION: Scenic city debates erecting barriers as sea levels rise. E&E Publishing. [Available online at http://www.eenews.net/stories/1059968975.]
NRC, 2012: Sea-Level Rise for the Coasts of California, Oregon, and Washington: Past, Present, and Future. The National Academies Press, 202 pp. [Available online at http://www.nap.edu/openbook.php?record_id=13389.]
Orlić, M., and Z. Pasarić, 2013: Semi-empirical versus process-based sea-level projections for the twenty-first century. Nature Climate Change, 3, 735–738, doi:10.1038/nclimate1877.
Rahmstorf, S., 2007: A semi-empirical approach to projecting future sea-level rise. Science, 315, 368–370, doi:10.1126/science.1135456.
R Core Team, 2012: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, 1731 pp. [Available online at http://www.lsw.uni-heidelberg.de/users/christlieb/teaching/UKStaSS10/R-refman.pdf.]
Reilly, J., P. Stone, C. Forest, H. Jacoby, and R. Prinn, 2001: Uncertainty and climate change assessments. Science, 293, 430–433, doi:10.1126/science.1062001.
Rootzén, H., and R. Katz, 2013: Design life level: Quantifying risk in a changing climate. Water Resour. Res., 49, 5964–5972, doi:10.1002/wrcr.20425.
Simpson, D. P., 2011: City of Olympia engineered response to sea level rise. City of Olympia Public Works Dept. Tech Rep., 112 pp. [Available online at http://olympiawa.gov/community/sustainability/~/media/Files/PublicWorks/Sustainability/Sea%20Level%20Rise%20Response%20Technical%20Report.ashx.]
Stephenson, D., M. Collins, J. Rougier, and R. Chandler, 2012: Statistical problems in the probabilistic prediction of climate change. Environmetrics, 23, 364–372, doi:10.1002/env.2153.
Stocker, T., and Coauthors, 2013: Climate Change 2013: The Physical Science Basis. Cambridge University Press, 1535 pp. [Available online at http://www.climatechange2013.org/images/report/WG1AR5_ALL_FINAL.pdf.]
Taylor, K., R. Stouffer, and G. Meehl, 2012: An overview of CMIP5 and the experiment design. Bull. Amer. Meteor. Soc., 93, 485–498, doi:10.1175/BAMS-D-11-00094.1.
Tebaldi, C., B. H. Strauss, and C. E. Zervas, 2012: Modelling sea level rise impacts on storm surges along US coasts. Environ. Res. Lett., 7, 014032, doi:10.1088/1748-9326/7/1/014032.
Vermeer, M., and S. Rahmstorf, 2009: Global sea level linked to global temperature. Proc. Natl. Acad. Sci. USA, 106, 21 527–21 532, doi:10.1073/pnas.0907765106.
Zervas, C., 2009: Sea level variations of the United States 1854-2006. NOAA Tech. Rep. NOS CO-OPS 053, 194 pp. [Available online at http://tidesandcurrents.noaa.gov/publications/Tech_rpt_53.pdf.]