1. Introduction
Multivariate linear theory has been used to great success in practically all realms of climate science. One widely applied linear method is the linear inverse model (LIM) (Penland and Sardeshmukh 1995) framework, in which a linear approximation to a system dynamics is empirically obtained from the system’s covariance statistics. In this framework, a linearly stable system describing the evolution of “slow” variable anomalies (e.g., sea surface temperatures anomalies) is driven by Gaussian white noise representing the effect of unresolved “fast” variability (e.g., wind stress, convection) on the slow variable (Papanicolaou and Kohler 1974; Penland 1996). It is a common practice to restrict the noise forcing the LIM to be state independent (additive), and while often providing valuable results, it is not required by these kinds of systems. This kind of model has been used successfully as a forecast tool (Newman 2013) and performs well when the underlying slow deterministic dynamics is linear or weakly nonlinear.
Despite the qualitative (and often quantitative) success of linear inverse models, these kinds of models are unable in general to reproduce observed deviations from Gaussianity, when driven by additive Gaussian white noise. These deviations from Gaussianity are typified for example in skewed (asymmetric) or kurtotic (lighter- or heavier-than-Gaussian distribution tails) probability density functions (PDFs). Deviations from Gaussianity in geophysical variables’ distributions are commonplace and well documented (e.g., Monahan 2004; Neelin et al. 2010; Ruff and Neelin 2012; Stefanova et al. 2013; Loikith et al. 2013; Perron and Sura 2013; Cavanaugh and Shen 2014; Huybers et al. 2014; Loikith and Neelin 2015; Sardeshmukh et al. 2015) and can be generated through multiple dynamical processes. Perhaps the most intuitive of these mechanisms is through nonlinearity in the deterministic dynamics, with the models of Timmermann et al. (2001), Kravtsov et al. (2005), Kondrashov et al. (2006), and Chen et al. (2016) (among others) providing examples in the inverse modeling setting. Simple advective–diffusive prototypes for passive tracers under a mean gradient can produce distinct non-Gaussianity, most evidently at the distribution tails (Bourlioux and Majda 2002; Neelin et al. 2010). Other mechanisms that lead to non-Gaussianity include cross-frequency coupling (Rennert and Wallace 2009), jet stream meandering (Luxford and Woollings 2012), and first passage processes (Stechmann and Neelin 2014; Neelin et al. 2017). Sura and Hannachi (2015) provide a comprehensive review on the mechanisms that generate deviations from Gaussianity in the atmospheric sciences.
Alternatively, even if the deterministic term (i.e., the term in which noise is not explicit) is linear, deviations from Gaussianity may arise through interactions between a slowly evolving system and fast transients forcing the system if the fast transients depend on the state of the system (Sura et al. 2005). Strictly speaking, any differential equation with stochasticity in it represents a treatment of nonlinearity at some level. That is where dynamical stochasticity originates. A linear system forced with additive noise represents a coarse graining long enough that all of the state dependence, if any, of the nonlinear effects is averaged out. In that case, the central limit theorem (CLT) applies strongly enough to render the statistics of the measured state approximately Gaussian. When the time-scale separation between the linear decay and the rapid nonlinearities is too small to invoke such a strong version of the CLT but is large enough to average out the details of the nonlinearities, the system may be modeled as a linear process with state-dependent (multiplicative) noise. Thus, unlike additive noise, the multiplicative noise processes that drive the deterministic dynamics explicitly depend on the system state (e.g., subdaily wind variance dependence on storminess or blocking, or surface fluxes depending on local stability). Multiplicative noise is well established as a source of non-Gaussianity (Penland 2003; Sura et al. 2005; Majda et al. 2008; Sardeshmukh and Sura 2009; Franzke et al. 2015; Sura and Hannachi 2015; Berner et al. 2017) and has been employed to model several aspects of climate variability, including El Niño–Southern Oscillation (Perez et al. 2005; Jin et al. 2007; Levine and Jin 2017) and extratropical variability (Neelin and Weng 1999; Sura et al. 2005).
For evaluation and comparison purposes, it is important to establish a baseline for variability, including deviations from Gaussianity, that can be explained through a multilinear deterministic system that integrates (possibly) state-dependent noise. To do that, it is necessary to have a simple methodology to extract the multiplicative noise information from data. This has proven difficult because the state-dependent noise, as elaborated below, in general contributes to both the “signal” and the “noise,” so disentangling its contribution is not straightforward. Thus, despite important progress on the matter (e.g., Siegert et al. 1998; Peavoy et al. 2015), a simple methodology to calculate the state-dependent noise from data in a statistically consistent way has been lacking. The development of this methodology, tailored to linear deterministic systems driven by multiplicative noise, is the primary goal of this paper.
In general, fast variability may depend not only on the magnitude of the system anomalies but also on their sign. This to a first approximation can be modeled through a type of noise formulation termed correlated additive–multiplicative (CAM) noise (Müller 1987; Sura et al. 2006; Sardeshmukh and Sura 2009; Majda et al. 2009; Penland and Sardeshmukh 2012; Sardeshmukh and Penland 2015; Sardeshmukh et al. 2015; Franzke 2017). Mathematically, the CAM noise amplitude depends linearly on the state of the system, and this dependency is allowed to be asymmetric with respect to the mean. This asymmetry is expected in systems where the fast variability is modulated differently whether the system is in its positive or negative state, which naturally leads to skewness. This is the case when linearizing the effects of rapid wind variability on fluxes affecting ocean mixed layer dynamics (Sura et al. 2006; Sura and Newman 2008). For example, Sura et al. (2006), studying an ocean mixed layer model, finds at least two (related) sources for this noise amplitude asymmetry. The first one arises because of ocean–atmosphere mean-state temperature differences. This affects the sensible and latent heat fluxes driven by rapid wind variability at the ocean–atmosphere interface and can be mapped directly onto a CAM noise term. The second source arises because of the different sensitivity of boundary layer stability to positive or negative anomalies. This contribution, while not precisely following a CAM noise form (a piecewise linear function would be better), can be approximated by it.


Henceforth in this paper, we will consider the next step in complexity beyond estimating parameters from the standard LIM (driven by additive noise) and LIM applied to the univariate CAM system (Sardeshmukh et al. 2015). That is, we consider a linear inverse model driven by a simplified diagonal CAM noise formulation (CAM-LIM). Although this formulation neglects CAM noise covariance and nonlocal state dependency [see, for example, Sardeshmukh and Sura’s (2009) (4a) and (4b)], it is a more general model than used in previous applications and allows for the generation of deviations from Gaussianity in a linear deterministic setting.




Stochastic modeling has been used to study different aspects of climate variability [see Berner et al. (2017) for a review]. In particular, simplified versions of (3) have provided important insight into the nature of ocean–atmosphere interactions in the midlatitudes (e.g., Frankignoul and Hasselmann 1977; Hall and Manabe 1997; Barsugli and Battisti 1998; Sura et al. 2006; Sura and Newman 2008). We will illustrate the derivation of the CAM-LIM parameters and the general usefulness of the model by constructing a two-variable model of ocean–atmosphere thermal coupling in midlatitudes, empirically derived from ocean weather station data. The remainder of this manuscript is organized as follows: Section 2 presents a brief overview of the LIM framework. Section 3 introduces the CAM-LIM, some important simplifications, and the derivation of the parameters of the model as a function of its statistical structure. Additionally, the constraint in (1) is updated to include the effects of the coupling. Section 4 exemplifies this in the previously mentioned two-variable thermal-coupling model, and results are compared to the standard LIM modeling of the same system. Finally, section 5 concludes the paper.
2. Brief review of linear inverse modeling






















The LIM framework is and has been used extensively to study the state of the tropical Pacific (Penland and Sardeshmukh 1995; Penland 1996; Newman et al. 2011; Vimont et al. 2014; Capotondi and Sardeshmukh 2015), tropical Atlantic (Penland and Matrosova 1998; Vimont 2012), and extratropical dynamics (Alexander et al. 2008; Zanna 2012; Newman 2013; Newman et al. 2016). In the tropical Pacific, the forecast of sea surface temperature (SST) anomalies through this method is competitive compared to forecasts provided by general circulation models (Newman and Sardeshmukh 2017). The LIM framework provides a good description of the state variables contemporaneous and lagged covariances if the temporally resolved dynamics is close to linear, but it is not designed to account for long-term deviations from Gaussianity, for example, asymmetric behavior between positive and negative anomalies, and different than Gaussian frequency of extreme events.
3. CAM-LIM
In this section, we introduce a CAM-LIM framework, calculate several formulas to extract the multiplicative noise information from data, and derive and discuss the constraints that this formulation puts on the statistical moments generated.
a. Model derivation
















The use of a diagonal CAM noise formulation (one independent process per variable) and the neglect of direct nonlocal noise state dependency are important simplifications but allow us to calculate relatively simple formulas for the CAM-LIM parameters. Using this particular CAM noise formulation is the logical first step to introduce noise state dependency in a LIM framework, and it is in the spirit of, though more general than, the principle of diagonal dominance postulated by Sardeshmukh and Sura (2009, section 6). This principle states the increasing importance of the self-correlation terms in representing the higher-order statistics of a system and explains the success of the univariate version of this model in representing the observed deviations from Gaussianity in several climate variables (Sardeshmukh and Sura 2009; Penland and Sardeshmukh 2012; Sardeshmukh et al. 2015; Sura and Hannachi 2015). Here, in addition to the terms considered by Sardeshmukh and Sura, coupling between the variables and noise covariance effects are incorporated. This allows for the calculation of joint statistics. Despite these simplifications, in most cases, the model will be enough to display a realistic representation of the emergent non-Gaussian behavior, while maintaining all the advantages of the standard LIM framework.






















b. CAM-LIM constraints on the statistics








4. Modeling midlatitude ocean–atmosphere local coupling using CAM-LIM
In this section, we apply the CAM-LIM methodology to a simple dataset that has been investigated in the literature (Hall and Manabe 1997; Sura et al. 2006; Sura and Newman 2008). A simple model of ocean–atmosphere coupling in the midlatitudes is calculated from data and compared to observations. The CAM-LIM parameters estimation procedure is described in detail, and the information provided by the constraints described above is used to improve the calculation of the parameters.
a. The models










b. Models' parameter estimation
To estimate parameters for our models in (27) and (28), we use ocean weather station (OWS) data [for information on OWS, see Diaz et al. (1987) and Dinsmore (1996)], specifically OWS Papa (OWS P) in the North Pacific. OWS P is located far from strong currents (Hall and Manabe 1997) and is only affected weakly by ENSO (Alexander et al. 2002), thus providing an ideal location to construct these models.
We consider daily data from 1 January 1950 to 31 December 1980 (total of 31 years). The














It is tempting to compare the calculation of these parameters in (29) to Sura and Newman (2008) modeling of the same dataset [see their (29), (34), and (36)]. Although superficially similar, the two models differ in several respects, making the comparison difficult. The model presented here is totally empirical, while Sura and Newman’s takes into account the dynamical equations. Having somewhat different objectives, the two models make different assumptions that prohibit their direct comparison. For example, while the CAM-LIM simplified noise formulation allows for a direct estimation of the noise amplitudes, it will not directly represent some of the nonlocal effects in Sura and Newman’s model. It is important to emphasize that in the CAM-LIM case, there are no assumptions as to where the noise is coming from, whereas Sura and Newman neglect some potentially important processes (ocean currents, vertical entrainment, variable mixed layer depth, and mixing) in order to highlight deviations from Gaussianity arising from the effect of state-dependent rapid wind fluctuations on sensible and latent heat fluxes at the air–sea interface. Because of the positive mean climatological ocean–atmosphere temperature difference almost everywhere, models restricted to local air–sea interaction can only generate positive SST skewness (Sura and Sardeshmukh 2009). Although SST skewness is positive at OWS P, there are many parts of the globe where skewness is negative (Sura and Sardeshmukh 2008; Sardeshmukh and Penland 2015). Comparing to the dimensional reduction strategy employed in Sura and Sardeshmukh [2009, see their (16) or (19)], CAM-LIM-independent
To compare both the standard LIM (28) and CAM-LIM (27) with observations, we run both models 10 times for 1000 years each with the calculated parameters in (29) using the stochastic Heun integration method (Rüemelin 1982; Ewald and Penland 2009). We remove the first 50 years of each integration as spinup time, for a total of 9500 years of LIM- and CAM-LIM-generated time series. We use an integration time step of 3 min and collect daily output. This corresponds to 9500 full years of (3-day running mean) daily values or, equivalently, to 19 157 extended winters of 181 days.
Using the generated datasets, we calculate the
Three-day running-mean To and Ta joint PDFs (solid), calculated using (a) observed data for November–April 1950–80, (b) LIM full integration, and (c) CAM-LIM full integration. Shading denotes differences from a best-fit bivariate Gaussian distribution. Units are of standard deviation.
Citation: Journal of the Atmospheric Sciences 75, 2; 10.1175/JAS-D-17-0235.1
Given the extended LIM and CAM-LIM integrations, one may ask how the observations compare with LIM and CAM-LIM integrations of the same length. Figure 2 shows the difference between the observed joint PDF and Monte Carlo estimates for the LIM joint PDF (Fig. 2a) and CAM-LIM joint PDF (Fig. 2b). For each model, Monte Carlo PDF estimates are obtained for each of 617 different 31-yr periods (181 extended winter days per year) contained within the respective 9500-yr simulations and averaged to obtain the dashed curve. Shading indicates regions where the observed PDF falls outside of the 2.5nd or 97.5th percentiles calculated from the 617 LIM and CAM-LIM PDF estimates. Comparing Figs. 2a and 2b, it is visually apparent that the observed variability can be better explained through the CAM-LIM formulation. Although there are some spots where the observed and CAM-LIM joint PDFs are different (at the 95% confidence level), noticeably for strong positive
Comparison of Ta–To observed joint PDF (solid) and (a) LIM- and (b) CAM-LIM-generated joint PDFs of the same length as the observations (617 realizations). The dashed line denotes the average of the 617 LIM and CAM-LIM realizations, and shading denotes region where the observed joint PDF is outside the 2.5nd and 97.5th percentiles estimated from the LIM and CAM-LIM realizations.
Citation: Journal of the Atmospheric Sciences 75, 2; 10.1175/JAS-D-17-0235.1
A similar analysis can be conducted for the distribution of the individual variables. Figure 3 shows the observed and standard LIM- and CAM-LIM-generated
(a),(c),(e) Ta and (b),(d),(f) To LIM-generated (red), CAM-LIM-generated (blue), and observed (green dashed) cumulative density functions. Solid red and blue lines denote the average of 617 different LIM and CAM-LIM realizations of the same length as the observations, with confidence intervals showing the region within the 2.5nd and 97.5th percentiles of the realizations (LIM: red error bars; CAM-LIM: blue shading). Units are of standard deviation. (a),(b) The middle range of the data (between −2 and 2 std dev), (c),(d) the negative tail, and (e),(f) the positive tail. All CDFs are estimated using an Epanechnikov kernel (Epanechnikov 1969; Bowman and Azzalini 1997); (c)–(f) are also shown in a logarithmic y axis in Fig. S3.
Citation: Journal of the Atmospheric Sciences 75, 2; 10.1175/JAS-D-17-0235.1
A general understanding of the data distribution, including the behavior of the tails, can be found by calculating the distribution’s skewness and kurtosis. Table 1 shows the observed skewness and kurtosis, as well as the values calculated using the full LIM and CAM-LIM integrations. As expected, the standard LIM skewness and kurtosis matches the ones of a Gaussian distribution. Even though the match is not perfect, it is evident that the CAM-LIM provides a closer match to observations.
Observed and modeled skewness and kurtosis.
There is an important degree of variability in the statistics as a function of the length of the data segment considered for the calculations. Figure 4 shows the skewness (S) and excess kurtosis (K − 3) distributions when partitioning the standard LIM- and CAM-LIM-generated time series in segments of 31 winters (the length of the OWS P observations) as done before. First, note that although the fitting works better for
An estimation of (a) Ta and (c) To skewness and (b) Ta and (d) To excess kurtosis distributions using an Epanechnikov kernel. This is calculated by dividing the full LIM- (blue solid) and CAM-LIM (red dashed)-generated datasets into segments the length of the observed dataset (617 realizations). In each panel, the light green circle denotes the observed skewness or excess kurtosis, and the black circles denote the 2.5nd and 97.5th percentile bounds. The observed values are within the 95% confidence level generated by the CAM-LIM and outside the confidence level generated by the LIM in all cases.
Citation: Journal of the Atmospheric Sciences 75, 2; 10.1175/JAS-D-17-0235.1
c. Parameter estimation and CAM-LIM-generated statistical constraints
Although the observational input data (and, by construction, the full CAM-LIM integration) satisfy the CAM-LIM constraints in (24)–(26), for short enough data segments, sampling variability may cause these constraints to be not satisfied. Practically, this becomes a problem because these “short enough” segments may be longer than the available dataset for a particular application. To partially overcome this, we need a redefinition of the sample statistics that take into account the constraints in (24)–(26). This can be done in several ways. Taking into account the information provided by the constraints, we choose a simple redefinition of matrix
As an example, Fig. 5 shows the histogram of
A histogram (with an Epanechnikov kernel estimated PDF superimposed) of E1 retrieved values calculated using segments of (a),(c) 31-winters' length and (b),(d) segments of 100-winters' length of the full CAM-LIM-generated dataset. Here, we show two different cases: (a), (b) the histogram of the retrieved values using segments where constraints (24) and (25) are satisfied (α = 0) and (c),(d) retrieved values for all segments after the methodology outlined in section 4c is followed (α varying). In this case, for each segment, we use a redefined matrix (1 + α)
Citation: Journal of the Atmospheric Sciences 75, 2; 10.1175/JAS-D-17-0235.1
5. Concluding remarks
In this paper, we consider a natural extension of the linear inverse model framework. Here, in addition to an additive Gaussian white noise component, the system is driven by a simple state-dependent noise formulation, termed CAM noise (Sardeshmukh and Sura 2009). Compared to a standard LIM, this framework generates the same (lag and contemporaneous) covariance structure and the same expected evolution of anomalies while at the same time generating skewness and excess kurtosis. One important result is that the statistical moments generated by this system are constrained. One of the constraints identified here generalizes the well-known univariate CAM noise constraint [(1)] between skewness S and kurtosis K to include the effects of coupling and noise covariance. In common with the univariate case, the coupled time series generated are typically kurtotic, making this an attractive framework to model extreme-events frequencies in many cases. The univariate constraint has been shown to be relevant for different climate variables (Sardeshmukh and Sura 2009; Sardeshmukh and Penland 2015; Sardeshmukh et al. 2015). We expect the multivariate constraint in (24) to provide additional information for coupled datasets.
We illustrate the general framework by using a locally coupled model of ocean–atmosphere interaction in midlatitudes. We calculate the model parameters using available sea surface temperature
Although here we presented the concrete example of a midlatitude coupled model, we picture this framework to have wide applicability. Specifically, any system where the time resolved dynamics is reasonably linear but significant deviations from Gaussianity are present is susceptible to be modeled using CAM-LIM. Here, we note that the model has been tested in other contexts, including higher-dimensional systems, with good results (Martinez-Villalobos 2016). Implicit in the derivation of this framework is a separation of the dynamics between slow and fast time scales. Here, we argue (together with many other studies) for the importance of the fast unresolved part of the dynamics in shaping not only the variance of the resolved dynamics but also the mean state (through the noise-induced drift), asymmetry in the PDF, and the behavior of the extremes. The tool presented here can be valuable to quantify these effects.
Acknowledgments
This work was supported by National Science Foundation Grants AGS-1463643 and AGS-1463970 (CM, DJV and MN), and National Science Foundation Grant AGS-1540518 (CM and JDN). We thank Dr. Zhaohua Wu for handling the manuscript and two anonymous reviewers for their insightful comments.
APPENDIX
Derivation of CAM-LIM Parameters























REFERENCES
Alexander, M. A., I. Bladé, M. Newman, J. R. Lanzante, N.-C. Lau, and J. D. Scott, 2002: The atmospheric bridge: The influence of ENSO teleconnections on air–sea interaction over the global oceans. J. Climate, 15, 2205–2231, https://doi.org/10.1175/1520-0442(2002)015<2205:TABTIO>2.0.CO;2.
Alexander, M. A., L. Matrosova, C. Penland, J. D. Scott, and P. Chang, 2008: Forecasting Pacific SSTs: Linear inverse model predictions of the PDO. J. Climate, 21, 385–402, https://doi.org/10.1175/2007JCLI1849.1.
Barsugli, J. J., and D. S. Battisti, 1998: The basic effects of atmosphere–ocean thermal coupling on midlatitude variability. J. Atmos. Sci., 55, 477–493, https://doi.org/10.1175/1520-0469(1998)055<0477:TBEOAO>2.0.CO;2.
Berner, J., and Coauthors, 2017: Stochastic parameterization: Toward a new view of weather and climate models. Bull. Amer. Meteor. Soc., 98, 565–588, https://doi.org/10.1175/BAMS-D-15-00268.1.
Borges, M. D., and D. L. Hartmann, 1992: Barotropic instability and optimal perturbations of observed nonzonal flows. J. Atmos. Sci., 49, 335–354, https://doi.org/10.1175/1520-0469(1992)049<0335:BIAOPO>2.0.CO;2.
Bourlioux, A., and A. J. Majda, 2002: Elementary models with probability distribution function intermittency for passive scalars with a mean gradient. Phys. Fluids, 14, 881–897, https://doi.org/10.1063/1.1430736.
Bowman, A. W., and A. Azzalini, 1997: Applied Smoothing Techniques for Data Analysis: The Kernel Approach with S-Plus Illustrations. Oxford Statistical Science Series, Vol. 18, Clarendon Press, 193 pp., https://searchworks.stanford.edu/view/3749403.
Boyd, J. P., 1983: The continuous spectrum of linear Couette flow with the beta effect. J. Atmos. Sci., 40, 2304–2308, https://doi.org/10.1175/1520-0469(1983)040<2304:TCSOLC>2.0.CO;2.
Capotondi, A., and P. D. Sardeshmukh, 2015: Optimal precursors of different types of ENSO events. Geophys. Res. Lett., 42, 9952–9960, https://doi.org/10.1002/2015GL066171.
Cavanaugh, N. R., and S. S. P. Shen, 2014: Northern Hemisphere climatology and trends of statistical moments documented from GHCN-Daily surface air temperature station data from 1950 to 2010. J. Climate, 27, 5396–5410, https://doi.org/10.1175/JCLI-D-13-00470.1.
Chen, C., M. A. Cane, N. Henderson, D. E. Lee, D. Chapman, D. Kondrashov, and M. D. Chekroun, 2016: Diversity, nonlinearity, seasonality, and memory effect in ENSO simulation and prediction using empirical model reduction. J. Climate, 29, 1809–1830, https://doi.org/10.1175/JCLI-D-15-0372.1.
DelSole, T., and A. Y. Hou, 1999: Empirical stochastic models for the dominant climate statistics of a general circulation model. J. Atmos. Sci., 56, 3436–3456, https://doi.org/10.1175/1520-0469(1999)056<3436:ESMFTD>2.0.CO;2.
Diaz, H. F., C. S. Ramage, S. D. Woodruff, and T. S. Parler, 1987: Climatic summaries of ocean weather stations. NOAA Rep., 26 pp., ftp://ftp.library.noaa.gov/noaa_documents.lib/OAR/ERL_ARL/Diaz1987.pdf.
Dinsmore, R., 1996: Alpha, Bravo, Charlie...: Ocean weather ships 1940-1980. Oceanus, 39, 9–10, http://www.whoi.edu/oceanus/feature/alpha-bravo-charlie.
Epanechnikov, V. A., 1969: Non-parametric estimation of a multivariate probability density. Theory Probab. Its Appl., 14, 153–158, https://doi.org/10.1137/1114019.
Ewald, B., and C. Penland, 2009: Numerical generation of stochastic differential equations in climate models. Handbook of Numerical Analysis: Computational Methods for the Atmosphere and the Oceans, R. Temam and J. Tribbia, Eds., Elsevier, 279–306.
Farrell, B., 1988: Optimal excitation of neutral Rossby waves. J. Atmos. Sci., 45, 163–172, https://doi.org/10.1175/1520-0469(1988)045<0163:OEONRW>2.0.CO;2.
Fokker, A. D., 1914: Die mittlere Energie rotierender elektrischer Dipole im Strahlungsfeld. Ann. Phys., 348, 810–820, https://doi.org/10.1002/andp.19143480507.
Frankignoul, C., and K. Hasselmann, 1977: Stochastic climate models, part II: Application to sea-surface temperature anomalies and thermocline variability. Tellus, 29, 289–305, https://doi.org/10.3402/tellusa.v29i4.11362.
Franzke, C. L. E., 2017: Extremes in dynamic-stochastic systems. Chaos, 27, 012101, https://doi.org/10.1063/1.4973541.
Franzke, C. L. E., T. J. O’Kane, J. Berner, P. D. Williams, and V. Lucarini, 2015: Stochastic climate theory and modeling. Wiley Interdiscip. Rev.: Climate Change, 6, 63–78, https://doi.org/10.1002/wcc.318.
Gardiner, C. W., 2010: Stochastic Methods: A Handbook for the Natural and Social Sciences. Springer Series in Synergetics, Vol. 13, Springer, 447 pp.
Ghil, M., and Coauthors, 2002: Advanced spectral methods for climatic time series. Rev. Geophys., 40, 1003, https://doi.org/10.1029/2000RG000092.
Gritsun, A., G. Branstator, and A. Majda, 2008: Climate response of linear and quadratic functionals using the fluctuation—Dissipation theorem. J. Atmos. Sci., 65, 2824–2841, https://doi.org/10.1175/2007JAS2496.1.
Hall, A., and S. Manabe, 1997: Can local linear stochastic theory explain sea surface temperature and salinity variability? Climate Dyn., 13, 167–180, https://doi.org/10.1007/s003820050158.
Huybers, P., K. A. McKinnon, A. Rhines, and M. Tingley, 2014: U.S. daily temperatures: The meaning of extremes in the context of nonnormality. J. Climate, 27, 7368–7384, https://doi.org/10.1175/JCLI-D-14-00216.1.
Ito, K., 1951: On stochastic differential equations. Memo. Amer. Math. Soc., 4, 1–51.
Jin, F.-F., L. Lin, A. Timmermann, and J. Zhao, 2007: Ensemble-mean dynamics of the ENSO recharge oscillator under state-dependent stochastic forcing. Geophys. Res. Lett., 34, L03807, https://doi.org/10.1029/2006GL027372.
Johnson, S. D., D. S. Battisti, and E. S. Sarachik, 2000: Empirically derived Markov models and prediction of tropical Pacific sea surface temperature anomalies. J. Climate, 13, 3–17, https://doi.org/10.1175/1520-0442(2000)013<0003:EDMMAP>2.0.CO;2.
Kim, K.-Y., and G. R. North, 1992: Seasonal cycle and second-moment statistics of a simple coupled climate system. J. Geophys. Res., 97, 20 437–20 448, https://doi.org/10.1029/92JD02281.
Kimoto, M., and M. Ghil, 1993: Multiple flow regimes in the Northern Hemisphere winter. Part I: Methodology and hemispheric regimes. J. Atmos. Sci., 50, 2625–2644, https://doi.org/10.1175/1520-0469(1993)050<2625:MFRITN>2.0.CO;2.
Kolmogoroff, A., 1931: Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung. Math. Ann., 104, 415–458, https://doi.org/10.1007/BF01457949.
Kondrashov, D., S. Kravtsov, and M. Ghil, 2006: Empirical mode reduction in a model of extratropical low-frequency variability. J. Atmos. Sci., 63, 1859–1877, https://doi.org/10.1175/JAS3719.1.
Kravtsov, S., D. Kondrashov, and M. Ghil, 2005: Multilevel regression modeling of nonlinear processes: Derivation and applications to climatic variability. J. Climate, 18, 4404–4424, https://doi.org/10.1175/JCLI3544.1.
Leith, C. E., 1975: Climate response and fluctuation dissipation. J. Atmos. Sci., 32, 2022–2026, https://doi.org/10.1175/1520-0469(1975)032<2022:CRAFD>2.0.CO;2.
Levine, A. F. Z., and F. F. Jin, 2017: A simple approach to quantifying the noise–ENSO interaction. Part I: Deducing the state-dependency of the windstress forcing using monthly mean data. Climate Dyn., 48, 1–18, https://doi.org/10.1007/s00382-015-2748-1.
Loikith, P. C., and J. D. Neelin, 2015: Short-tailed temperature distributions over North America and implications for future changes in extremes. Geophys. Res. Lett., 42, 8577–8585, https://doi.org/10.1002/2015GL065602.
Loikith, P. C., B. R. Lintner, J. Kim, H. Lee, J. D. Neelin, and D. E. Waliser, 2013: Classifying reanalysis surface temperature probability density functions (PDFs) over North America with cluster analysis. Geophys. Res. Lett., 40, 3710–3714, https://doi.org/10.1002/grl.50688.
Luxford, F., and T. Woollings, 2012: A simple kinematic source of skewness in atmospheric flow fields. J. Atmos. Sci., 69, 578–590, https://doi.org/10.1175/JAS-D-11-089.1.
Majda, A. J., C. Franzke, and B. Khouider, 2008: An applied mathematics perspective on stochastic modelling for climate. Philos. Trans. Roy. Soc., 366A, 2427–2453, https://doi.org/10.1098/rsta.2008.0012.
Majda, A. J., C. Franzke, and D. Crommelin, 2009: Normal forms for reduced stochastic climate models. Proc. Natl. Acad. Sci. USA, 106, 3649–3653, https://doi.org/10.1073/pnas.0900173106.
Martinez-Villalobos, C., 2016: Deterministic and stochastic models of tropical climate variability. Ph.D. thesis, University of Wisconsin–Madison, 183 pp., https://dept.atmos.ucla.edu/cristian_martinez_villalobos/publications/deterministic-and-stochastic-models-tropical-climate.
Martinez-Villalobos, C., and D. J. Vimont, 2017: An analytical framework for understanding tropical meridional modes. J. Climate, 30, 3303–3323, https://doi.org/10.1175/JCLI-D-16-0450.1.
Monahan, A. H., 2004: A simple model for the skewness of global sea surface winds. J. Atmos. Sci., 61, 2037–2049, https://doi.org/10.1175/1520-0469(2004)061<2037:ASMFTS>2.0.CO;2.
Moore, A. M., and R. Kleeman, 1999: The nonnormal nature of El Niño and intraseasonal variability. J. Climate, 12, 2965–2982, https://doi.org/10.1175/1520-0442(1999)012<2965:TNNOEN>2.0.CO;2.
Müller, D., 1987: Bispectra of sea-surface temperature anomalies. J. Phys. Oceanogr., 17, 26–36, https://doi.org/10.1175/1520-0485(1987)017<0026:BOSSTA>2.0.CO;2.
Neelin, J. D., and W. Weng, 1999: Analytical prototypes for ocean–atmosphere interaction at midlatitudes. Part I: Coupled feedbacks as a sea surface temperature dependent stochastic process. J. Climate, 12, 697–721, https://doi.org/10.1175/1520-0442(1999)012<0697:APFOAI>2.0.CO;2.
Neelin, J. D., B. R. Lintner, B. Tian, Q. Li, L. Zhang, P. K. Patra, M. T. Chahine, and S. N. Stechmann, 2010: Long tails in deep columns of natural and anthropogenic tropospheric tracers. Geophys. Res. Lett., 37, L05804, https://doi.org/10.1029/2009GL041726.
Neelin, J. D., S. Sahany, S. N. Stechmann, and D. N. Bernstein, 2017: Global warming precipitation accumulation increases above the current-climate cutoff scale. Proc. Natl. Acad. Sci. USA, 114, 1258–1263, https://doi.org/10.1073/pnas.1615333114.
Newman, M., 2013: An empirical benchmark for decadal forecasts of global surface temperature anomalies. J. Climate, 26, 5260–5269, https://doi.org/10.1175/JCLI-D-12-00590.1.
Newman, M., and P. D. Sardeshmukh, 2017: Are we near the predictability limit of tropical Indo-Pacific sea surface temperatures? Geophys. Res. Lett., 44, 8520–8529, https://doi.org/10.1002/2017GL074088.
Newman, M., M. A. Alexander, and J. D. Scott, 2011: An empirical model of tropical ocean dynamics. Climate Dyn., 37, 1823–1841, https://doi.org/10.1007/s00382-011-1034-0.
Newman, M., and Coauthors, 2016: The Pacific decadal oscillation, revisited. J. Climate, 29, 4399–4427, https://doi.org/10.1175/JCLI-D-15-0508.1.
North, G. R., and R. F. Cahalan, 1981: Predictability in a solvable stochastic climate model. J. Atmos. Sci., 38, 504–513, https://doi.org/10.1175/1520-0469(1981)038<0504:PIASSC>2.0.CO;2.
Papanicolaou, G. C., and W. Kohler, 1974: Asymptotic theory of mixing stochastic ordinary differential equations. Commun. Pure Appl. Math., 27, 641–668, https://doi.org/10.1002/cpa.3160270503.
Peavoy, D., C. L. Franzke, and G. O. Roberts, 2015: Systematic physics constrained parameter estimation of stochastic differential equations. Comput. Stat. Data Anal., 83, 182–199, https://doi.org/10.1016/j.csda.2014.10.011.
Penland, C., 1996: A stochastic model of IndoPacific sea surface temperature anomalies. Physica D, 98, 534–558, https://doi.org/10.1016/0167-2789(96)00124-8.
Penland, C., 2003: A stochastic approach to nonlinear dynamics: A review. Bull. Amer. Meteor. Soc., 84, 925–925, https://doi.org/10.1175/BAMS-84-7-Penland.
Penland, C., 2007: Stochastic linear models of nonlinear geosystems. Nonlinear Dynamics in Geosciences, A. A. Tsonis and J. B. Elsner, Eds., Springer, 485–515.
Penland, C., and L. Matrosova, 1994: A balance condition for stochastic numerical models with application to the El Niño–Southern Oscillation. J. Climate, 7, 1352–1372, https://doi.org/10.1175/1520-0442(1994)007<1352:ABCFSN>2.0.CO;2.
Penland, C., and P. D. Sardeshmukh, 1995: The optimal growth of tropical sea surface temperature anomalies. J. Climate, 8, 1999–2024, https://doi.org/10.1175/1520-0442(1995)008<1999:TOGOTS>2.0.CO;2.
Penland, C., and L. Matrosova, 1998: Prediction of tropical Atlantic sea surface temperatures using linear inverse modeling. J. Climate, 11, 483–496, https://doi.org/10.1175/1520-0442(1998)011<0483:POTASS>2.0.CO;2.
Penland, C., and P. D. Sardeshmukh, 2012: Alternative interpretations of power-law distributions found in nature. Chaos, 22, 023119, https://doi.org/10.1063/1.4706504.
Perez, C. L., A. M. Moore, J. Zavala-Garay, and R. Kleeman, 2005: A comparison of the influence of additive and multiplicative stochastic forcing on a coupled model of ENSO. J. Climate, 18, 5066–5085, https://doi.org/10.1175/JCLI3596.1.
Perron, M., and P. Sura, 2013: Climatology of non-Gaussian atmospheric statistics. J. Climate, 26, 1063–1083, https://doi.org/10.1175/JCLI-D-11-00504.1.
Rennert, K. J., and J. M. Wallace, 2009: Cross-frequency coupling, skewness, and blocking in the Northern Hemisphere winter circulation. J. Climate, 22, 5650–5666, https://doi.org/10.1175/2009JCLI2669.1.
Ruff, T. W., and J. D. Neelin, 2012: Long tails in regional surface temperature probability distributions with implications for extremes under global warming. Geophys. Res. Lett., 39, L04704, https://doi.org/10.1029/2011GL050610.
Rüemelin, W., 1982: Numerical treatment of stochastic differential equations. SIAM J. Numer. Anal., 19, 604–613, https://doi.org/10.1137/0719041.
Sardeshmukh, P. D., and P. Sura, 2009: Reconciling non-Gaussian climate statistics with linear dynamics. J. Climate, 22, 1193–1207, https://doi.org/10.1175/2008JCLI2358.1.
Sardeshmukh, P. D., and C. Penland, 2015: Understanding the distinctively skewed and heavy tailed character of atmospheric and oceanic probability distributions. Chaos, 25, 036410, https://doi.org/10.1063/1.4914169.
Sardeshmukh, P. D., G. P. Compo, and C. Penland, 2015: Need for caution in interpreting extreme weather statistics. J. Climate, 28, 9166–9187, https://doi.org/10.1175/JCLI-D-15-0020.1.
Sévellec, F., and A. V. Fedorov, 2017: Predictability and decadal variability of the North Atlantic Ocean state evaluated from a realistic ocean model. J. Climate, 30, 477–498, https://doi.org/10.1175/JCLI-D-16-0323.1.
Siegert, S., R. Friedrich, and J. Peinke, 1998: Analysis of data sets of stochastic systems. Phys. Lett., 243A, 275–280, https://doi.org/10.1016/S0375-9601(98)00283-7.
Smirnov, D., M. Newman, and M. A. Alexander, 2014: Investigating the role of ocean–atmosphere coupling in the North Pacific Ocean. J. Climate, 27, 592–606, https://doi.org/10.1175/JCLI-D-13-00123.1.
Smyth, P., K. Ide, and M. Ghil, 1999: Multiple regimes in Northern Hemisphere height fields via mixture model clustering. J. Atmos. Sci., 56, 3704–3723, https://doi.org/10.1175/1520-0469(1999)056<3704:MRINHH>2.0.CO;2.
Stechmann, S. N., and J. D. Neelin, 2014: First-passage-time prototypes for precipitation statistics. J. Atmos. Sci., 71, 3269–3291, https://doi.org/10.1175/JAS-D-13-0268.1.
Stefanova, L., P. Sura, and M. Griffin, 2013: Quantifying the non-Gaussianity of wintertime daily maximum and minimum temperatures in the Southeast. J. Climate, 26, 838–850, https://doi.org/10.1175/JCLI-D-12-00161.1.
Stratonovich, R. L., 1966: A new representation for stochastic integrals and equations. SIAM J. Control, 4, 362–371, https://doi.org/10.1137/0304028.
Sura, P., and M. Newman, 2008: The impact of rapid wind variability upon air–sea thermal coupling. J. Climate, 21, 621–637, https://doi.org/10.1175/2007JCLI1708.1.
Sura, P., and P. D. Sardeshmukh, 2008: A global view of non-Gaussian SST variability. J. Phys. Oceanogr., 38, 639–647, https://doi.org/10.1175/2007JPO3761.1.
Sura, P., and P. D. Sardeshmukh, 2009: A global view of air–sea thermal coupling and related non-Gaussian SST variability. Atmos. Res., 94, 140–149, https://doi.org/10.1016/j.atmosres.2008.08.008.
Sura, P., and A. Hannachi, 2015: Perspectives of non-Gaussianity in atmospheric synoptic and low-frequency variability. J. Climate, 28, 5091–5114, https://doi.org/10.1175/JCLI-D-14-00572.1.
Sura, P., M. Newman, C. Penland, and P. Sardeshmukh, 2005: Multiplicative noise and non-Gaussianity: A paradigm for atmospheric regimes? J. Atmos. Sci., 62, 1391–1409, https://doi.org/10.1175/JAS3408.1.
Sura, P., M. Newman, and M. A. Alexander, 2006: Daily to decadal sea surface temperature variability driven by state-dependent stochastic heat fluxes. J. Phys. Oceanogr., 36, 1940–1958, https://doi.org/10.1175/JPO2948.1.
Thompson, C. J., and D. S. Battisti, 2000: A linear stochastic dynamical model of ENSO. Part I: Model development. J. Climate, 13, 2818–2832, https://doi.org/10.1175/1520-0442(2000)013<2818:ALSDMO>2.0.CO;2.
Timmermann, A., H. U. Voss, and R. Pasmanter, 2001: Empirical dynamical system modeling of ENSO using nonlinear inverse techniques. J. Phys. Oceanogr., 31, 1579–1598, https://doi.org/10.1175/1520-0485(2001)031<1579:EDSMOE>2.0.CO;2.
Vimont, D. J., 2010: Transient growth of thermodynamically coupled variations in the tropics under an equatorially symmetric mean state. J. Climate, 23, 5771–5789, https://doi.org/10.1175/2010JCLI3532.1.
Vimont, D. J., 2012: Analysis of the Atlantic Meridional Mode using linear inverse modeling: Seasonality and regional influences. J. Climate, 25, 1194–1212, https://doi.org/10.1175/JCLI-D-11-00012.1.
Vimont, D. J., M. A. Alexander, and M. Newman, 2014: Optimal growth of central and east Pacific ENSO events. Geophys. Res. Lett., 41, 4027–4034, https://doi.org/10.1002/2014GL059997.
von Storch, H., T. Bruns, I. Fischer-Bruns, and K. Hasselmann, 1988: Principal oscillation pattern analysis of the 30- to 60-day oscillation in general circulation model equatorial troposphere. J. Geophys. Res., 93, 11 022–11 036, https://doi.org/10.1029/JD093iD09p11022.
Wilkins, J. E., 1944: A note on skewness and kurtosis. Ann. Math. Stat., 15, 333–335, https://doi.org/10.1214/aoms/1177731243.
Wu, R., B. P. Kirtman, and K. Pegion, 2006: Local air–sea relationship in observations and model simulations. J. Climate, 19, 4914–4932, https://doi.org/10.1175/JCLI3904.1.
Zanna, L., 2012: Forecast skill and predictability of observed Atlantic sea surface temperatures. J. Climate, 25, 5047–5056, https://doi.org/10.1175/JCLI-D-11-00539.1.
Zanna, L., and E. Tziperman, 2005: Nonnormal amplification of the thermohaline circulation. J. Phys. Oceanogr., 35, 1593–1605, https://doi.org/10.1175/JPO2777.1.
Note that Sardeshmukh et al. (2015) derive a stricter bound
In this case, the mean of the conditional PDF will not correspond in general to its most probable value (Penland 2007).
Note that the denominator of (19) is always positive (Wilkins 1944).
This provides a conservative estimate. In this step, we may choose to calculate the constraint variable by variable, and some variables may be recovered faster.