A Statistical Investigation of the Dependence of Tropical Cyclone Intensity Change on the Surrounding Environment

Ning Lin Department of Civil and Environmental Engineering, Princeton University, Princeton, New Jersey

Search for other papers by Ning Lin in
Current site
Google Scholar
PubMed
Close
,
Renzhi Jing Department of Civil and Environmental Engineering, Princeton University, Princeton, New Jersey

Search for other papers by Renzhi Jing in
Current site
Google Scholar
PubMed
Close
,
Yuyan Wang Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey

Search for other papers by Yuyan Wang in
Current site
Google Scholar
PubMed
Close
,
Emmi Yonekura Department of Civil and Environmental Engineering, Princeton University, Princeton, New Jersey

Search for other papers by Emmi Yonekura in
Current site
Google Scholar
PubMed
Close
,
Jianqing Fan Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey

Search for other papers by Jianqing Fan in
Current site
Google Scholar
PubMed
Close
, and
Lingzhou Xue Department of Statistics, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Lingzhou Xue in
Current site
Google Scholar
PubMed
Close
Full access

Abstract

A progression of advanced statistical methods is applied to investigate the dependence of the 6-h tropical cyclone (TC) intensity change on various environmental variables, including the recently developed ventilation index (VI). The North Atlantic (NA) and western North Pacific (WNP) observations from 1979 to 2014 are used. As a first step, a model of the intensity change is developed as a linear function of 13 variables used in operational models, obtaining statistical R2 values of 0.26 for NA and 0.3 for WNP. Statistical variable selection techniques are then applied to significantly reduce the number of predictors (to 5–11), while keeping similar R2 values with linear or nonlinear models. Further reduction of the number of predictors (to 5–7) and significant improvement of R2 (0.41–0.53) are obtained with mixture modeling, indicating that the dependence of TC intensification on the environment is nonhomogeneous. Applying VI as the environmental predictor in the mixture modeling gives R2 results (0.41–0.74) similar to or better than those with more environmental variables, confirming that VI is a dominant environmental variable, although its effect on TC intensification is quite heterogeneous. However, the overall predictive R2 results of the mixture models are relatively low (<0.3), as the considered environmental variables have limited predictability for the occurrence of extreme/rapid intensification. Finally, nonparametric regression with six predictors [current intensity, previous intensity change, the three components of VI (maximum potential intensity, shear, and entropy deficit), and 200-hPa zonal wind] performs relatively well with predictive R2 values of 0.37 for NA and 0.36 for WNP. The predictability of these statistical models may be further improved by adding oceanic and inner-core process predictors.

Denotes content that is immediately available upon publication as open access.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ning Lin, nlin@princeton.edu

Abstract

A progression of advanced statistical methods is applied to investigate the dependence of the 6-h tropical cyclone (TC) intensity change on various environmental variables, including the recently developed ventilation index (VI). The North Atlantic (NA) and western North Pacific (WNP) observations from 1979 to 2014 are used. As a first step, a model of the intensity change is developed as a linear function of 13 variables used in operational models, obtaining statistical R2 values of 0.26 for NA and 0.3 for WNP. Statistical variable selection techniques are then applied to significantly reduce the number of predictors (to 5–11), while keeping similar R2 values with linear or nonlinear models. Further reduction of the number of predictors (to 5–7) and significant improvement of R2 (0.41–0.53) are obtained with mixture modeling, indicating that the dependence of TC intensification on the environment is nonhomogeneous. Applying VI as the environmental predictor in the mixture modeling gives R2 results (0.41–0.74) similar to or better than those with more environmental variables, confirming that VI is a dominant environmental variable, although its effect on TC intensification is quite heterogeneous. However, the overall predictive R2 results of the mixture models are relatively low (<0.3), as the considered environmental variables have limited predictability for the occurrence of extreme/rapid intensification. Finally, nonparametric regression with six predictors [current intensity, previous intensity change, the three components of VI (maximum potential intensity, shear, and entropy deficit), and 200-hPa zonal wind] performs relatively well with predictive R2 values of 0.37 for NA and 0.36 for WNP. The predictability of these statistical models may be further improved by adding oceanic and inner-core process predictors.

Denotes content that is immediately available upon publication as open access.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ning Lin, nlin@princeton.edu

1. Introduction

The intensity of a tropical cyclone (TC) has been one of the most difficult aspects of TCs to model, as TC intensification is a complex dynamic process depending on many components of the environment. Based on empirical relationships, the Statistical Hurricane Intensity Prediction Scheme (SHIPS) and Statistical Typhoon Intensity Prediction Scheme (STIPS) models have been built for operational weather forecasts of TC intensity (Knaff et al. 2005; DeMaria and Kaplan 1999; DeMaria et al. 2005). The models show that intensification depends on current and previous TC characteristics (e.g., translational speed, current intensity) and various environmental factors [e.g., maximum potential intensity (MPI), vertical wind shear, upper-level winds, and ocean heat content], though the empirical relationships change in different ocean basins. A simplified operational forecast scheme has also been developed to relate TC intensification to a reduced number of environmental variables including MPI, wind shear, and convective instability (DeMaria 2009). Emanuel et al. (2004) use a simple dynamic model to show that TC intensity depends significantly on MPI and other environmental factors, including wind shear, upper-ocean thermal structure, bathymetry in shallow regions, and land moisture and temperature. The study further notes that TCs also have internal variability of intensity through eyewall replacement cycles, which can be independent of the environment. Moreover, during their life cycles, many TCs undergo rapid intensification (RI; Kaplan and DeMaria 2003), which has been shown to significantly affect the climatology of the maximum lifetime intensity of TCs (Lee et al. 2016). Previous studies have attributed RI to inner-core, oceanic, and large-scale environmental processes (e.g., Kaplan and DeMaria 2003; Kaplan et al. 2010, 2015). However, the physical mechanism of RI and its dependence on the environment are not completely understood, and the operational prediction of RI has been a great challenge (Elsberry et al. 2007).

TC intensity plays a large role in the damage potential of a storm (e.g., Kantha 2006, 2008; Chavas et al. 2013). TC intensity modeling is not only critical in real-time operational forecasting but also a key component of long-term risk assessment. Within a risk assessment framework, a large number of synthetic TCs, generated with Monte Carlo (MC) methods, are often needed to evaluate the risk posed to a specific region (e.g., Lin and Emanuel 2016). The intensity is simulated along the generated storm track (e.g., Vickery et al. 2000; Emanuel et al. 2006; Hall and Jewson 2007; Yonekura and Hall 2011), possibly using the estimated environmental fields along the track; the environmental fields are estimated from observed or climate-model-projected datasets. Some TC intensity models that are used operationally may be applied to risk assessment. For such purposes, it is best to have both a computationally simple model and, more importantly, one that requires fewer environmental variable predictors, as some of the environmental variables may not be available in climate-model-projected datasets. The Coupled Hurricane Intensity Prediction System (CHIPS; Emanuel et al. 2004) is an example of a model used for operational forecasting that can also be applied to risk assessment (Emanuel et al. 2006). CHIPS is a relatively simple deterministic model based on TC physics. In contrast, a statistical model based on empirical relationships from observations of TCs and their environment may also be applied. Ideally, such a model relies on a few environmental predictors and captures nearly the full range of intensity changes.

The dependence on the environment, however, is critical, as it is key to a TC intensity model that will be used for long-term projection and risk analysis within the context of climate variation and climate change. Most previous work on statistical modeling of TC intensity for risk analysis relies very little on the environment but heavily on storm characteristics. The simplest statistical models for intensity use only current and previous TC intensities (i.e., persistence) as predictors. One example is the James and Mason (2005) model for TC central pressure, which is modeled as an autoregressive process. (Persistence is a very strong predictor, especially for short time step predictions.) The Vickery et al. (2000) model takes the persistence model a step further by using current and previous sea surface temperatures (SSTs) as predictors for statistical simulations of relative intensity—the TC central pressure normalized by the minimum central pressure that mean seasonal climatic conditions would allow. In an updated model, Vickery et al. (2009) add dependence on vertical wind shear, and the relative intensity is determined using the tropopause temperature and SST adjusted by a 1D ocean model (Emanuel et al. 2006). Recently, Lee et al. (2015) have developed a TC intensity model that reduces the SHIPS multiple linear regression model to its key environmental predictors: MPI minus current intensity, vertical wind shear, atmospheric stability, and 200-hPa divergence.

The main objective of this work is to further explore the dependence of TC intensification (including deintensification) on the environment and to develop new statistical models of TC intensity. We first build regression models incorporating environmental predictors that were previously considered to study their influence on TC intensification. However, as demonstrated by Lee et al. (2015), the previously considered variables are limited in fully capturing the climatology of TC intensity. Thus, we also explore a new variable from a recent advancement in our understanding of TC physics. Tang and Emanuel (2012) present an environmental predictor for intensification, the ventilation index (VI). They show that the ventilation of low-entropy air into a TC via vertical wind shear plays an important role in TC formation and intensification. VI is a nonlinear combination of critical environmental variables: it is the product of vertical wind shear and the entropy deficit between the environment and the inner storm core, divided by MPI. The entropy deficit characterizes the midlevel horizontal entropy difference between the storm and environment relative to the vertical entropy difference between the sea surface and the air above it. Tang and Emanuel (2012) derive a relationship between intensity change normalized by MPI as a joint function of VI and intensity normalized by MPI, showing that positive intensification and negative intensification occur in distinct phases of the VI-normalized intensity space; VI is a potentially valuable predictor for modeling TC intensity change. As such, we construct TC intensification regression models using VI as a sole environmental predictor. As VI is a nondimensional quantity with strong theoretical relationships to nondimensional intensity and intensification (Tang and Emanuel 2012), we also construct fully nondimensional VI models. The models based on VI, as well as on its component variables, are compared with the models based on previously considered environmental variables.

Recent advancement in statistical analysis of complex, large datasets also motivates us to explore new regression methods applied to TC intensity modeling. First, similar to Lee et al. (2015), we reduce the SHIPS and STIPS models by statistically identifying the most important environmental predictors and developing their associated linear models. However, instead of using the forward selection procedure of Lee et al. (2015) and others (DeMaria and Kaplan 1999; Knaff et al. 2005), which adds individual predictors in a stepwise manner, we add a constraint to the coefficient estimation process to select important predictors simultaneously from a large pool of potential predictors. Second, we construct generalized additive models, which allow nonlinear dependence of the TC intensification on the storm and environmental variables. The previous studies (DeMaria and Kaplan 1999; Knaff et al. 2005) have also used some nonlinear predictors (e.g., MPI2), indicating that there may exist nonlinear relationships with predictors. Here, we attempt to test the nonlinearity in all selected variables in a more systematic way. Third, Musgrave et al. (2012) note that the life cycle intensity of a TC may be divided into distinct regimes, meaning not all intensification observations should be treated the same. The idea of multiple regimes motivates us to treat TC intensification as a heterogeneous mixture in a finite mixture regression. Further, in addition to the parametric models with linear or specified nonlinear and heterogeneous structures, we also apply nonparametric modeling to explore the predictive potential of the variables of interest. These different statistical analysis approaches will greatly extend previous linear regression methods in order to improve TC intensity forecasting and risk analysis.

The four main phases of our statistical analysis are: variable selection, linear and nonlinear regression, finite mixture regression, and nonparametric analysis of selected variables. These statistical analyses are applied to a large number of previously considered environmental variables as well as to VI as the sole environmental predictor for TC intensification. Section 2 describes the data and the different statistical methods that are applied in the analysis. We highlight the progressions from a simple linear model to more complex approaches and discuss their advantages. Section 3 presents and discusses results from each phase of the analysis, performing a comparison of statistical performance, environmental predictor reductions, and interpretability. Section 4 discusses prediction perspectives, especially for the finite mixture modeling and nonparametric modeling. In section 5, we summarize our key findings and new insights regarding the statistical modeling of TC intensity change.

2. Methodology

a. Data and preprocessing

Most of the potential predictors, including TC and environmental variables, are similar to those used for both the SHIPS and STIPS models (DeMaria and Kaplan 1999; Knaff et al. 2005). A complete list of the notations, calculations, and data sources of the considered variables appear in Table 1. TC data are taken from the International Best Track Archive for Climate Stewardship (IBTrACS) WMO archive (Knapp et al. 2010). The TC data include 6-hourly latitude and longitude positions and 10-min maximum sustained wind speeds at 10 m above the surface. The location data are used to calculate the translational speed (TSPD) of the storm. Estimated surface background wind (Lin and Chavas 2012) is subtracted from the observed maximum wind to obtain the TC maximum wind (V). The 6-h change in the TC wind intensity from current to next time step, denoted by DV, is the intensification we model in this study. The 6-h step change in wind intensity from the previous time step is represented as DVP. We note that the SHIPS and STIPS models, as well as the Lee et al. (2015) model, consider various forecast windows from 12 to 120 h, as required for real-time forecasting. These analyses show that the statistical performance of the models decreases for shorter forecast windows, likely because of an increasing ratio of the data error to intensity change as the time interval becomes shorter. Nevertheless, here we focus on 6-h intensity changes in line with the statistical approach for risk analysis, which simulates both the track and intensity at 6-hourly intervals to mimic the format of the best track observations (Vickery et al. 2000, 2009; Hall and Yonekura 2013). The methods developed here can be similarly applied to longer-time-interval analyses for further investigation and for real-time forecasting applications.

Table 1.

Glossary of predictor variable notation with associated data sources and calculations noted.

Table 1.

Environmental data are taken from the European Centre for Medium-Range Weather Forecasts (ECMWF) interim reanalysis (ERA-Interim) with a resolution of 0.75° × 0.75° (Dee et al. 2011). The environmental variables include SHR, the vertical wind shear or difference between the 850- and 200-hPa level winds; USHR, the zonal component of the vertical wind shear; LSHR, the latitude-considered wind shear; T200, U200, and D200, the 200-hPa temperature, zonal wind, and divergence, respectively; RHHI, the relative humidity in the layer between 300 and 500 hPa; and Z850, the 850-hPa absolute vorticity. More complex combinations of environmental variables include MPI and VI. The MPI is calculated following Emanuel (1995) and Bister and Emanuel (1998), and VI [including its component variable entropy deficit (ED)] is calculated according to Tang and Emanuel (2012). In some analyses involving VI, the TC intensity is normalized by the maximum potential intensity (V/MPI), with 6-h intensification to the next step denoted as d(V/MPI) and from the previous step denoted as d(V/MPI)p. To account for the tendency toward spatial and temporal changes, we use the next-step values of the environmental variables to predict the change in intensity from the current to the next step. The next-step environmental values are available for risk analysis as the environment and storm track are first simulated. The current step environmental variables can be used as predictors, if the next-step environment is not first predicted in real-time forecasting applications. Sensitivity analyses show that the results are similar when using current or next-step environmental values in our short-time-interval prediction (6 h). In this study we do not incorporate oceanic variables to directly account for the ocean’s negative impact on storm intensification. Since 2004, SHIPS has started to incorporate oceanic heat content (OHC) estimates inferred from satellite altimetry observations; however, the oceanic data are only available for a limited time period and over a limited part of the Atlantic basin (DeMaria et al. 2005). Lee et al. (2015) consider the ocean temperature averaged over the top 100 m (Price 2009) but find that it is not a significant predictor. How to better account for the negative impact of the ocean in statistical TC intensity modeling warrants further research.

We use data from the years 1979–2014 for both the North Atlantic (NA) and western North Pacific (WNP). The data years are chosen to capture observations from the era of satellite technology as well as to include possible decadal oscillations. We start by developing SHIPS- and STIPS-like models for comparison. Differences from the original SHIPS and STIPS published models are expected as a result of the increased number of data years in our analysis: the DeMaria and Kaplan (1999) SHIPS model was built using 1989–96 observations, and the Knaff et al. (2005) STIPS model was built using 1997–2002 observations. Here, we use the environmental data from the ERA-Interim, whereas the SHIPS and STIPS models were constructed using operational synoptic datasets (DeMaria and Kaplan 1999; Knaff et al. 2005). We adhere to the spatial averaging of environmental variables in SHIPS that attempts to exclude the influence of the TC on the observed environmental variables.

The domains of analysis are 0°–30°N and 100°–12°W for NA and 0°–30°N and 95°E–180° for WNP. Only the 6-h observations that are over the ocean are kept for the analysis because TC intensity is known to behave differently over land. The observations that have missing values for any variable are removed. For example, if an observation of DV is missing the value for U200, the observation is not used in the regression. The filtered datasets include 7171 observations for NA and 13 180 observations for WNP. In the statistical analysis, variables are first standardized (by subtracting the mean of all observations and dividing by the standard deviation), except for the nondimensional VI models.

b. Statistical methods

The models predict the intensification DV (predictand) given the environmental and storm variables (predictors). Initially, 13 TC and environmental variables informed by the SHIPS and STIPS models [listed in Table 1, except VI, ED, V/MPI, and d(V/MPI)p] are used in a multiple linear regression model to serve as a baseline for comparison. The first stage of more complex models uses variable selection to reduce the model to only the most important predictors. Generalized additive modeling is applied next to allow for nonlinear relationships between the selected variables and the predictand. Then, the observations are considered to be a heterogeneous mixture and are classified into groups so that each has its own selected predictors and statistical properties. This progression of analyses is also used to test VI as the sole environmental predictor, with only storm intensity variables (i.e., V and DVp) as the other possible predictors. In addition, nondimensional analyses with VI are performed. Finally, the nonparametric method is applied to the analysis of VI, its component variables (MPI, SHR, ED), and other variables highlighted by the variable selection analysis. The following five subsections describe the statistical methods applied in these analyses.

1) Ordinary least squares (OLS)

In the linear regression with OLS, the squared residual error is minimized to estimate the model parameters and :
e1a
e1b
The predictand Y in our models is TC intensification (DV), predictors are m environmental and TC variables, and the prediction error has a Gaussian distribution with a mean of zero and standard deviation . Observations of the variables, denoted by and (i = 1, 2, …, n), are used to estimate the model parameters.

2) Sparse linear model (SLM)

Building on OLS, Tibshirani (1996) proposed a method for creating sparse linear models (SLMs). The method selects the most important predictors based on their correlation to the predictand by requiring the following constraint to Eq. (1b):
e2
where t is an adjustable “budget” parameter that constrains the regression coefficient estimates. As t increases from zero to infinity, the model progressively selects variables from no variables to all variables. Equation (1b) under the constraint in Eq. (2) can be solved as
e3
where is a nonnegative regularization parameter that is related to t. Equation (3) is the Lagrangian function of Eq. (1b) with constraint Eq. (2), known as the least absolute shrinkage and selection operator (LASSO; Tibshirani 1996).

Instead of performing significance tests to add each individual predictor as in the SHIPS model construction (DeMaria and Kaplan 1999), LASSO selects the most important variables simultaneously by shrinking unnecessary coefficients to zero. The value of the regularization parameter is chosen to balance the model’s accuracy and the number of predictors. We use a cross-validation scheme. Specifically, the data are randomly partitioned into a training set (90%) and a validation set (10%), and the model for each of a range of values is developed using the training set with the mean square error (MSE) calculated for the validation set; this analysis is repeated a number (10) of times to obtain the mean and standard deviation of the MSE for each value. Then, a value is chosen to be slightly greater than the value of , which gives the minimum mean MSE. Common choices of are one standard error from , denoted as (the MSE corresponding to equals the minimum MSE plus its one standard deviation), and two standard errors from , denoted as To illustrate, Fig. 1 shows an example cross-validation plot of the MSE as a function of , where the dashed green line shows , the dashed orange line shows , and the dashed blue line shows ; the number of parameters selected for each value is also displayed. In addition, it is noted that regression coefficient estimates from LASSO may include some of the bias due to the shrinkage applied during variable selection (Zhang and Huang 2008). Thus, to obtain SLMs, we apply OLS regression on the variables selected by LASSO.

Fig. 1.
Fig. 1.

MSEs for different values of the regulation parameter for the SLM using the NA data with the full variable selection pool. The mean (red dots) and standard error (gray thin curves) for the MSE for each value of are calculated via cross validation. The green dashed line shows the value of that gives a minimum error. The orange dashed line shows the that gives an error one standard error away from the minimum error , and the blue dashed line shows the two-standard-error line . The number of selected variables for each value of is shown at the top of the plot.

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

3) Sparse generalized additive model (SGAM)

Considering that the effects of the predictors for TC intensification may be nonlinear, we use sparse generalized additive models (SGAMs; Huang et al. 2010) to identify and characterize nonlinear effects, while still imposing a constraint to limit the number of predictors. To model the nonlinearity effects, consider the nonparametric additive model:
e4a
where are unknown nonlinear functions. Generalized additive models (GAMs) provide a useful extension to linear models, as they allow nonlinear transforms of predictors while still retaining much of their simplicity. In the above model, if we represent each function as a linear combination of basis functions, the resulting model can then be fit by simple least squares, and a sparse model can be achieved by imposing a constraint on the basis functions. More specifically, in our analysis, we expand each using B splines with degree 3:
e4b
Then,
e4c
where the constraint is imposed on the L-2 norm of the regression coefficients. Here, we apply a group LASSO penalty (Yuan and Lin 2006; Huang et al. 2010; Simon et al. 2013) on the coefficients—a generalized LASSO that sets coefficients of the basis functions for the same variable to zero simultaneously. As for SLM, is chosen based on the trade-off between fewer variables selected and lower MSE using the cross-validation scheme. The resulting SGAM has the most significant predictors selected and models the predictand as a sum of nonlinear functions of the selected predictors.

4) Finite mixture regression (FMR) LASSO

The assumption of homogeneity that requires the regression relationships to be the same for all TC intensification observations may be inadequate. Thus, substantial prediction improvements may be possible by incorporating a heterogeneous structure to the model. The finite mixture regression (FMR) model is a widely used approach for analyzing heterogeneity data. In this model, each observation is considered to be a random sample generated by one of its k components (groups/clusters), while the identity of the generating component is not observed. In a Gaussian setting, each of the k components is a linear regression, as in Eq. (1a); then, the probability distribution of the predictand Y, given the predictors Xj, is
e5
where is the mixture weight (proportion of observations), and are regression coefficients, and is the standard deviation, for each group r. These parameters can be estimated from data using the generalized expectation–maximization (EM) algorithm (McLachlan and Krishnan 1997), a widely used technique for parameter estimation in mixture models. In addition, the EM algorithm estimates the probability that each observation () is generated from each group. Thus, FMR has also been widely used for clustering the data; for example, Gaffney et al. (2007) and Camargo et al. (2007) apply FMR analysis to group storm trajectories, based on the estimated membership probabilities, into different clusters that depict the characteristic tracks (as functions of travel time) of the storms.
In our application to model TC intensity as a function of environmental and TC variables, it is ideal to add a constraint/penalty for the variable selection to FMR. We apply the L1-penalized finite mixture of the regression model (also known as FMR LASSO) proposed by Städler et al. (2010). The method applies an efficient generalized EM algorithm to obtain the sparse linear regression function for each group. The algorithm is iterative and starts by assigning observations to random groups and maximizing the following penalized log-likelihood function with respect to the group assignment:
e6
where represents the collection of model parameters () and the constraint on the L-1 norm of the regression coefficients is applied so that the variable selection is performed to obtain a sparse model within each group. Then, the model error is calculated and used to find the optimal group assignment for the observations. Similar to SLM and SGAM, is chosen with the cross-validation scheme to balance the model’s accuracy and the number of predictors.

FMR LASSO is a mixture of linear models; we also develop a mixture of nonlinear models called mixture GAM (MGAM) LASSO, which combines the merits of mixture models and SGAM. In the first step, FMR LASSO is applied to group the data and select important variables for each cluster. In the second step, we apply GAM to variables selected for each cluster. As a result, a nonlinear regression function is obtained for each cluster. Similarly, we can apply a nonparametric model, as described in the next subsection, to variables selected for each cluster to obtain a nonparametric model for each cluster; this model is denoted as mixture nonparametric (MNP) LASSO.

FMR models provide an advanced tool for clustering and investigating the heterogeneity of the data. However, we note that, unlike the homogenous models, which can be directly used for prediction, making predictions with an FMR model requires assigning a new observation of predictors (X) to a group or, alternatively, assigning group weights to the new observation. This assignment can introduce further, possibly significant, uncertainties into the prediction. We will return to this point in section 4, after showing the regression analysis results.

5) Nonparametric (NP) regression

In addition to the parametric regression methods introduced above, nonparametric (NP) multivariate regression is also applied. Instead of fitting variables of a predetermined regression model, NP regression relaxes the model assumptions and hence has the ability to capture more specific structure in the dataset. In this study we apply the kernel regression. The predictand can be estimated from the predictor by the first-order kernel regression:
e7
In Eq. (7), , where is the so-called kernel and h is the bandwidth, and we use the Gaussian kernel . The bandwidth h is a tuning parameter balancing the bias–variance trade-off: smaller h leads to better in-sample fit but may cause overfitting; larger h yields a smoother estimation but may sacrifice accuracy of estimation. In practice, one can use a data-driven approach such as cross validation to choose the optimal bandwidth for nonparametric kernel regression. Similarly, the prediction for Y from the second-order kernel regression with two covariates is
e8
where h1 and h2 are the bandwidths in the two covariate directions, respectively.
In our applications, more than two predictors may be considered. However, it is noted that kernel regression with more than two covariates often performs poorly with relatively large errors (Fan and Gijbels 1996, chapter 7). Thus, we apply kernel regression with model aggregation. Specifically, we model the response as a linear combination of first- and second-order kernel regression functions of m predictors (m > 2) as
e9
where are first-order kernel regression functions fitted for , as in Eq. (7), and are second-order kernel regression functions fitted for and , a combination of any two different covariates in the model, as in Eq. (8). By applying lower-order kernel regression and aggregating the fitted functions with an additional linear model, we can reduce the prediction error for higher-order analysis and at the same time preserve the advantage of nonparametric regression.

The goodness of fit of the NP regression is, as for other models, evaluated by the R-squared (R2) value, which reflects the percentage of variation in the predictand variable explained by the predictors. All statistical analyses in this study are calculated using the R statistical software interface. The glmnet package (Friedman et al. 2010) is used for the SLM analysis, the gglasso (Yang and Zou 2015) and gam (Hastie and Tibshirani 1990) packages are used for the SGAM and GAM analyses, the fmrlasso package (Städler et al. 2010) is used for the FMR LASSO analyses, and the np package (Hayfield and Racine 2008) is used for the nonparametric analysis.

3. Results

a. Variable selection and linear–nonlinear regression

The OLS [Eq. (1)], SLM [Eq. (3)], and SGAM [Eq. (4)] methods are performed on the observations of DV and 13 potential predictor variables for NA and WNP. Table 2 shows the selected variables using each method. The OLS columns list all the variables for linear regression as a baseline for comparison. The SLM columns list the variables selected by LASSO for linear regression. The SGAM columns list the variables selected by group LASSO for nonlinear regression. The variables appear in the order of significance as determined by their contribution to the explained variance of the predictand, and the sign of the coefficient for each variable is also shown. The relative order of importance among the predictors is similar across models. Storm-persistent variables (i.e., current intensity V and last-step intensification DVp) are most significant, as expected, especially for the short-time prediction. Among the environmental variables, MPI, SHR, RHHI, and U200 are most important; Z850 is also relatively important. Specifically, intensification is favored if the storm has been intensifying, has a relatively low intensity, and is surrounded by an environment that has high MPI, low wind shear, high upper-level relative humidity, high-level zonal wind more easterly than normal, and high low-level vorticity. These observations are consistent with previous studies; in particular, DeMaria and Kaplan (1999) point out that 200-hPa winds are more easterly than normal equatorward of an upper-level ridge, which is a favorable region for intensification. Another large-scale forcing term, D200, is relatively less important for the 6-h intensification considered here, consistent with previous observations that this variable is only significant for longer prediction windows (>72 h; Lee et al. 2015). The variable T200 is expected to have an inverse relationship with intensification because a lower upper-level atmospheric temperature may increase the efficiency of convection by providing a larger temperature difference from the surface. However, T200 is not significant here, as the upper-level temperature is already applied in the calculation of MPI.

Table 2.

OLS, SLM, and SGAM analyses for modeling intensification (DV) for NA and WNP. Selected variables are listed in their order of statistical significance, followed by the sign of their coefficient (for linear models). The bottom row shows the R2 value for each model.

Table 2.

A few variable predictors have an unexpected sign for their coefficient estimate according to the preestablished physical understanding. While the sign of the coefficient helps with the interpretability of the model, it does not necessarily mean that it is incorrect when unexpected signs appear in a multivariant regression setting, as also noted for the SHIPS and STIPS models (DeMaria and Kaplan 1999; Knaff et al. 2005). Since some predictors are interrelated, an unexpected sign may indicate compensation for the contribution of other variables. For example, SHR is expected to have an inverse relationship with intensification, since higher values of vertical wind shear inhibit convection. LSHR has a positive sign in the OLS models, as it statistically compensates for the negative effects of SHR and USHR. This statistical result is consistent with the theoretical argument of DeMaria (1996) that, as they have smaller Rossby penetration depth, low-latitude storms are more sensitive to vertical shear than higher-latitude storms. TSPD is shown to have an inverse relationship to intensification, likely because fast translational speed can lead to more significant asymmetry in the cyclone structure and inhibit intensification (e.g., Chen et al. 2006). However, previous studies for longer-time-interval analysis (>12 h) showed a positive relationship between TPSD and intensification (Lee et al. 2015), which may be explained by the fact that slow movement may lead to cold-water upwelling near the storm center and prevent intensification (e.g., Geisler 1970).

The R2 values for the OLS model with 13 predictors are about 0.26 for NA and 0.3 for WNP. (As a comparison, the R2 values for the OLS model with only the current intensity and last-step intensification as predictors are about 0.24 for NA and 0.22 for WNP.) These values for 6-h predictions are lower than those for 12-h predictions in the SHIPS (0.36 for NA; DeMaria and Kaplan 1999) and STIPS (0.4 for WNP; Knaff et al. 2005) models, as R2 tends to increase with increasing forecast window. Compared to the OLS method, the SLM approach succeeds in significantly reducing the number of predictors (from 13 to 5 for NA and to 8 for WNP) needed to retain similar R2 (0.24 for NA and 0.3 for NWP). When the nonlinear relationship is applied with the SGAM approach, more variables are selected (8 for NA and 11 for WNP), and the R2 values are slightly increased (0.26 for NA and 0.31 for NWP).

b. Mixture modeling

Mixture modeling using FMR LASSO [Eq. (6)] is performed for the DV predictand to capture the subpopulation heterogeneity and enhance the statistical modeling. We perform the analysis with three groups (k = 3) for both NA and WNP using the 13 potential predictor variables. The three groups that are defined based purely on statistical properties of the predictand and predictor variables present distinct physical features. As shown in Fig. 2, the first group is featured with little intensification or DV values centering around zero (“static,” in red), the second group with moderate intensification or DV taking relatively moderate positive and negative values (“normal,” in green), and the third group with rapid intensification/deintensification or large DV values in both the positive and negative directions (“extreme,” in blue). Note that the groups, especially the normal and extreme, have some areas of overlap, so it is not sufficient to define them solely by thresholds of DV. These three regimes of intensification also appear clearly as three phases in intensification during the lifetime of individual storms, as shown by two examples in Fig. 2. The statistically classified extreme intensification indicates “rapid intensification,” although the latter is often specifically defined for the positive increase of intensity over a longer time interval [e.g., at least 30-kt (15.4 m s−1) increase in the maximum sustained wind within 24 h or less; Kaplan and DeMaria (2003)].

Fig. 2.
Fig. 2.

FMR grouping results for the model of intensification (DV) using selected variables for (a) NA and (b) WNP, both using k = 3 groups. All observations of DV are plotted with colors denoting the groups. Sample storm time series for (c) NA and (d) WNP, with cluster assignments colored accordingly.

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

Table 3 lists the variables selected and regression statistics in the FMR LASSO analyses. For each group, the predictors that were selected appear in the order of statistical significance. Below the predictor lists are the statistics associated with each group. The weight for each group is in Eq. (6), calculated as the proportion of observations from the dataset that are optimally assigned to each group r. The mean and standard deviation of DV are calculated for each group using the observations in each group. The static group has a mean close to zero with a small standard deviation, the normal group has a moderately higher standard deviation, and the extreme group has the largest standard deviation, as also reflected by the DV observations colored by group in Fig. 2. In assessing the statistical performance of the models, R2 values are calculated for each group separately, and the total R2 considers all groups together. Compared to the previous analyses assuming a homogenous data structure (Table 2), FMR analysis increases the R2 values significantly (0.41 for NA and 0.49 for WNP) while using fewer predictor variables (five for NA and seven for WNP). This result indicates that TC intensification is a heterogeneous mixture with varying dependencies on the TC and environmental variables. Applying GAM to account for nonlinearity in the mixture model (MGAM) slightly increases the total R2 (0.43 for NA and 0.53 for WNP), as shown also in Table 3.

Table 3.

Mixture LASSO analyses for modeling intensification (DV) using k = 3 groups for NA and WNP. Variables selected (from the 13 variables in Table 2) are listed in their order of statistical significance, followed by the sign of their coefficient (for linear models). The group weight and mean and standard deviation of intensification for each group are shown. The R2 values for each group and for the total are shown for each of two models (FMR and MGAM).

Table 3.

In addition, compared to the homogenous models (Table 2), improvement is seen in the mixture models in matching with the physical understanding, or coefficient sign interpretability, of the relationship between the variables and intensification (Table 3). This may be due to the fact that fewer (possibly correlated) variables are selected, but it may also indicate that some physical understanding of predictors may apply only to certain groups or phases of the TC intensification. In addition to the persistent variables, MPI and SHR are selected for both basins. The variable U200 is shown to be significant for NA, while RHHI is important for WNP. It is noted that the static group models DV for NA as a pure Gaussian random variable and for WNP using only TSPD as a predictor, indicating that a TC that maintains a constant intensity largely ignores the environment represented by the applied predictors (however, the R2 value for the group is quite low). This result may also reflect the limitations of the data; the intensity values from the best-track data are rounded to the nearest 5 kt (2.58 m s−1), and thus some of the data points in the static group may be static only because of this rounding. After this group is separated out, the normal and also the extreme groups show much improved statistical relationships between the 6-h intensity change and the selected small number of storm and environmental predictors (compared to Table 2). However, it is important to note again that in calculating these R2 values, the correct group classification is assumed to assess the performance of the model in terms of capturing the statistical relationship between the predictand and predictor variables; to apply the model for prediction, one needs to first predict the group membership, which can induce significant uncertainty (see section 4).

c. Testing ventilation index (VI)

Instead of using many environmental variables, VI and TC intensity variables are explicitly selected as predictors to construct models for DV using multiple methods. In the dimensional analysis, we model DV using VI, V, and DVP. In both the OLS and GAM models, the R2 values are about 0.25 for NA and 0.23 for WNP. These R2 values are lower than those of the corresponding models using more predictors, especially for WNP, as shown in Table 2.

Next, we perform FMR, MGAM, and MNP analyses. To better visualize these mixture analysis results, we show the estimated function for each variable that contributes to the predictand for each group in Figs. 3 and 4 for NA and WNP, respectively. The red solid line shows the linear function from the FMR model, the solid blue curve gives the nonlinear function from the MGAM model, and the black solid curve represents the nonparametric function from the MNP model, for each predictor in each group. For instance, the top-left panel in Fig. 3 is the function f(VI), which, for each value of VI, gives a value that contributes to the predictand DV in the first group in the NA analysis. In most cases, the linear function appears to be a simplified trend of the nonlinear and nonparametric functions, which can also capture local variations. Large uncertainties and differences in the models are apparent mainly in the regions of sparse observations (see gray hash marks). Consistent with the VI theory (Tang and Emanuel 2012), VI has generally a negative correlation with intensification in all groups for both NA and WNP. Previous intensification (DVp) is positively correlated with intensification, as expected. Although the current intensity V is expected to negatively correlate with intensification, exceptions occur for the static group for WNP, likely because of statistical compensation effects. The signs of the coefficients of the linear models are also shown in Table 4, as are the main statistics.

Fig. 3.
Fig. 3.

Functions for each predictor in the mixture OLS (FMR; red), mixture GAM (MGAM; blue), and mixture NP (MNP; black) models for intensification (DV) in NA. (top) The group 1 (static) functions, (middle) the group 2 (normal) functions, and (bottom) the group 3 (extreme) functions. Dashed blue lines give the 95% confidence interval for the MGAM functions, and the gray hashes along the top axes indicate the locations of the observations.

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

Fig. 4.
Fig. 4.

As in Fig. 3, but for WNP.

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

Table 4.

As in Table 3, but here the VI and TC intensity variables are explicitly selected as predictors and MNP analysis results are also shown.

Table 4.

In this case using VI as the only environmental predictor, the R2 values of the FMR model (0.41 for NA and 0.46 for WNP) and of the MGAM model (0.44 for NA and 0.52 for WNP) are similar to those using more environmental variables (see Table 3), indicating that VI is a dominate variable for storm intensification. However, considering that the R2 values are reduced in the OLS and GAM models when using VI, this result indicates that the heterogeneous feature is more apparent in the data when using VI to predict TC intensification. The MNP modeling, which accounts for local variability, further increases the R2 values (0.49 for NA and 0.58 for WNP).

In the nondimensional analysis, we model d(V/MPI) using VI, V/MPI, and d(V/MPI)p, following the modeling framework of Tang and Emanuel (2012). Generally, a positive d(V/MPI) means that a storm is intensifying since MPI is relatively slowly varying in time and space. Similar to the dimensional analysis results, the simple OLS and GAM models do not perform as well as those using other environmental variables, with R2 values of only about 0.24 for both NA and WNP.

Mixture regression analyses are performed on the nondimensional data. Table 5 shows the results for the three new groups determined for the nondimensional predictand d(V/MPI) for each ocean basin. Given the nondimensional form, the three groups are no longer clearly distinguished as the static, normal, and extreme clusters; the groups have quite close values of the standard deviation of the predictand for NA. Most signs of coefficients are as expected; namely, d(V/MPI) is associated positively with d(V/MPI)p and negatively with V/MPI and VI. But VI shows positive correlation with intensification for groups 2 and 3 for WNP, and V/MPI shows positive correlation with intensification for group 3 for NA, as a result of statistical compensation effects and possibly also other effects such as ocean mixing that we do not consider here. It is noted that the total R2 values are significantly increased (0.7–0.74 for NA and 0.49–0.62 for WNP) in the nondimensional analysis with VI, compared to the dimensional analysis (see Table 4), indicating that the VI effect may be better represented in a nondimensional model.

Table 5.

As in Table 4, but for modeling nondimensional intensification d(V/MPI) using nondimensional TC intensity variables.

Table 5.

d. Comparing the predictability of significant variables using nonparametric analysis

It is thus interesting to investigate how the specific nonlinear function of TC intensification derived theoretically based on the VI theory (Tang and Emanuel 2012) would fit with the real data. Tang and Emanuel (2012;,their Fig. 7) show an excellent comparison of the observed and theoretically predicted 24-h normalized intensification [d(V/MPI)] as a function of VI and normalized intensity (V/MPI). It is noted that, to capture the main features in the comparison between the observation and theory, the observational data in their figure are binned (i.e., average value of the predictand is taken within the bin grid of the predictor space). Here, we plot a similar binned figure for 6-h intensification, on which we focus in this study, for the NA data (Fig. 5a). A pattern similar to that predicted by the theoretical function is obtained [note that the time interval over which the intensification occurs is ambiguous in the theory; Tang and Emanuel (2012)]. Statistical regression using the functional form from the theory on the binned data gives high R2 values. In fact, even a simple linear model gives a similarly high R2 value of 0.6 for the 6-h intensification data (and 0.64 for 24-h intensification data). However, this result is heavily dependent on the choice of the bin width. The R2 values could drop to less than 0.1 if the bin width becomes very small. This possibility exists because the original data of 6-h intensification, as shown by the scatterplot in Fig. 5b, are very “noisy.” Without the averaging/smoothing, the noise even dominates and d(V/MPI) can no longer be explained by a simple linear function or even the theoretical nonlinear function of VI and V/MPI. When we apply the nonparametric modeling (without grouping) to the 6-h normalized intensification [d(V/MPI)] as a function of VI, normalized intensity (V/MPI), as well as previous intensification [d(V/MPI)p], we obtained R2 values of 0.31 for NA and, curiously, as high as 0.54 for WNP.

Fig. 5.
Fig. 5.

Comparison of (a) bin-averaged and (b) scatterplot of intensification [d(V/MPI)] as a function of V/MPI and VI for NA. In (a), the VI axis is divided logarithmically into 30 grids between 0.001 and 1, and the V/MPI axis is divided evenly into 24 grids between 0 and 1.2. Bins with sample sizes less than three are omitted.

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

To further compare the predictability of VI, its components, and other previously identified significant variables, we perform a series of nonparametric modeling analyses (without grouping and in dimensional forms) of 6-h intensification with these predictors, as shown in Table 6. (OLS and GMA models are also applied in parallel, but they perform less well than NP for all cases and thus are not shown.) First, compared to the nondimensional modeling discussed above, the dimensional VI model (model 2) performs similarly (in terms of the R2 value) for NA but less well for WNP. VI is shown to perform better (model 2) than MPI, SHR, or ED (models 3–5), which are the three components of VI. The model with VI (model 2) is also comparable to the model with all three component variables of VI (model 9). Applying the three component variables provides a statistically better model than applying VI, because, as mentioned above, the real data are noisy, and applying the three variables separately provides a greater degree of freedom for statistical fitting. We also test RHHI in place of ED. RHHI performs less well than ED when applied as the sole environmental variable or with MPI or SHR as the other environmental variable (models 10–12 compared to models 3 and 7–8). When RHHI is applied in place of ED with both MPI and SHR, the results are similar (R2 slightly lower for NA and slightly higher for WNP; model 13 compared to model 9), as the significance of ED/RHHI is reduced when both MPI and SHR are applied. Finally, we add U200, which may not affect TC intensification in a direct, physical way as do the other discussed variables but has been shown to be statistically significant. Adding U200 significantly improves R2 in all models for both NA and WNP (models 14–20); however, the role U200 plays in controlling TC intensification still calls for further investigation. The model with six predictors (V, DVP, MPI, ED, SHR, and U200) gives the highest R2 values (about 0.37 for NA and 0.36 for WNP; model 20) among these nonparametric models.

Table 6.

Comparison of nonparametric analyses using different significant variables to model intensification (DV) for NA and WNP. The plus sign (+) denotes a variable combination, and the R2 value is shown.

Table 6.

4. Discussion

The mixture regression analyses reveal the heterogeneous properties of the data and provide models that better explain the statistical relationship between storm intensification and the environmental and storm predictors. However, the probability of belonging to a group, or the proportion , does not depend on the predictors X in the current FMR or FMR LASSO, so the mixture model is not readily a predictive model (i.e., the heterogeneity cannot be directly predicted). To add the predictive capability to the mixture models, therefore, we build classification models using classic methods such as multinomial logistic regression and probit regression. Such a model determines the probability of a new observation X belonging to each of the groups as a function of X. Thus, for a new observation, the prediction (of storm intensification) can be taken according to the group model with the highest probability or as a probability-weighted average of the group model predictions. For evaluation, a predictive R2 can be calculated using the predicted group assignments. The value of the predictive R2, which accounts for the uncertainty in assigning the group to a new observation, should be lower than that of the standard R2, which is calculated given the optimized group assignment.

As a result, the predictive R2 is greatly reduced (to below 0.3), compared to the standard R2 (0.41–0.74), for all mixture models presented in section 3. To investigate where the most significant uncertainties are introduced, we employ a loss function to quantify the behavior of the classification model, or the accuracy of the group reassignment. The loss function of observation i is designed to be , where is the probability based on the classification model that the observation i belongs to group r and is the indicator function equal to 1 if i belongs to group r or 0 if not, according to the actual (optimized) group assignment. Thus, the lower the probability assigned to the right group based on the classification model, the larger the loss. Figure 6 shows an example of the calculated loss for one mixture model with logistic regression; similar results are obtained for other mixture models in section 3 and for using both the logistic and multinomial regression methods.

Fig. 6.
Fig. 6.

Example of the loss function of the group reassignment using logistic regression (for the dimensional mixture model with the VI predictor for the NA dataset; Table 4).

Citation: Monthly Weather Review 145, 7; 10.1175/MWR-D-16-0368.1

The calculated loss function indicates that the group assignment has the highest accuracy for the normal group 2 observations, followed by the static group 1 (which is affected by data accuracy as discussed before). The extreme group 3 observations are often assigned to an incorrect group, which is the main reason that the overall predictive R2 is greatly reduced. This result indicates that the selected predictors have limited predictability for the occurrence of rapid intensification. One reason for this limitation may be that oceanic variables are not explicitly included in this study focusing on the large-scale environmental factors. However, Kaplan et al. (2010) also obtain only low-to-modest predictability of RI occurrence even when the ocean heat content and other satellite-derived variables were added as additional predictors. Kaplan et al. (2010) highlight the difficulty of predicting RI occurrence and suggest further examining other predictors, especially those related to the inner-core process. Various new predictors related to oceans, inner-core processes, and storm structures are continuously being explored and added to the operational forecasting of RI (Kaplan et al. 2015).

For the purpose of prediction, the best model we obtained is the nonparametric model with six predictors (V, DVP, MPI, ED, SHR, and U200) for NA and the nonparametric VI model in the nondimensional form for WNP. The nonparametric regression, which often requires larger sample sizes than parametric regression, actually accounts for the heterogeneity of the data. In the kernel regression, the prediction Y for a new observation of predictors X is essentially a weighted average of the y observations in the dataset with the weights depending on the new observation [Eqs. (7) and (8)]. As the predictors applied in the NP analysis are similar to those in the mixture models, it is likely that the extreme intensification is not well modeled either in the NP analysis. Here, oceanic and inner-core-process variables should also be explored in future studies.

In addition, the predictability of these models may be improved by using longer-time-interval or “smoothed” intensity change predictands. For example, the intensity change as well as the likelihood of rapid intensification over a 24-h interval may be predicted better statistically, as shown by previous studies (DeMaria and Kaplan 1999; Knaff et al. 2005; Lee et al. 2015; Kaplan et al. 2015). Also relevant is the “intensification tendency,” which is calculated as the linear regression coefficient of the wind intensity over six successive 6-hourly steps starting from the current time (Lloyd and Vecchi 2011). These longer-time-window intensity changes are less affected by data accuracy and precision, and by smoothing out the (possibly physical) noise, they may reflect better the temporal scale of the TC intensification in response to the atmospheric and oceanic conditions. In forecasting and risk analysis, however, additional models may be needed to predict shorter-time-interval intensity changes from the longer-time-interval estimates.

5. Summary

In this study, we have explored the dependence of TC intensification on the environment through various statistical modeling approaches. The NA and WNP TC observations from the IBTrACS WMO archive and surrounding environmental variables from the ERA-Interim over 1979–2014 were used. The developed statistical models estimate the 6-h intensity change (predictand) given the environmental and storm variables (predictors).

First, the simplest multiple linear regression model using 13 TC and environmental variables informed by the operational SHIPS and STIPS models obtained statistical R2 values of about 0.26 for NA and 0.3 for WNP. The variable selection technique LASSO was applied to identify the critical predictors simultaneously; the analysis shows that intensification is favored if the storm has been intensifying, has a low intensity, and is surrounded by an environment that has high MPI, low wind shear, high upper-level relative humidity, and high-level zonal winds that are more easterly than normal, consistent with previous studies. The SLM model, which applies linear regression to LASSO-selected variables, succeeds in significantly reducing the number of predictors (from 13 to 5 for NA and to 8 for WNP) needed to retain similar R2 results (0.24 for NA and 0.3 for NWP). When the nonlinear relationship is applied with the SGAM approach, more variables (8 for NA and 11 for NWP) are selected and the R2 values are slightly increased (0.26 for NA and 0.31 for NWP).

Second, mixture LASSO modeling was performed to capture the subpopulation heterogeneity and enhance the statistical modeling. The modeling separates the data into subgroups based on the statistical properties of the predictand and predictor variables, selects critical predictors for each group, and develops the regression model for each group. The statistical analysis identified three intensification regimes: static, normal, and extreme, reflecting observed physical features of intensification during a storm’s life cycle. The mixture modeling significantly increased the R2 values (0.41 with linear modeling and 0.43 with nonlinear modeling for NA; 0.49 with linear modeling and 0.53 with nonlinear modeling for WNP) with greatly reduced numbers of predictors (five for NA and seven for WNP). However, the mixture model is not readily a predictive model, and a classification model is needed to assign the group membership for a new observation of predictors. When a classic classification model such as the multinomial logistic regression or probit regression was added, the overall predictive R2 values of the mixture models were reduced to below 0.3. The main reason for this significant reduction in the predictability of the mixture models is that the applied predictors, which are mainly large-environmental variables, are limited in their ability to predict the occurrence of extreme/rapid intensification.

Third, the progression of analyses from linear, nonlinear, to mixture modeling was applied to test VI as the environmental predictor in both dimensional and nondimensional forms. The homogenous linear and nonlinear models obtained relatively low R2 values (0.25 for NA and 0.23 for WNP in dimensional analyses and 0.24 for NA and WNP in nondimensional analyses). However, the R2 values were greatly improved when the mixture modeling was applied (0.41/0.7 with linear modeling, 0.44/0.71 with nonlinear modeling, and 0.49/0.74 with nonparametric modeling for NA in dimensional/nondimensional analyses; 0.46/0.49 with linear modeling, 0.52/0.49 with nonlinear modeling, and 0.58/0.62 with nonparametric modeling for WNP). These analysis results indicate that VI is a dominant environmental factor for TC intensification, more so in the nondimensional form than the dimensional form, but its effect on TC intensification is quite heterogeneous and nonlinear. However, when a classic classification model was added, the overall predictive R2 values of the VI mixture models were also reduced to below 0.3.

Finally, the nonparametric method was applied to the analysis of VI, its component variables, and other variables highlighted by the variable selection analysis. We found that VI, as a theoretically based combination of three significant environmental variables (MPI, SHR, and ED), can be conveniently considered to be a single environmental variable for intensification analysis. However, applying the three component variables separately may provide a better model statistically because the real data is very noisy and applying the three variables separately provides a greater degree of freedom for statistical fitting. The simpler RHHI represents ED relatively well statistically. Adding U200 significantly improves the predictability of the statistical models. The nonparametric model with six predictors (V, DVP, MPI, ED, SHR, and U200) gives relatively high predictive R2 values (0.37 for NA and 0.36 for WNP). It was also found that nonparametric modeling with VI in the nondimensional form gives an R2 value as high as 0.54 for WNP. The reason behind this high statistical performance and how to apply nondimensional analysis involving other predictors requires further investigation.

This work has helped to better explain the relationship between TC intensification and the surrounding environment by exploring new ways to connect them statistically. We have come up with several viable alternatives to using the simple linear regression models that depend on a long list of environmental variables. We have narrowed down the essential predictors to a smaller pool that is more favorable for real-time forecasting and risk modeling. In contrast to Lee et al. (2015) and the SHIPS (DeMaria and Kaplan 1999) and STIPS (Knaff et al. 2005) models, we applied new variable selection techniques, employed methods to take into account the nonlinear effects of the predictors, and investigated different subgroups of data that can align with a physical understanding. Also unique to any statistical modeling of TC intensity, we have incorporated the new variable VI and carefully examined its application. Tang and Emanuel (2012) motivated its use with physics and provided supporting example cases. We tested its use in formal statistical modeling.

The predictability of the mixture and nonparametric models may be further improved by adding other predictors. In our ongoing work, ocean variables (Schade and Emanuel 1999) are being added to the predictor pool, and the effects of the ocean on other variables like MPI (Lin et al. 2013; Balaguru et al. 2015) are being incorporated. Longer-time-interval (e.g., 24-h intensity change) and “smoothed” (e.g., intensification tendency) predictands are also being investigated. The results of these efforts will be reported upon in the near future. The next step of this work is to use the models for the simulation of TC intensity. Simulations may be compared to real storms as further evaluation of comparable models. Matters of initialization, termination, overland behavior, and extratropical characteristics must be considered for simulations.

Acknowledgments

This study is supported by Grants 1514606 from the National Science Foundation and NA14OAR4320106 from the National Oceanic and Atmospheric Administration, U.S. Department of Commerce. The statements, findings, conclusions, and recommendations herein are those of the authors and do not necessarily reflect the views of the National Science Foundation, the National Oceanic and Atmospheric Administration, or the U.S. Department of Commerce. We thank Brian Tang for helping us with the calculation of the ventilation index and providing useful knowledge of its properties. We also thank Daniel Chavas and two anonymous reviewers for their very helpful comments.

REFERENCES

  • Balaguru, K., G. R. Foltz, L. R. Leung, E. D. Asaro, K. A. Emanuel, H. Liu, and S. E. Zedler, 2015: Dynamic potential intensity: An improved representation of the ocean’s impact on tropical cyclones. Geophys. Res. Lett., 42, 67396746, doi:10.1002/2015GL064822.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bister, M., and K. A. Emanuel, 1998: Dissipative heating and hurricane intensity. Meteor. Atmos. Phys., 65, 233240, doi:10.1007/BF01030791.

  • Camargo, S. J., A. W. Robertson, S. J. Gaffney, P. Smyth, and M. Ghil, 2007: Cluster analysis of typhoon tracks. Part I: General properties. J. Climate, 20, 36353653, doi:10.1175/JCLI4188.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chavas, D., E. Yonekura, C. Karamperidou, N. Cavanaugh, and K. Serafin, 2013: US hurricanes and economic damage: Extreme value perspective. Nat. Hazards Rev., 14, 237246, doi:10.1061/(ASCE)NH.1527-6996.0000102.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chen, S. S., J. A. Knaff, and F. D. Marks Jr., 2006: Effects of vertical wind shear and storm motion on tropical cyclone rainfall asymmetries deduced from TRMM. Mon. Wea. Rev., 134, 31903208, doi:10.1175/MWR3245.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dee, D. P., and Coauthors, 2011: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Quart. J. Roy. Meteor. Soc., 137, 553597, doi:10.1002/qj.828.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., 1996: The effect of vertical shear on tropical cyclone intensity change. J. Atmos. Sci., 53, 20762088, doi:10.1175/1520-0469(1996)053<2076:TEOVSO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., 2009: A simplified dynamical system for tropical cyclone intensity prediction. Mon. Wea. Rev., 137, 6882, doi:10.1175/2008MWR2513.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., and J. Kaplan, 1999: An updated Statistical Hurricane Intensity Prediction Scheme (SHIPS) for the Atlantic and eastern North Pacific basins. Wea. Forecasting, 14, 326337, doi:10.1175/1520-0434(1999)014<0326:AUSHIP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., M. Mainelli, and L. K. Shay, 2005: Further improvements to the Statistical Hurricane Intensity Prediction Scheme (SHIPS). Wea. Forecasting, 20, 531543, doi:10.1175/WAF862.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Elsberry, R. L., T. D. B. Lambert, and M. A. Boothe, 2007: Accuracy of Atlantic and eastern North Pacific tropical cyclone intensity forecast guidance. Wea. Forecasting, 22, 747762, doi:10.1175/WAF1015.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., 1995: The behavior of a simple hurricane model using a convective scheme based on subcloud-layer entropy equilibrium. J. Atmos. Sci., 52, 39603968, doi:10.1175/1520-0469(1995)052<3960:TBOASH>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., C. DesAutels, C. Holloway, and R. Korty, 2004: Environmental control of tropical cyclone intensity. J. Atmos. Sci., 61, 843858, doi:10.1175/1520-0469(2004)061<0843:ECOTCI>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., S. Ravela, E. Vivant, and C. Risi, 2006: A statistical deterministic approach to hurricane risk assessment. Bull. Amer. Meteor. Soc., 87, 299314, doi:10.1175/BAMS-87-3-299.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fan, J., and I. Gijbels, 1996: Local Polynomial Modelling and Its Applications. Chapman and Hall, 341 pp.

  • Friedman, J., T. Hastie, and R. Tibshirani, 2010: Regularization paths for generalized linear models via coordinate descent. J. Stat. Software, 33, doi:10.18637/jss.v033.i01.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gaffney, S. J., A. W. Robertson, P. Smyth, S. J. Camargo, and M. Ghil, 2007: Probabilistic clustering of extratropical cyclones using regression mixture models. Climate Dyn., 29, 423440, doi:10.1007/s00382-007-0235-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Geisler, J. E., 1970: Linear theory on the response of a two layer ocean to a moving hurricane. Geophys. Fluid Dyn., 1, 249272, doi:10.1080/03091927009365774.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hall, T. M., and S. Jewson, 2007: Statistical modeling of North Atlantic tropical cyclone tracks. Tellus, 59A, 486498, doi:10.1111/j.1600-0870.2007.00240.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hall, T. M., and E. Yonekura, 2013: North American tropical cyclone landfall and SST: A statistical model study. J. Climate, 26, 84228439, doi:10.1175/JCLI-D-12-00756.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hastie, T. J., and R. J. Tibshirani, 1990: Generalized Additive Models. Monographs on Statistics and Applied Probability, Vol. 43, CRC Press, 335 pp.

  • Hayfield, T., and J. S. Racine, 2008: Nonparametric econometrics: The np package. J. Stat. Software, 27, doi:10.18637/jss.v027.i05.

  • Huang, J., J. L. Horowitz, and F. Wei, 2010: Variable selection in nonparametric additive models. Ann. Stat., 38, 22822313, doi:10.1214/09-AOS781.

  • James, M. K., and L. B. Mason, 2005: Synthetic tropical cyclone database. J. Waterway, Port, Ocean Eng., 131, 181192, doi:10.1061/(ASCE)0733-950X(2005)131:4(181).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kantha, L., 2006: Time to replace the Saffir–Simpson hurricane scale? Eos, Trans. Amer. Geophys. Union, 87, 36, doi:10.1029/2006EO010003.

  • Kantha, L., 2008: Tropical cyclone destruction potential by integrated kinetic energy. Bull. Amer. Meteor. Soc., 89, 219221, doi:10.1175/BAMS-89-2-219.

    • Search Google Scholar
    • Export Citation
  • Kaplan, J., and M. DeMaria, 2003: Large-scale characteristics of rapidly intensifying tropical cyclones in the North Atlantic basin. Wea. Forecasting, 18, 10931108, doi:10.1175/1520-0434(2003)018<1093:LCORIT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kaplan, J., M. DeMaria, and J. A. Knaff, 2010: A revised tropical cyclone rapid intensification index for the Atlantic and eastern North Pacific basins. Wea. Forecasting, 25, 220241, doi:10.1175/2009WAF2222280.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kaplan, J., and Coauthors, 2015: Evaluating environmental impacts on tropical cyclone rapid intensification predictability utilizing statistical models. Wea. Forecasting, 30, 13741396, doi:10.1175/WAF-D-15-0032.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knaff, J. A., C. R. Sampson, and M. DeMaria, 2005: An operational statistical typhoon intensity prediction scheme for the western North Pacific. Wea. Forecasting, 20, 688699, doi:10.1175/WAF863.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knapp, K. R., M. C. Kruk, D. H. Levinson, H. J. Diamond, and C. J. Neumann, 2010: The International Best Track Archive for Climate Stewardship (IBTrACS): Unifying tropical cyclone data. Bull. Amer. Meteor. Soc., 91, 363376, doi:10.1175/2009BAMS2755.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, C.-Y., M. K. Tippett, S. J. Camargo, and A. H. Sobel, 2015: Probabilistic multiple-linear regression modeling for tropical cyclone intensity. Mon. Wea. Rev., 143, 933954, doi:10.1175/MWR-D-14-00171.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, C.-Y., M. K. Tippett, A. H. Sobel, and S. J. Camargo, 2016: Rapid intensification and the bimodal distribution of tropical cyclone intensity. Nat. Commun., 7, 10625, doi:10.1038/ncomms10625.

    • Search Google Scholar
    • Export Citation
  • Lin, I. I., and Coauthors, 2013: An ocean coupling potential intensity index for tropical cyclones. Geophys. Res. Lett., 40, 18781882, doi:10.1002/grl.50091.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lin, N., and D. Chavas, 2012: On hurricane parametric wind and applications in storm surge modeling. J. Geophys. Res., 117, D09120, doi:10.1029/2011JD017126.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lin, N., and K. Emanuel, 2016: Grey swan tropical cyclones. Nat. Climate Change, 6, 106111, doi:10.1038/nclimate2777.

  • Lloyd, I. D., and G. A. Vecchi, 2011: Observational evidence for oceanic controls on hurricane intensity. J. Climate, 24, 11381153, doi:10.1175/2010JCLI3763.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • McLachlan, G. J., and T. Krishnan, 1997: The EM Algorithm and Extensions. John Wiley and Sons, 274 pp.

  • Musgrave, K. D., R. K. Taft, J. L. Vigh, B. D. McNoldy, and W. H. Schubert, 2012: Time evolution of the intensity and size of tropical cyclones. J. Adv. Model. Earth Syst., 4, M08001, doi:10.1029/2011MS000104.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Owens, B. and G. J. Holland, 2009: The Willis hurricane index. Second Int. Summit on Hurricanes and Climate Change, Corfu, Greece.

  • Price, J. F., 2009: Metrics of hurricane–ocean interaction: Vertically-integrated or vertically-averaged ocean temperature? Ocean Sci., 5, 351368, doi:10.5194/os-5-351-2009.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schade, L. R., and K. A. Emanuel, 1999: The ocean’s effect on the intensity of tropical cyclones: Results from a simple coupled atmosphere–ocean model. J. Atmos. Sci., 56, 642651, doi:10.1175/1520-0469(1999)056<0642:TOSEOT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Simon, N., J. Friedman, T. Hastie, and R. Tibshirani, 2013: A sparse-group lasso. J. Comput. Graph. Stat., 22, 231245, doi:10.1080/10618600.2012.681250.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Städler, N., P. Bühlmann, and S. Van de Geer, 2010: 1-penalization for mixture regression models. TEST, 19, 209256, doi:10.1007/s11749-010-0197-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tang, B., and K. E. Emanuel, 2012: A ventilation index for tropical cyclones. Bull. Amer. Meteor. Soc., 93, 19011912, doi:10.1175/BAMS-D-11-00165.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tibshirani, R., 1996: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc., 58B, 267288.

  • Vickery, P. J., P. F. Skerlj, and L. A. Twisdale, 2000: Simulation of hurricane risk in the U.S. using an empirical track model. J. Struct. Eng., 126, 12221237, doi:10.1061/(ASCE)0733-9445(2000)126:10(1222).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Vickery, P. J., D. Wadhera, L. Twisdale Jr., and F. Lavelle, 2009: U.S. hurricane wind speed risk and uncertainty. J. Struct. Eng., 135, 301320, doi:10.1061/(ASCE)0733-9445(2009)135:3(301).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yang, Y., and H. Zou, 2015: A fast unified algorithm for solving group-lasso penalize learning problems. Stat. Comput., 25, 11291141, doi:10.1007/s11222-014-9498-5.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yonekura, E., and T. M. Hall, 2011: A statistical model of tropical cyclone tracks in the western North Pacific with ENSO-dependent cyclogenesis. J. Appl. Meteor. Climatol., 50, 17251739, doi:10.1175/2011JAMC2617.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yuan, M., and Y. Lin, 2006: Model selection and estimation in regression with grouped variables. J. Roy. Stat. Soc., 68B, 4967, doi:10.1111/j.1467-9868.2005.00532.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhang, C. H., and J. Huang, 2008: The sparsity and bias of the lasso selection in high-dimensional linear regression. Ann. Stat., 36, 15671594, doi:10.1214/07-AOS520.

    • Crossref
    • Search Google Scholar
    • Export Citation
Save
  • Balaguru, K., G. R. Foltz, L. R. Leung, E. D. Asaro, K. A. Emanuel, H. Liu, and S. E. Zedler, 2015: Dynamic potential intensity: An improved representation of the ocean’s impact on tropical cyclones. Geophys. Res. Lett., 42, 67396746, doi:10.1002/2015GL064822.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bister, M., and K. A. Emanuel, 1998: Dissipative heating and hurricane intensity. Meteor. Atmos. Phys., 65, 233240, doi:10.1007/BF01030791.

  • Camargo, S. J., A. W. Robertson, S. J. Gaffney, P. Smyth, and M. Ghil, 2007: Cluster analysis of typhoon tracks. Part I: General properties. J. Climate, 20, 36353653, doi:10.1175/JCLI4188.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chavas, D., E. Yonekura, C. Karamperidou, N. Cavanaugh, and K. Serafin, 2013: US hurricanes and economic damage: Extreme value perspective. Nat. Hazards Rev., 14, 237246, doi:10.1061/(ASCE)NH.1527-6996.0000102.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chen, S. S., J. A. Knaff, and F. D. Marks Jr., 2006: Effects of vertical wind shear and storm motion on tropical cyclone rainfall asymmetries deduced from TRMM. Mon. Wea. Rev., 134, 31903208, doi:10.1175/MWR3245.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dee, D. P., and Coauthors, 2011: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Quart. J. Roy. Meteor. Soc., 137, 553597, doi:10.1002/qj.828.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., 1996: The effect of vertical shear on tropical cyclone intensity change. J. Atmos. Sci., 53, 20762088, doi:10.1175/1520-0469(1996)053<2076:TEOVSO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., 2009: A simplified dynamical system for tropical cyclone intensity prediction. Mon. Wea. Rev., 137, 6882, doi:10.1175/2008MWR2513.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., and J. Kaplan, 1999: An updated Statistical Hurricane Intensity Prediction Scheme (SHIPS) for the Atlantic and eastern North Pacific basins. Wea. Forecasting, 14, 326337, doi:10.1175/1520-0434(1999)014<0326:AUSHIP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DeMaria, M., M. Mainelli, and L. K. Shay, 2005: Further improvements to the Statistical Hurricane Intensity Prediction Scheme (SHIPS). Wea. Forecasting, 20, 531543, doi:10.1175/WAF862.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Elsberry, R. L., T. D. B. Lambert, and M. A. Boothe, 2007: Accuracy of Atlantic and eastern North Pacific tropical cyclone intensity forecast guidance. Wea. Forecasting, 22, 747762, doi:10.1175/WAF1015.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., 1995: The behavior of a simple hurricane model using a convective scheme based on subcloud-layer entropy equilibrium. J. Atmos. Sci., 52, 39603968, doi:10.1175/1520-0469(1995)052<3960:TBOASH>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., C. DesAutels, C. Holloway, and R. Korty, 2004: Environmental control of tropical cyclone intensity. J. Atmos. Sci., 61, 843858, doi:10.1175/1520-0469(2004)061<0843:ECOTCI>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K. A., S. Ravela, E. Vivant, and C. Risi, 2006: A statistical deterministic approach to hurricane risk assessment. Bull. Amer. Meteor. Soc., 87, 299314, doi:10.1175/BAMS-87-3-299.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fan, J., and I. Gijbels, 1996: Local Polynomial Modelling and Its Applications. Chapman and Hall, 341 pp.

  • Friedman, J., T. Hastie, and R. Tibshirani, 2010: Regularization paths for generalized linear models via coordinate descent. J. Stat. Software, 33, doi:10.18637/jss.v033.i01.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gaffney, S. J., A. W. Robertson, P. Smyth, S. J. Camargo, and M. Ghil, 2007: Probabilistic clustering of extratropical cyclones using regression mixture models. Climate Dyn., 29, 423440, doi:10.1007/s00382-007-0235-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Geisler, J. E., 1970: Linear theory on the response of a two layer ocean to a moving hurricane. Geophys. Fluid Dyn., 1, 249272, doi:10.1080/03091927009365774.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hall, T. M., and S. Jewson, 2007: Statistical modeling of North Atlantic tropical cyclone tracks. Tellus, 59A, 486498, doi:10.1111/j.1600-0870.2007.00240.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hall, T. M., and E. Yonekura, 2013: North American tropical cyclone landfall and SST: A statistical model study. J. Climate, 26, 84228439, doi:10.1175/JCLI-D-12-00756.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hastie, T. J., and R. J. Tibshirani, 1990: Generalized Additive Models. Monographs on Statistics and Applied Probability, Vol. 43, CRC Press, 335 pp.

  • Hayfield, T., and J. S. Racine, 2008: Nonparametric econometrics: The np package. J. Stat. Software, 27, doi:10.18637/jss.v027.i05.

  • Huang, J., J. L. Horowitz, and F. Wei, 2010: Variable selection in nonparametric additive models. Ann. Stat., 38, 22822313, doi:10.1214/09-AOS781.

  • James, M. K., and L. B. Mason, 2005: Synthetic tropical cyclone database. J. Waterway, Port, Ocean Eng., 131, 181192, doi:10.1061/(ASCE)0733-950X(2005)131:4(181).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kantha, L., 2006: Time to replace the Saffir–Simpson hurricane scale? Eos, Trans. Amer. Geophys. Union, 87, 36, doi:10.1029/2006EO010003.

  • Kantha, L., 2008: Tropical cyclone destruction potential by integrated kinetic energy. Bull. Amer. Meteor. Soc., 89, 219221, doi:10.1175/BAMS-89-2-219.

    • Search Google Scholar
    • Export Citation
  • Kaplan, J., and M. DeMaria, 2003: Large-scale characteristics of rapidly intensifying tropical cyclones in the North Atlantic basin. Wea. Forecasting, 18, 10931108, doi:10.1175/1520-0434(2003)018<1093:LCORIT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kaplan, J., M. DeMaria, and J. A. Knaff, 2010: A revised tropical cyclone rapid intensification index for the Atlantic and eastern North Pacific basins. Wea. Forecasting, 25, 220241, doi:10.1175/2009WAF2222280.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kaplan, J., and Coauthors, 2015: Evaluating environmental impacts on tropical cyclone rapid intensification predictability utilizing statistical models. Wea. Forecasting, 30, 13741396, doi:10.1175/WAF-D-15-0032.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knaff, J. A., C. R. Sampson, and M. DeMaria, 2005: An operational statistical typhoon intensity prediction scheme for the western North Pacific. Wea. Forecasting, 20, 688699, doi:10.1175/WAF863.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knapp, K. R., M. C. Kruk, D. H. Levinson, H. J. Diamond, and C. J. Neumann, 2010: The International Best Track Archive for Climate Stewardship (IBTrACS): Unifying tropical cyclone data. Bull. Amer. Meteor. Soc., 91, 363376, doi:10.1175/2009BAMS2755.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, C.-Y., M. K. Tippett, S. J. Camargo, and A. H. Sobel, 2015: Probabilistic multiple-linear regression modeling for tropical cyclone intensity. Mon. Wea. Rev., 143, 933954, doi:10.1175/MWR-D-14-00171.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, C.-Y., M. K. Tippett, A. H. Sobel, and S. J. Camargo, 2016: Rapid intensification and the bimodal distribution of tropical cyclone intensity. Nat. Commun., 7, 10625, doi:10.1038/ncomms10625.

    • Search Google Scholar
    • Export Citation
  • Lin, I. I., and Coauthors, 2013: An ocean coupling potential intensity index for tropical cyclones. Geophys. Res. Lett., 40, 18781882, doi:10.1002/grl.50091.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lin, N., and D. Chavas, 2012: On hurricane parametric wind and applications in storm surge modeling. J. Geophys. Res., 117, D09120, doi:10.1029/2011JD017126.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lin, N., and K. Emanuel, 2016: Grey swan tropical cyclones. Nat. Climate Change, 6, 106111, doi:10.1038/nclimate2777.

  • Lloyd, I. D., and G. A. Vecchi, 2011: Observational evidence for oceanic controls on hurricane intensity. J. Climate, 24, 11381153, doi:10.1175/2010JCLI3763.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • McLachlan, G. J., and T. Krishnan, 1997: The EM Algorithm and Extensions. John Wiley and Sons, 274 pp.

  • Musgrave, K. D., R. K. Taft, J. L. Vigh, B. D. McNoldy, and W. H. Schubert, 2012: Time evolution of the intensity and size of tropical cyclones. J. Adv. Model. Earth Syst., 4, M08001, doi:10.1029/2011MS000104.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Owens, B. and G. J. Holland, 2009: The Willis hurricane index. Second Int. Summit on Hurricanes and Climate Change, Corfu, Greece.

  • Price, J. F., 2009: Metrics of hurricane–ocean interaction: Vertically-integrated or vertically-averaged ocean temperature? Ocean Sci., 5, 351368, doi:10.5194/os-5-351-2009.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schade, L. R., and K. A. Emanuel, 1999: The ocean’s effect on the intensity of tropical cyclones: Results from a simple coupled atmosphere–ocean model. J. Atmos. Sci., 56, 642651, doi:10.1175/1520-0469(1999)056<0642:TOSEOT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Simon, N., J. Friedman, T. Hastie, and R. Tibshirani, 2013: A sparse-group lasso. J. Comput. Graph. Stat., 22, 231245, doi:10.1080/10618600.2012.681250.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Städler, N., P. Bühlmann, and S. Van de Geer, 2010: 1-penalization for mixture regression models. TEST, 19, 209256, doi:10.1007/s11749-010-0197-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tang, B., and K. E. Emanuel, 2012: A ventilation index for tropical cyclones. Bull. Amer. Meteor. Soc., 93, 19011912, doi:10.1175/BAMS-D-11-00165.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tibshirani, R., 1996: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc., 58B, 267288.

  • Vickery, P. J., P. F. Skerlj, and L. A. Twisdale, 2000: Simulation of hurricane risk in the U.S. using an empirical track model. J. Struct. Eng., 126, 12221237, doi:10.1061/(ASCE)0733-9445(2000)126:10(1222).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Vickery, P. J., D. Wadhera, L. Twisdale Jr., and F. Lavelle, 2009: U.S. hurricane wind speed risk and uncertainty. J. Struct. Eng., 135, 301320, doi:10.1061/(ASCE)0733-9445(2009)135:3(301).

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yang, Y., and H. Zou, 2015: A fast unified algorithm for solving group-lasso penalize learning problems. Stat. Comput., 25, 11291141, doi:10.1007/s11222-014-9498-5.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yonekura, E., and T. M. Hall, 2011: A statistical model of tropical cyclone tracks in the western North Pacific with ENSO-dependent cyclogenesis. J. Appl. Meteor. Climatol., 50, 17251739, doi:10.1175/2011JAMC2617.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yuan, M., and Y. Lin, 2006: Model selection and estimation in regression with grouped variables. J. Roy. Stat. Soc., 68B, 4967, doi:10.1111/j.1467-9868.2005.00532.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhang, C. H., and J. Huang, 2008: The sparsity and bias of the lasso selection in high-dimensional linear regression. Ann. Stat., 36, 15671594, doi:10.1214/07-AOS520.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fig. 1.

    MSEs for different values of the regulation parameter for the SLM using the NA data with the full variable selection pool. The mean (red dots) and standard error (gray thin curves) for the MSE for each value of are calculated via cross validation. The green dashed line shows the value of that gives a minimum error. The orange dashed line shows the that gives an error one standard error away from the minimum error , and the blue dashed line shows the two-standard-error line . The number of selected variables for each value of is shown at the top of the plot.

  • Fig. 2.

    FMR grouping results for the model of intensification (DV) using selected variables for (a) NA and (b) WNP, both using k = 3 groups. All observations of DV are plotted with colors denoting the groups. Sample storm time series for (c) NA and (d) WNP, with cluster assignments colored accordingly.

  • Fig. 3.

    Functions for each predictor in the mixture OLS (FMR; red), mixture GAM (MGAM; blue), and mixture NP (MNP; black) models for intensification (DV) in NA. (top) The group 1 (static) functions, (middle) the group 2 (normal) functions, and (bottom) the group 3 (extreme) functions. Dashed blue lines give the 95% confidence interval for the MGAM functions, and the gray hashes along the top axes indicate the locations of the observations.

  • Fig. 4.

    As in Fig. 3, but for WNP.

  • Fig. 5.

    Comparison of (a) bin-averaged and (b) scatterplot of intensification [d(V/MPI)] as a function of V/MPI and VI for NA. In (a), the VI axis is divided logarithmically into 30 grids between 0.001 and 1, and the V/MPI axis is divided evenly into 24 grids between 0 and 1.2. Bins with sample sizes less than three are omitted.

  • Fig. 6.

    Example of the loss function of the group reassignment using logistic regression (for the dimensional mixture model with the VI predictor for the NA dataset; Table 4).

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2042 1207 399
PDF Downloads 920 175 33