Skill Comparisons between Neural Networks and Canonical Correlation Analysis in Predicting the Equatorial Pacific Sea Surface Temperatures

Benyang Tang Department of Earth and Ocean Sciences, Oceanography, University of British Columbia, Vancouver, British Columbia, Canada

Search for other papers by Benyang Tang in
Current site
Google Scholar
PubMed
Close
,
William W. Hsieh Department of Earth and Ocean Sciences, Oceanography, University of British Columbia, Vancouver, British Columbia, Canada

Search for other papers by William W. Hsieh in
Current site
Google Scholar
PubMed
Close
,
Adam H. Monahan Department of Earth and Ocean Sciences, Oceanography, University of British Columbia, Vancouver, British Columbia, Canada

Search for other papers by Adam H. Monahan in
Current site
Google Scholar
PubMed
Close
, and
Fredolin T. Tangang Department of Earth and Ocean Sciences, Oceanography, University of British Columbia, Vancouver, British Columbia, Canada

Search for other papers by Fredolin T. Tangang in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Among the statistical methods used for seasonal climate prediction, canonical correlation analysis (CCA), a more sophisticated version of the linear regression (LR) method, is well established. Recently, neural networks (NN) have been applied to seasonal climate prediction. Unlike CCA and LR, NN is a nonlinear method, which leads to the question whether the nonlinearity of NN brings any extra prediction skill.

In this study, an objective comparison between the three methods (CCA, LR, and NN) in predicting the equatorial Pacific sea surface temperatures (in regions Niño1+2, Niño3, Niño3.4, and Niño4) was made. The skill of NN was found to be comparable to that of LR and CCA. A cross-validated t test showed that the difference between NN and LR and the difference between NN and CCA were not significant at the 5% level. The lack of significant skill difference between the nonlinear NN method and the linear methods suggests that at the seasonal timescale the equatorial Pacific dynamics is basically linear.

Corresponding author address: Dr. Benyang Tang, M/S 300-323, Jet Propulsion Laboratory, 4800 Oak Grove Drive, Pasadena, CA 91109.

Abstract

Among the statistical methods used for seasonal climate prediction, canonical correlation analysis (CCA), a more sophisticated version of the linear regression (LR) method, is well established. Recently, neural networks (NN) have been applied to seasonal climate prediction. Unlike CCA and LR, NN is a nonlinear method, which leads to the question whether the nonlinearity of NN brings any extra prediction skill.

In this study, an objective comparison between the three methods (CCA, LR, and NN) in predicting the equatorial Pacific sea surface temperatures (in regions Niño1+2, Niño3, Niño3.4, and Niño4) was made. The skill of NN was found to be comparable to that of LR and CCA. A cross-validated t test showed that the difference between NN and LR and the difference between NN and CCA were not significant at the 5% level. The lack of significant skill difference between the nonlinear NN method and the linear methods suggests that at the seasonal timescale the equatorial Pacific dynamics is basically linear.

Corresponding author address: Dr. Benyang Tang, M/S 300-323, Jet Propulsion Laboratory, 4800 Oak Grove Drive, Pasadena, CA 91109.

Save
  • Barnett, T. P., and R. Preisendorfer, 1987: Origins and levels of monthly and seasonal forecast skill for united states surface air temperatures determined by canonical correlation analysis. Mon. Wea. Rev.,115, 1825–1850.

  • Barnston, A. G., and C. F. Ropelewski, 1992: Prediction of ENSO episodes using Canonical Correlation Analysis. J. Climate,5, 1316–1345.

  • ——, and Coauthors, 1994: Long-lead seasonal forecasts—Where do we stand? Bull. Amer. Meteor. Soc.,75, 2097–2114.

  • Bishop, C. M., 1995: Neural Networks for Pattern Recognition. Clarendon Press, 482 pp.

  • Breiman, L., 1996: Bagging predictions. Mach. Learning,24, 123–140.

  • Chen, D., S. E. Zebiak, A. J. Busalacchi, and M. A. Cane, 1995: An improved procedure for El Niño forecasting: Implications for predictability. Science,269, 1699–1702.

  • Derr, V. E., and R. J. Slutz, 1994: Prediction of El Niño event in the Pacific by means of neural networks. AI Interact.,8, 51–63.

  • Dietterich, T. G., 1998: Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput.,10, 1895–1923.

  • Finnoff, W. F., F. Hergert, and H. G. Zimmermann, 1993: Improving model selection by nonconvergent methods. Neural Networks,137, 771–783.

  • Graham, N. E., J. Michaelsen, and T. P. Barnett, 1987: An investigation of the El Niño-Southern Oscillation cycle with statistical models: 1. Predictor field characteristics. J. Geophys. Res.,92 (C13), 14 251–14 270.

  • Hastenrath, S., L. Greischar, and J. Heerden, 1995: Prediction of the summer rainfall over South Africa. J. Climate,8, 1511–1518.

  • Hoerling, M. P., A. Kumar, and M. Zhong, 1997: El Niño, La Niña, and the nonlinearity of their teleconnections. J. Climate,10, 1769–1786.

  • Hsieh, W. W., and B. Tang, 1998: Applying neural network models to prediction and data analysis in meteorology and oceanography. Bull. Amer. Meteor. Soc.,79, 1855–1870.

  • Livezey, R. E., M. Masutani, L. A. H. Rui, M. Ji, and A. Kumar, 1997: Teleconnective response of the Pacific-North American region atmosphere to large central equatorial Pacific SST anomalies. J. Climate,10, 1787–1820.

  • Lorenz, 1963: Deterministic nonperiodic flow. J. Atmos. Sci.,20, 130–141.

  • Manly, B. F. J., 1986: Multivariate Statistical Method: A Primer. Chapman and Hall, 159 pp.

  • Penland, C., and P. D. Sardeshmukh, 1995: The optimal growth of tropical see surface temperature anomalies. J. Climate,8, 1999–2024.

  • Press, W. H., B. P. Flannery, S. Teukolsky, and W. Vetterling, 1986:Numerical Recipes. Cambridge University Press, 818 pp.

  • Reynolds, R. W., and T. M. Smith, 1994: Improved global sea surface temperature analyses using optimum interpolation. J. Climate,7, 929–948.

  • Shabbar, A., B. Bonsal, and M. Khandekar, 1997: Canadian precipitation patterns associated with the Southern Oscillation. J. Climate,10, 3016–3027.

  • Smith, T. M., A. G. Barnston, M. Ji, and M. Chelliah, 1995: The impact of pacific Ocean subsurface data on operational prediction of tropical Pacific SST at the NCEP. Wea. Forecasting,10, 708–714.

  • ——, R. W. Reynolds, R. E. Livezey, and D. C. Stokes, 1996: Reconstruction of historical sea surface temperatures using empirical orthogonal functions. J. Climate,9, 1403–1420.

  • Tang, B., G. M. Flato, and G. Holloway, 1994: A study of Arctic sea ice and sea-level pressure using POP and neural network methods. Atmos.–Ocean,32, 507–529.

  • Tangang, F. T., W. W. Hsieh, and B. Tang, 1997: Forecasting the equatorial sea surface temperatures by neural network models. Climate Dyn.,13, 135–147.

  • Weigend, A. S., and N. A. Gershenfeld, 1994: Time Series Prediction:Forecasting the Future and Understanding the Past. Addison-Wesley, 643 pp.

  • Woodruff, S. D., R. L. J. R. J. Slutz, and P. M. Steurer, 1987: A comprehensive ocean-atmosphere data set. Bull. Amer. Meteor. Soc.,68, 1239–1250.

  • Xue, Y., M. A. Cane, S. E. Zebiak, and M. B. Blumenthal, 1994: On the prediction of ENSO: A study with a low order markov model. Tellus,46A, 512–528.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 682 206 26
PDF Downloads 305 91 2