Applying a Neural Network Collocation Method to an Incompletely Known Dynamical System via Weak Constraint Data Assimilation

Ali Liaqat Department of Computer Science, The University of Electro-Communications, Tokyo, Japan

Search for other papers by Ali Liaqat in
Current site
Google Scholar
PubMed
Close
,
Makoto Fukuhara Department of Computer Science, The University of Electro-Communications, Tokyo, Japan

Search for other papers by Makoto Fukuhara in
Current site
Google Scholar
PubMed
Close
, and
Tatsuoki Takeda Department of Computer Science, The University of Electro-Communications, Tokyo, Japan

Search for other papers by Tatsuoki Takeda in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

A method based on a neural network collocation method is proposed for approximating incompletely known dynamical systems via weak constraint data assimilation formulation. The aim of the new method is to solve several difficult issues encountered in previous research. For this purpose, the weak constraint property of the neural network collocation method is used. The problem regarding the wider assimilation window is tackled by interconnecting narrower windows with finite overlapping interfaces. The method is examined by considering the Lorenz system as an example where one of the three equations of the system is unknown. The object function of the neural network training is composed of squared residuals of differential equations at collocation points and squared deviations of the observations from their corresponding calculated values.

The weakly and highly nonlinear cases of the Lorenz system are considered. The numerical experiments have been carried out with simulated noiseless and noisy observation data under various conditions. The performance of the method for approximating an unknown equation during the assimilation and testing periods is examined for the two cases. Also, the parameters of incomplete dynamical systems are estimated for the two cases. Satisfactory results have been obtained in both cases.

Corresponding author address: Prof. Tatsuoki Takeda, Dept. of Computer Science, The University of Electro-Communications, 1-5-1Chofugaoka, Chofu, Tokyo, 182-8585 Japan. Email: takeda@im.uec.ac.jp

Abstract

A method based on a neural network collocation method is proposed for approximating incompletely known dynamical systems via weak constraint data assimilation formulation. The aim of the new method is to solve several difficult issues encountered in previous research. For this purpose, the weak constraint property of the neural network collocation method is used. The problem regarding the wider assimilation window is tackled by interconnecting narrower windows with finite overlapping interfaces. The method is examined by considering the Lorenz system as an example where one of the three equations of the system is unknown. The object function of the neural network training is composed of squared residuals of differential equations at collocation points and squared deviations of the observations from their corresponding calculated values.

The weakly and highly nonlinear cases of the Lorenz system are considered. The numerical experiments have been carried out with simulated noiseless and noisy observation data under various conditions. The performance of the method for approximating an unknown equation during the assimilation and testing periods is examined for the two cases. Also, the parameters of incomplete dynamical systems are estimated for the two cases. Satisfactory results have been obtained in both cases.

Corresponding author address: Prof. Tatsuoki Takeda, Dept. of Computer Science, The University of Electro-Communications, 1-5-1Chofugaoka, Chofu, Tokyo, 182-8585 Japan. Email: takeda@im.uec.ac.jp

Save
  • Barnett, T. P., M. Latif, N. Graham, M. Flügel, S. Pazan, and W. White, 1993: ENSO and ENSO-related predictability. Part I: Prediction of equatorial sea surface temperature with a hybrid coupled ocean–atmosphere model. J. Climate, 6 , 15451566.

    • Search Google Scholar
    • Export Citation
  • Beale, R., and T. Jackson, 1990: Neural Computing: An Introduction. IOP, 240 pp.

  • Bishop, C. M., 1994: Neural networks and their applications. Rev. Sci. Instrum., 65 , 18031832.

  • Elsner, J. B., and A. A. Tsonis, 1992: Nonlinear prediction, chaos, and noise. Bull. Amer. Meteor. Soc., 73 , 4960.

  • Funahashi, K., 1989: On the approximate realization of continuous mappings by neural networks. Neural Networks, 2 , 183192.

  • Gauthier, P., 1992: Chaos and quadri-dimensional data assimilation: A study based on the Lorenz model. Tellus, 44A , 217.

  • Hassoun, M. H., 1995: Fundamentals of Artificial Neural Networks. MIT Press, 511 pp.

  • Hornik, K., 1989: Multilayer feedforward networks are universal approximators. Neural Networks, 2 , 359366.

  • Latif, M., and M. Flügel, 1991: An investigation of short-range climate predictability in the tropical Pacific. J. Geophys. Res., 96 , 26612673.

    • Search Google Scholar
    • Export Citation
  • Liaqat, A., M. Fukuhara, and T. Takeda, 2001: Application of neural network collocation method to data assimilation. Comput. Phys. Commun., 141 , 350364.

    • Search Google Scholar
    • Export Citation
  • Liaqat, A., M. Fukuhara, and T. Takeda, 2003: Optimal estimation of parameters of dynamical systems by neural network collocation method. Comput. Phys. Commun., 150 , 215234.

    • Search Google Scholar
    • Export Citation
  • Sparrow, C., 1982: The Lorenz Equations: Bifurcations, Chaos, and Strange Attractors. Springer-Verlag, 269 pp.

  • Syu, H-H., J. D. Neelin, and D. Gutzler, 1995: Seasonal and interannual variability in a hybrid coupled GCM. J. Climate, 8 , 21212143.

    • Search Google Scholar
    • Export Citation
  • Tang, Y., and W. W. Hsieh, 2001: Coupling neural networks to incomplete dynamical systems via variational data assimilation. Mon. Wea. Rev., 129 , 818834.

    • Search Google Scholar
    • Export Citation
  • Tang, Y., W. W. Hsieh, B. Tang, and K. Haines, 2001: A neural network atmospheric model for hybrid coupled modelling. Climate Dyn., 17 , 445455.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 213 56 7
PDF Downloads 191 37 6