Application of a New Adjoint Newton Algorithm to the 3D ARPS Storm-Scale Model Using Simulated Data

Zhi Wang Center for Analysis and Prediction of Storms, University of Oklahoma, Norman, Oklahoma

Search for other papers by Zhi Wang in
Current site
Google Scholar
PubMed
Close
,
Kelvin K. Droegemeier School of Meteorology and Center for Analysis and Prediction of Storms, University of Oklahoma, Norman, Oklahoma

Search for other papers by Kelvin K. Droegemeier in
Current site
Google Scholar
PubMed
Close
,
L. White Department of Mathematics, University of Oklahoma, Norman, Oklahoma

Search for other papers by L. White in
Current site
Google Scholar
PubMed
Close
, and
I. M. Navon Department of Mathematics and Supercomputer Computations Research Institute, The Florida State University, Tallahassee, Florida

Search for other papers by I. M. Navon in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The adjoint Newton algorithm (ANA) is based on the first- and second-order adjoint techniques allowing one to obtain the “Newton line search direction” by integrating a “tangent linear model” backward in time (with negative time steps). Moreover, the ANA provides a new technique to find Newton line search direction without using gradient information. The error present in approximating the Hessian (the matrix of second-order derivatives) of the cost function with respect to the control variables in the quasi-Newton-type algorithm is thus completely eliminated, while the storage problem related to storing the Hessian no longer exists since the explicit Hessian is not required in this algorithm. The ANA is applied here, for the first time, in the framework of 4D variational data assimilation to the adiabatic version of the Advanced Regional Prediction System, a three-dimensional, compressible, nonhydrostatic storm-scale model. The purpose is to assess the feasibility and efficiency of the ANA as a large-scale minimization algorithm in the setting of 4D variational data assimilation.

Numerical results using simulated observations indicate that the ANA can efficiently retrieve high quality model initial conditions. It improves upon the efficiency of the usual adjoint method employing the LBFGS algorithm by more than an order of magnitude in terms of both CPU time and number of iterations for test problems presented here. Numerical results also show that the ANA obtains a fast linear convergence rate.

Corresponding author address: Dr. Zhi Wang, 100 E. Boyd, EC 1110, Center for Analysis and Prediction of Storms, University of Oklahoma, Norman, OK 73019.

Abstract

The adjoint Newton algorithm (ANA) is based on the first- and second-order adjoint techniques allowing one to obtain the “Newton line search direction” by integrating a “tangent linear model” backward in time (with negative time steps). Moreover, the ANA provides a new technique to find Newton line search direction without using gradient information. The error present in approximating the Hessian (the matrix of second-order derivatives) of the cost function with respect to the control variables in the quasi-Newton-type algorithm is thus completely eliminated, while the storage problem related to storing the Hessian no longer exists since the explicit Hessian is not required in this algorithm. The ANA is applied here, for the first time, in the framework of 4D variational data assimilation to the adiabatic version of the Advanced Regional Prediction System, a three-dimensional, compressible, nonhydrostatic storm-scale model. The purpose is to assess the feasibility and efficiency of the ANA as a large-scale minimization algorithm in the setting of 4D variational data assimilation.

Numerical results using simulated observations indicate that the ANA can efficiently retrieve high quality model initial conditions. It improves upon the efficiency of the usual adjoint method employing the LBFGS algorithm by more than an order of magnitude in terms of both CPU time and number of iterations for test problems presented here. Numerical results also show that the ANA obtains a fast linear convergence rate.

Corresponding author address: Dr. Zhi Wang, 100 E. Boyd, EC 1110, Center for Analysis and Prediction of Storms, University of Oklahoma, Norman, OK 73019.

Save
  • Bennett, A., 1992: Inverse Problem in Physical Oceanography. Cambridge University Press, 346 pp.

  • Berger, M. S., 1977: Nonlinearity and Functional Analysis. Academic Press, 417 pp.

  • Caradus, S. R., 1974: Operator theory of the pseudo-inverse. Queen’s Papers in Pure and Applied Mathematics 38, 67 pp. [Available from Queen’s University, Kingston, ON K7L-5C4, Canada.].

  • Davidon, W. C., 1959: Variable metric method for minimization. A. E. C. Research and Development Rep.ANL-5990. [Available from Argonne National Laboratory, Argonne, IL 60439.].

  • Dieudonne, J., 1960: Foundations of Modern Analysis. Academic Press, 361 pp.

  • Droegemeier, K., and Coauthors, 1995: Weather prediction: A scalable storm-scale model. High Performance Computing, G. W. Sabot, Ed., Addison Wesley, 45–92.

  • Errico, R. M., T. Vukićević, and K. Raeder, 1993: Examination of the accuracy of a tangent linear model. Tellus,45A, 462–477.

  • Gill, P. E., and W. Murray, 1972: Quasi-Newton methods for unconstrained optimization. J. Inst. Math. Its Appl.,9, 91–108.

  • ——, ——, and M. H. Wright, 1981: Practical Optimization. Academic Press, 401 pp.

  • Golub, G. H., and C. F. van Loan, 1989: Matrix Computations. 2d ed. The Johns Hopkins University Press, 642 pp.

  • Klemp, J. B., and R. B. Wilhelmson, 1978: The simulation of three-dimensional convective storm dynamics. J. Atmos. Sci.,35, 1070–1096.

  • Lacarra, J. F., and O. Talagrand, 1988: Short-range evolution of small perturbations in a barotropic model. Tellus,40A, 81–95.

  • Le Dimet, F. X., and O. Talagrand, 1986: Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus,38A, 97–110.

  • Liu, D. C., and J. Nocedal, 1989: On the limited memory BFGS method for large scale minimization. Math. Prog.,45, 503–528.

  • Luenberger, D. G., 1984: Linear and Nonlinear Programming. 2d ed. Addison-Wesley, 491 pp.

  • Nash, S. G., 1984a: Newton-type minimization via the Lanczos method. SIAM J. Numer. Anal.,21 (4), 770–788.

  • ——, 1984b: Truncated-Newton methods for large-scale function minimization. Applications of Nonlinear Programming to Optimization and Control, Pergamon Press, H. E. Rauch, Ed., 91–100.

  • ——, 1985: Preconditioning of truncated-Newton methods. SIAM J. Sci. Stat. Comput.,6 (3), 599–616.

  • ——, and J. Nocedal, 1989: A numerical study of the limited memory BFGS method and the truncated-Newton method for large scale optimization. Tech. Rep. NAM, 02, Dept. of Electrical Engineering and Computer Science, Northwestern University, 19 pp. [Available from Dept. of Electrical Engineering and Computer Science, Northwestern University, Evanston, IL 60208.].

  • ——, and A. Sofer, 1989: Block truncated-Newton methods for parallel optimization. Math. Prog.,45, 529–546.

  • Navon, I. M., and R. de Villiers, 1983: Combined penalty multiplier optimization methods to enforce integral invariants conservation. Mon. Wea. Rev.,111, 1228–1243.

  • ——, and D. M. Legler, 1987: Conjugate gradient methods for large scale minimization in meteorology. Mon. Wea. Rev.,115, 1479–1502.

  • ——, X. L. Zou, J. Derber, and J. Sela, 1992a: Variational data assimilation with an adiabatic version of the NMC Spectral Model. Mon. Wea. Rev.,120, 1433–1446.

  • ——, ——, M. Berger, P. K. H. Phua, T. Schlick, and F. X. Le Dimet, 1992b: Numerical experience with limited memory quasi-Newton and truncated Newton methods. Optimization Techniques and Applications, K. H. Phua et al., Eds., Vol. 1,World Scientific Publishing, 33–48.

  • ——, ——, ——, ——, ——, and ——, 1992c: Testing for reliability and robustness of optimization codes for large scale optimization problems. Optimization Techniques and Applications, K. H. Phua et al., Eds., Vol. 1, World Scientific Publishing, 445–480.

  • Nocedal, J., 1980: Updating quasi-Newton matrices with limited storage. Math. Comput.,35, 773–782.

  • O’Leary, D. P., 1983: A discrete Newton algorithm for minimizing a function of many variables. Math. Prog.,23, 20–23.

  • Pu, Z., E. Kalnay, J. Derber, and J. Sela, 1996a: Using past forecast error to improve the future forecast skill. Preprints, 11th Conf. on Numerical Weather Prediction, Norfolk, VA, Amer. Meteor. Soc., 142–143.

  • ——, ——, and ——, 1996b: Use of tangent linear model in the study of the sensitivity of forecast error to initial conditions. WMO Weather Prediction Research Programs. CAS/JSC Working Group on Numerical Experimentation, Research Activities in Atmospheric Oceanic Modeling, Rep. 23, WMO/ID-No. 734, 626–627. [Available from WMO, CP No. 2300, CH-1211, Geneva 2, Switzerland.].

  • ——, ——, and J. Sela, 1997: Sensitivity of forecast errors to initial conditions with a quasi-inverse linear method. Mon. Wea. Rev.,125, 2479–2503.

  • Rao, C. R., and S. K. Mitra, 1971: Generalized Inverse of Matrices and Its Applications to Statistics. John Wiley and Sons, 240 pp.

  • Schlick, T., and A. Fogelson, 1992a: TNPACK—A truncated Newton minimization package for large-scale problems: I. Algorithm and usage. ACMTOMS,18 (1), 46–70.

  • ——, and ——, 1992b: TNPACK—A truncated Newton minimization package for large-scale problems: II. Implementation examples. ACMTOMS,18 (1), 71–111.

  • Shanno, D. F., and K. H. Phua, 1980: Remark on algorithm 500—A variable method sub-routine for unconstrained nonlinear minimization. ACMTOMS,6, 618–622.

  • Smolarkiewicz, P. K., 1983: A simple positive definite advection scheme with small implicit diffusion. Mon. Wea. Rev.,111, 479–486.

  • Stoer, J., and R. Bulirsch, 1976: Introduction to Numerical Analysis. 2d ed. Springer-Verlag, 659 pp.

  • Sun, J., 1992: Convective scale 4-D data assimilation using simulated single Doppler radar observations. Ph.D. thesis, University of Oklahoma, Norman, OK, 172 pp. [Available from 100 East Boyd Street, EC1310, School of Meteorology, University of Oklahoma, Norman, OK 73019.].

  • Thacker, W. C., 1989: The role of Hessian matrix in fitting models to measurements. J. Geophys. Res.,94, 6177–6196.

  • Thépaut, J.-N., D. Vasiljevic, and P. Courtier, 1993: Variational assimilation of conventional meteorological observations with a multilevel primitive-equation model. Quart. J. Roy. Meteor. Soc.,119, 153–186.

  • Vukićević, T., 1991: Nonlinear and linear evolution of initial forecast error. Mon. Wea. Rev.,119, 1602–1611.

  • Wang, Z., 1993: Variational data assimilation with 2-D shallow water equations and 3-D FSU global spectral models. Tech. Rep. FSU-SCRI-93T-149, The Florida State University, Tallahassee, FL, 235 pp. [Available from SCRI, FSU, Tallahassee, FL32306-4052.].

  • ——, I. M. Navon, F. X. Le Dimet, and X. Zou, 1992: The second order adjoint analysis: Theory and application. Meteor. Atmos. Phys.,50, 3–20.

  • ——, ——, X. Zou, and F. X. Le Dimet, 1995a: The adjoint truncated Newton algorithm for large-scale unconstrained optimization. Comput. Optimization Appl.,4 (3), 241–262.

  • ——, K. Droegemeier, M. Xue, and S. Park, 1995b: The sensitivity of a 3-D compressible storm-scale model to input parameters. Preprints, Int. Symp. on Assimilation of Observations in Meteorology and Oceanography, Tokyo, Japan, Japan Meteorological Agency, 437–443.

  • ——, ——, and L. White, 1997: The adjoint Newton algorithm for large-scale unconstrained optimization in meteorology applications. Comput. Optimization Appl., in press.

  • Weisman, M. L., and J. B. Klemp, 1982: The dependence of numerically simulated convective storms on vertical wind shear and buoyancy. Mon. Wea. Rev.,110, 504–520.

  • Xue, M., K. Droegemeier, V. Vong, A. Shapiro, and K. Brewster, 1995: ARPS Version 4.0 User’s Guide. Center for the Analysis and Prediction of Storms, University of Oklahoma, 380 pp. [Available from Center for the Analysis and Prediction of Storms, University of Oklahoma, Norman, OK 73019.].

  • Yang, W., I. M. Navon, and P. Courtier, 1996: A new Hessian preconditioning method applied to variational data assimilation experiments using NASA general circulation models. Mon. Wea. Rev.,124, 1000–1017.

  • Zou, X., I. M. Navon, and F. X. LeDimet, 1992: Incomplete observations and control of gravity waves in variational data assimilation. Tellus,44A (4), 273–296.

  • Zupanski, D., and F. Mesinger, 1995: Four-dimensional variational data assimilation of precipitation data. Mon. Wea. Rev.,123, 1112–1127.

  • Zupanski, M., 1993a: A preconditioning algorithm for large scale minimization problems. Tellus,45A, 578–592.

  • ——, 1993b: Regional four-dimensional variational data assimilation in a quasi-operational forecasting environment. Mon. Wea. Rev.,121, 2396–2408.

  • ——, 1996: A preconditioning algorithm suitable for a general four-dimensional data assimilation. Preprints, 11th Conf. on Numerical Weather Prediction, Norfolk, VA, Amer. Meteor. Soc., 241–242.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 285 82 14
PDF Downloads 135 43 3