Ensemble Transformation and Adaptive Observations

Craig H. Bishop Department of Meteorology, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Craig H. Bishop in
Current site
Google Scholar
PubMed
Close
and
Zoltan Toth GSC, NCEP, Camp Springs, Maryland

Search for other papers by Zoltan Toth in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Suppose that the geographical and temporal resolution of the observational network could be changed on a daily basis. Of all the possible deployments of observational resources, which particular deployment would minimize expected forecast error? The ensemble transform technique answers such questions by using nonlinear ensemble forecasts to rapidly construct ensemble-based approximations to the prediction error covariance matrices associated with a wide range of different possible deployments of observational resources. From these matrices, estimates of the expected forecast error associated with each distinct deployment of observational resources are obtained. The deployment that minimizes the chosen measure of forecast error is deemed optimal.

The technique may also be used to find the perturbation that evolves into the leading eigenvector or singular vector of an ensemble-based prediction error covariance matrix. This time-evolving perturbation “explains” more of the ensemble-based prediction error variance than any other perturbation. It may be interpreted as the fastest growing perturbation on the subspace of ensemble perturbations.

The ensemble-based approximations to the prediction error covariance matrices are constructed from transformation matrices derived from estimates of the analysis error covariance matrices associated with each possible deployment of observational resources. The authors prove that the ensemble transform technique would precisely recover the prediction error covariance matrices associated with each possible deployment of observational resources provided that (i) estimates of the analysis error covariance matrix were precise, (ii) the ensemble perturbations span the vector space of all possible perturbations, and (iii) the evolution of errors were linear and perfectly modeled. In the absence of such precise information, the ensemble transform technique links available information on analysis error covariances associated with different observational networks with error growth estimates contained in the ensemble forecast to estimate the optimal configuration of an adaptive observational network. Tests of the technique will be presented in subsequent publications. Here, the objective is to describe the theoretical basis of the technique and illustrate it with an example from the Fronts and Atlantic Storm Tracks Experiment (FASTEX).

Corresponding author address: Craig H. Bishop, Department of Meteorology, The Pennsylvania State University, 520 Walker Building, University Park, PA 16802.

Abstract

Suppose that the geographical and temporal resolution of the observational network could be changed on a daily basis. Of all the possible deployments of observational resources, which particular deployment would minimize expected forecast error? The ensemble transform technique answers such questions by using nonlinear ensemble forecasts to rapidly construct ensemble-based approximations to the prediction error covariance matrices associated with a wide range of different possible deployments of observational resources. From these matrices, estimates of the expected forecast error associated with each distinct deployment of observational resources are obtained. The deployment that minimizes the chosen measure of forecast error is deemed optimal.

The technique may also be used to find the perturbation that evolves into the leading eigenvector or singular vector of an ensemble-based prediction error covariance matrix. This time-evolving perturbation “explains” more of the ensemble-based prediction error variance than any other perturbation. It may be interpreted as the fastest growing perturbation on the subspace of ensemble perturbations.

The ensemble-based approximations to the prediction error covariance matrices are constructed from transformation matrices derived from estimates of the analysis error covariance matrices associated with each possible deployment of observational resources. The authors prove that the ensemble transform technique would precisely recover the prediction error covariance matrices associated with each possible deployment of observational resources provided that (i) estimates of the analysis error covariance matrix were precise, (ii) the ensemble perturbations span the vector space of all possible perturbations, and (iii) the evolution of errors were linear and perfectly modeled. In the absence of such precise information, the ensemble transform technique links available information on analysis error covariances associated with different observational networks with error growth estimates contained in the ensemble forecast to estimate the optimal configuration of an adaptive observational network. Tests of the technique will be presented in subsequent publications. Here, the objective is to describe the theoretical basis of the technique and illustrate it with an example from the Fronts and Atlantic Storm Tracks Experiment (FASTEX).

Corresponding author address: Craig H. Bishop, Department of Meteorology, The Pennsylvania State University, 520 Walker Building, University Park, PA 16802.

Save
  • Anderson, J. L., 1997: The impact of dynamical constraints on the selection of initial conditions for ensemble predictions: Low-order perfect model results. Mon. Wea. Rev.,125, 2969–2983.

  • Barkmeijer, J., 1995: Approximating dominant eigenvalues and eigenvectors of the local forecast error covariance matrix. Tellus,47A, 495–501.

  • Berliner, L. M., Z. Q. Lu, and C. Snyder, 1999: Statistical design for adaptive weather observations. J. Atmos. Sci., in press.

  • Bretherton, C. S., C. Smith, and J. M. Wallace, 1992: An intercomparison of methods for finding patterns in climate data. J. Climate,5, 541–561.

  • Buizza, R., and T. N. Palmer, 1995: The singular-vector structure of the atmospheric global circulation. J. Atmos., Sci.,52, 1434–1456.

  • Cherry, S., 1996: Singular value decomposition analysis and canonical correlation analysis. J. Climate,9, 2003–2009.

  • Daley, R., 1991: Atmospheric Data Analysis. Vol. 2. Cambridge University Press, 457 pp.

  • Eady, E. T., 1949: Long waves and cyclone waves. Tellus,1, 33–52.

  • Ehrendorfer, M., and J. J. Tribbia, 1997: Optimal prediction of forecast error covariances through singular vectors. J. Atmos. Sci.,54, 286–313.

  • Elsner, J. B., and A. A. Tsonis, 1996: Singular Spectrum Analysis. Plenum Press, 164 pp.

  • Emanuel, K., and Coauthors, 1995: Report of the first Prospectus Development Team of the U. S. Weather Research Program to NOAA and the NSF. Bull. Amer. Meteor. Soc.,76, 1194–1208.

  • Evensen, E., 1994: Sequential data assimilation with a non-linear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res.,99 (C5), 10 143–10 162.

  • Farrell, B. F, 1984: Modal and non-modal baroclinic waves. J. Atmos. Sci.,41, 668–673.

  • ——, 1988: Optimal excitation of neutral Rossby waves. J. Atmos. Sci.,45, 163–171.

  • ——, 1989: Optimal excitation of baroclinic waves. J. Atmos. Sci.,46, 1193–1206.

  • Golub, G. H., and C. F. van Loan, 1983: Matrix Computations. Johns Hopkins University Press, 476 pp.

  • Houtekamer, P. L., 1995: The construction of optimal perturbations. Mon. Wea. Rev.,123, 2888–2898.

  • ——, and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev.,126, 796–811.

  • ——, L. Lefaivre, J. Derome, H. Ritchie, and H. L. Mitchell, 1996:A system simulation approach to ensemble prediction. Mon. Wea. Rev.,124, 1225–1242.

  • Joly, A., and Coauthors, 1997: The Fronts and Atlantic Storm-track Experiment (FASTEX): Scientific objectives and experimental design. Bull. Amer. Meteor. Soc.,78, 1917–1940.

  • Langland, R. H., and G. D. Rohaly, 1996: Adjoint-based targeting of observations for FASTEX cyclones. Preprints, Seventh Conf. on Mesoscale Processes, Phoenix, AZ, Amer. Meteor. Soc., 369–371.

  • Lord, S. J, 1996: The impact on synoptic scale forecasts over the United States of dropwindsonde observations taken in the northeast Pacific. Preprints, 11th Conf. on Numerical Weather Prediction, Norfolk, VA, Amer. Meteor. Soc., 70–71.

  • Lorenz, E. N., and K. Emanuel, 1998: Optimal sites for supplementary weather observations: Simulation with a small model. J. Atmos. Sci.,55, 399–414.

  • Palmer, T. N., R. Gelaro, J. Barkmeijer, and R. Buizza, 1998: Singular vectors, metrics, and adaptive observations. J. Atmos. Sci.,55, 633–653.

  • Pires, C., R. Vautard, and O. Talagrand, 1996: On extending the limits of variational assimilation in chaotic systems. Tellus,48A, 96–121.

  • Strang, G., 1988: Linear Algebra and Its Applications. Harcourt, Brace and Jovanavitch, 505 pp.

  • Szunyogh, I., E. Kalnay, and Z. Toth, 1997: A comparison of Lyapunov and optimal vectors in a low-resolution GCM. Tellus,49A, 200–227.

  • Thorpe, A. J., 1998: Predictability studies with FASTEX data using the ECMWF IFS. Proc. ECMWF Workshop on Predictability, Reading, United Kingdom, ECMWF.

  • Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc.,74, 2317–2330.

  • ——, and ——, 1997: Ensemble forecasting at NCEP and the breeding method. Mon. Wea. Rev.,125, 3297–3319.

  • ——, and I. Szunyogh, 1997: Review of the use of ECMWF ensemble data for targeting upstream observations during the FASTEX field experiments. NOAA/NWS/NCEP Office Note 420, 131 pp. [Available from Environmental Modeling Center, 5200 Auth Rd., WWB, Rm. 207, Camp Springs, MD 20746.].

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 898 271 25
PDF Downloads 449 101 17