An FSO-Based Optimization Framework for Improved Observation Performance: Theoretical Formulation and Experiments with NAVDAS-AR/NAVGEM

Dacian N. Daescu aPortland State University, Portland, Oregon

Search for other papers by Dacian N. Daescu in
Current site
Google Scholar
PubMed
Close
and
Rolf H. Langland bNaval Research Laboratory, Monterey, California

Search for other papers by Rolf H. Langland in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The forecast sensitivity to observations (FSO) is embedded into a new optimization framework for improving the observation performance in atmospheric data assimilation. Key ingredients are introduced as follows: the innovation-weight parameterization of the analysis equation, the FSO-based evaluation of the forecast error gradient to parameters, a line search approach to optimization, and an efficient mechanism for step length specification. This methodology is tested in preliminary numerical experiments with the Naval Research Laboratory Atmospheric Variational Data Assimilation System-Accelerated Representer (NAVDAS-AR) and the U.S. Navy’s Global Environmental Model (NAVGEM) at a T425L60 resolution. The experimental setup relies on a verification state produced by the European Centre for Medium-Range Weather Forecasts (ECMWF) to estimate the analysis and short-range forecast errors. Parameter tuning is implemented in a training stage valid for 1–14 April 2018 and aimed at improving the use of assimilated observations in reducing the initial-condition errors. Assessment is carried out for 15 April–31 May 2018 to investigate the performance of the weighted assimilation system in reducing the errors in analyses and 24-h model forecasts. In average, as compared with the control run and verified against the ECMWF analyses, the weighted approach provided 17.4% reduction in analysis errors and 3.1% reduction in 24-h forecast errors, measured in a dry total energy norm. Observation impacts are calculated to assess the use of various observation types in reducing the analysis and forecast errors. In particular, assimilation of satellite wind data is significantly improved through the innovation-weighting procedure.

Significance Statement

A new methodology is introduced to improve the information content of observations in numerical weather prediction (NWP). The computational procedure relies on observation sensitivity tools developed at all major NWP centers, and therefore, it appeals to a large audience for implementation and testing in practical applications. Our approach retains all available observations and provides a judicious optimization-based guidance to identify system deficiencies and improve the weighting assigned to various observing system components. The practical ability to implement this methodology is demonstrated in a computational environment that features all elements necessary for NWP applications. Preliminary results show that proper specification of the innovation weights can significantly improve the observation performance in reducing both the analysis errors and short-range forecast errors.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Dacian N. Daescu, daescu@pdx.edu

Abstract

The forecast sensitivity to observations (FSO) is embedded into a new optimization framework for improving the observation performance in atmospheric data assimilation. Key ingredients are introduced as follows: the innovation-weight parameterization of the analysis equation, the FSO-based evaluation of the forecast error gradient to parameters, a line search approach to optimization, and an efficient mechanism for step length specification. This methodology is tested in preliminary numerical experiments with the Naval Research Laboratory Atmospheric Variational Data Assimilation System-Accelerated Representer (NAVDAS-AR) and the U.S. Navy’s Global Environmental Model (NAVGEM) at a T425L60 resolution. The experimental setup relies on a verification state produced by the European Centre for Medium-Range Weather Forecasts (ECMWF) to estimate the analysis and short-range forecast errors. Parameter tuning is implemented in a training stage valid for 1–14 April 2018 and aimed at improving the use of assimilated observations in reducing the initial-condition errors. Assessment is carried out for 15 April–31 May 2018 to investigate the performance of the weighted assimilation system in reducing the errors in analyses and 24-h model forecasts. In average, as compared with the control run and verified against the ECMWF analyses, the weighted approach provided 17.4% reduction in analysis errors and 3.1% reduction in 24-h forecast errors, measured in a dry total energy norm. Observation impacts are calculated to assess the use of various observation types in reducing the analysis and forecast errors. In particular, assimilation of satellite wind data is significantly improved through the innovation-weighting procedure.

Significance Statement

A new methodology is introduced to improve the information content of observations in numerical weather prediction (NWP). The computational procedure relies on observation sensitivity tools developed at all major NWP centers, and therefore, it appeals to a large audience for implementation and testing in practical applications. Our approach retains all available observations and provides a judicious optimization-based guidance to identify system deficiencies and improve the weighting assigned to various observing system components. The practical ability to implement this methodology is demonstrated in a computational environment that features all elements necessary for NWP applications. Preliminary results show that proper specification of the innovation weights can significantly improve the observation performance in reducing both the analysis errors and short-range forecast errors.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Dacian N. Daescu, daescu@pdx.edu
Save
  • Baker, N. L., and R. Daley, 2000: Observation and background adjoint sensitivity in the adaptive observation-targeting problem. Quart. J. Roy. Meteor. Soc., 126, 14311454, https://doi.org/10.1002/qj.49712656511.

    • Search Google Scholar
    • Export Citation
  • Beck, A., and L. Tetruashvili, 2013: On the convergence of block coordinate descent type methods. SIAM J. Optim., 23, 20372060, https://doi.org/10.1137/120887679.

    • Search Google Scholar
    • Export Citation
  • Bougeault, P., and Coauthors, 2010: The THORPEX Interactive Grand Global Ensemble. Bull. Amer. Meteor. Soc., 91, 10591072, https://doi.org/10.1175/2010BAMS2853.1.

    • Search Google Scholar
    • Export Citation
  • Buehner, M., P. Du, and J. Bedard, 2018: A new approach for estimating the observation impact in ensemble–variational data assimilation. Mon. Wea. Rev., 146, 447465, https://doi.org/10.1175/MWR-D-17-0252.1.

    • Search Google Scholar
    • Export Citation
  • Cardinali, C., 2009: Monitoring the observation impact on the short-range forecast. Quart. J. Roy. Meteor. Soc., 135, 239250, https://doi.org/10.1002/qj.366.

    • Search Google Scholar
    • Export Citation
  • Cardinali, C., 2018: Forecast sensitivity observation impact with an observation-only based objective function. Quart. J. Roy. Meteor. Soc., 144, 20892098, https://doi.org/10.1002/qj.3305.

    • Search Google Scholar
    • Export Citation
  • Cardinali, C., S. Pezzulli, and E. Andersson, 2004: Influence-matrix diagnostic of a data assimilation system. Quart. J. Roy. Meteor. Soc., 130, 27672786, https://doi.org/10.1256/QJ.03.205.

    • Search Google Scholar
    • Export Citation
  • Chen, T.-C., and E. Kalnay, 2019: Proactive quality control: Observing system simulation experiments with the Lorenz ’96 model. Mon. Wea. Rev., 147, 5367, https://doi.org/10.1175/MWR-D-18-0138.1.

    • Search Google Scholar
    • Export Citation
  • Chen, T.-C., and E. Kalnay, 2020: Proactive quality control: Observing system experiments using the NCEP Global Forecast System. Mon. Wea. Rev., 148, 39113931, https://doi.org/10.1175/MWR-D-20-0001.1.

    • Search Google Scholar
    • Export Citation
  • Daescu, D. N., 2008: On the sensitivity equations of four-dimensional variational (4D-Var) data assimilation. Mon. Wea. Rev., 136, 30503065, https://doi.org/10.1175/2007MWR2382.1.

    • Search Google Scholar
    • Export Citation
  • Daescu, D. N., and R. Todling, 2009: Adjoint estimation of the variation in model functional output due to the assimilation of data. Mon. Wea. Rev., 137, 17051716, https://doi.org/10.1175/2008MWR2659.1.

    • Search Google Scholar
    • Export Citation
  • Daescu, D. N., and R. Todling, 2010: Adjoint sensitivity of the model forecast to data assimilation system error covariance parameters. Quart. J. Roy. Meteor. Soc., 136, 20002012, https://doi.org/10.1002/qj.693.

    • Search Google Scholar
    • Export Citation
  • Daescu, D. N., and R. H. Langland, 2013: Error covariance sensitivity and impact estimation with adjoint 4D-Var: Theoretical aspects and first applications to NAVDAS-AR. Quart. J. Roy. Meteor. Soc., 139, 226241, https://doi.org/10.1002/qj.1943.

    • Search Google Scholar
    • Export Citation
  • Daescu, D. N., and R. H. Langland, 2016: Innovation-weight parametrization in data assimilation: Formulation and analysis with NAVDAS-AR/NAVGEM. IFAC-PapersOnLine, 49, 176181, https://doi.org/10.1016/j.ifacol.2016.10.159.

    • Search Google Scholar
    • Export Citation
  • Dee, D. P., 2005: Bias and data assimilation. Quart. J. Roy. Meteor. Soc., 131, 33233343, https://doi.org/10.1256/qj.05.137.

  • Diniz, F. L. R., and R. Todling, 2020: Assessing the impact of observations in a multi-year reanalysis. Quart. J. Roy. Meteor. Soc., 146, 724747, https://doi.org/10.1002/qj.3705.

    • Search Google Scholar
    • Export Citation
  • Eyre, J. R., 2016: Observation bias correction schemes in data assimilation systems: A theoretical study of some of their properties. Quart. J. Roy. Meteor. Soc., 142, 22842291, https://doi.org/10.1002/qj.2819.

    • Search Google Scholar
    • Export Citation
  • Gelaro, R., Y. Zhu, and R. M. Errico, 2007: Examination of various-order adjoint-based approximations of observation impact. Meteor. Z., 16, 685–692, https://doi.org/10.1127/0941-2948/2007/0248.

    • Search Google Scholar
    • Export Citation
  • Gelaro, R., R. Langland, S. Pellerin, and R. Todling, 2010: The THORPEX observation impact intercomparison experiment. Mon. Wea. Rev., 138, 40094025, https://doi.org/10.1175/2010MWR3393.1.

    • Search Google Scholar
    • Export Citation
  • Hogan, T. F., and Coauthors, 2014: The Navy Global Environmental Model. Oceanography, 27 (3), 116125, https://doi.org/10.5670/oceanog.2014.73.

    • Search Google Scholar
    • Export Citation
  • Hotta, D., T.-C. Chen, E. Kalnay, Y. Ota, and T. Miyoshi, 2017a: Proactive QC: A fully flow-dependent quality control scheme based on EFSO. Mon. Wea. Rev., 145, 33313354, https://doi.org/10.1175/MWR-D-16-0290.1.

    • Search Google Scholar
    • Export Citation
  • Hotta, D., E. Kalnay, Y. Ota, and T. Miyoshi, 2017b: EFSR: Ensemble forecast sensitivity to observation error covariance. Mon. Wea. Rev., 145, 50155031, https://doi.org/10.1175/MWR-D-17-0122.1.

    • Search Google Scholar
    • Export Citation
  • Ishibashi, T., 2018: Adjoint-based observation impact estimation with direct verification using forward calculation. Mon. Wea. Rev., 146, 28372858, https://doi.org/10.1175/MWR-D-18-0037.1.

    • Search Google Scholar
    • Export Citation
  • Kalnay, E., Y. Ota, T. Miyoshi, and J. Liu, 2012: A simpler formulation of forecast sensitivity to observations: Application to ensemble Kalman filters. Tellus, 64A, 18462, https://doi.org/10.3402/tellusa.v64i0.18462.

    • Search Google Scholar
    • Export Citation
  • Kim, S.-M., and H. M. Kim, 2018: Effect of observation error variance adjustment on numerical weather prediction using forecast sensitivity to error covariance parameters. Tellus, 70A, 116, https://doi.org/10.1080/16000870.2018.1492839.

    • Search Google Scholar
    • Export Citation
  • Kim, S.-M., and H. M. Kim, 2019: Forecast sensitivity observation impact in the 4DVAR and hybrid-4DVAR data assimilation systems. J. Atmos. Oceanic Technol., 36, 15631575, https://doi.org/10.1175/JTECH-D-18-0240.1.

    • Search Google Scholar
    • Export Citation
  • Kotsuki, S., K. Kurosawa, and T. Miyoshi, 2019: On the properties of ensemble forecast sensitivity to observations. Quart. J. Roy. Meteor. Soc., 145, 18971914, https://doi.org/10.1002/qj.3534.

    • Search Google Scholar
    • Export Citation
  • Langland, R., and N. Baker, 2004: Estimation of observation impact using the NRL atmospheric variational data assimilation adjoint system. Tellus, 56, 189201, https://doi.org/10.3402/tellusa.v56i3.14413.

    • Search Google Scholar
    • Export Citation
  • Le Dimet, F.-X., H.-E. Ngodock, B. Luong, and J. Verron, 1997: Sensitivity analysis in variational data assimilation. J. Meteor. Soc. Japan, 75, 245255, https://doi.org/10.2151/jmsj1965.75.1B_245.

    • Search Google Scholar
    • Export Citation
  • Liu, J., and E. Kalnay, 2008: Estimating observation impact without adjoint model in an ensemble Kalman filter. Quart. J. Roy. Meteor. Soc., 134, 13271335, https://doi.org/10.1002/qj.280.

    • Search Google Scholar
    • Export Citation
  • Lorenc, A., and R. Marriott, 2014: Forecast sensitivity to observations in the Met Office global numerical weather prediction system. Quart. J. Roy. Meteor. Soc., 140, 209224, https://doi.org/10.1002/qj.2122.

    • Search Google Scholar
    • Export Citation
  • Lupu, C., P. Gauthier, and S. Laroche, 2011: Evaluation of the impact of observations on analyses in 3D- and 4D-Var based on information content. Mon. Wea. Rev., 139, 726737, https://doi.org/10.1175/2010MWR3404.1.

    • Search Google Scholar
    • Export Citation
  • Lupu, C., C. Cardinali, and A. P. McNally, 2015: Adjoint-based forecast sensitivity applied to observation-error variance tuning. Quart. J. Roy. Meteor. Soc., 141, 31573165, https://doi.org/10.1002/qj.2599.

    • Search Google Scholar
    • Export Citation
  • Moulay, E., V. Léchappé, and F. Plestan, 2019: Properties of the sign gradient descent algorithms. Inf. Sci., 492, 2939, https://doi.org/10.1016/j.ins.2019.04.012.

    • Search Google Scholar
    • Export Citation
  • Ota, Y., J. C. Derber, E. Kalnay, and T. Miyoshi, 2013: Ensemble-based observation impact estimates using the NCEP GFS. Tellus, 65A, 20038, https://doi.org/10.3402/tellusa.v65i0.20038.

    • Search Google Scholar
    • Export Citation
  • Privé, N., R. M. Errico, R. Todling, and A. El Akkraoui, 2021: Evaluation of adjoint-based observation impacts as a function of forecast length using an observing system simulation experiment. Quart. J. Roy. Meteor. Soc., 147, 121138, https://doi.org/10.1002/qj.3909.

    • Search Google Scholar
    • Export Citation
  • Rosmond, T., 1997: A technical description of the NRL adjoint modeling system. NRL Rep. NRL/MR/7532/97/7230, 62 pp., https://doi.org/10.21236/ADA330960.

  • Rosmond, T., and L. Xu, 2006: Development of NAVDAS-AR: Non-linear formulation and outer loop tests. Tellus, 58A, 4558, https://doi.org/10.1111/j.1600-0870.2006.00148.x.

    • Search Google Scholar
    • Export Citation
  • Ruston, B., and S. Healy, 2021: Forecast impact of FORMOSAT-7/COSMIC-2 GNSS radio occultation measurements. Atmos. Sci. Lett., 22, e1019, https://doi.org/10.1002/asl.1019.

    • Search Google Scholar
    • Export Citation
  • Todling, R., 2013: Comparing two approaches for assessing observation impact. Mon. Wea. Rev., 141, 14841505, https://doi.org/10.1175/MWR-D-12-00100.1.

    • Search Google Scholar
    • Export Citation
  • Todling, R., and A. El Akkraoui, 2018: The GMAO hybrid ensemble-variational atmospheric data assimilation system: Version 2.0. NASA Tech. Rep. Series NASA/TM-2018-104606, Vol. 50, 167 pp.

    • Search Google Scholar
    • Export Citation
  • Trémolet, Y., 2008: Computation of observation sensitivity and observation impact in incremental variational data assimilation. Tellus, 60A, 964978, https://doi.org/10.1111/j.1600-0870.2008.00349.x.

    • Search Google Scholar
    • Export Citation
  • Wright, S. J., 2015: Coordinate descent algorithms. Math. Program., 151, 334, https://doi.org/10.1007/s10107-015-0892-3.

  • Xu, L., T. Rosmond, and R. Daley, 2005: Development of NAVDAS-AR: Formulation and initial tests of the linear problem. Tellus, 57A, 546559, https://doi.org/10.3402/tellusa.v57i4.14710.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 498 0 0
Full Text Views 424 257 17
PDF Downloads 426 232 12