Neural Error Regression Diagnosis (NERD): A Tool for Model Bias Identification and Prognostic Data Assimilation

Gab Abramowitz Macquarie University, Sydney, Australia

Search for other papers by Gab Abramowitz in
Current site
Google Scholar
PubMed
Close
,
Hoshin Gupta The University of Arizona, Tuscon, Arizona

Search for other papers by Hoshin Gupta in
Current site
Google Scholar
PubMed
Close
,
Andy Pitman Macquarie University, Sydney, Australia

Search for other papers by Andy Pitman in
Current site
Google Scholar
PubMed
Close
,
Yingping Wang CSIRO Atmospheric Research, Melbourne, Australia

Search for other papers by Yingping Wang in
Current site
Google Scholar
PubMed
Close
,
Ray Leuning CSIRO Atmospheric Research, Melbourne, Australia

Search for other papers by Ray Leuning in
Current site
Google Scholar
PubMed
Close
,
Helen Cleugh CSIRO Atmospheric Research, Melbourne, Australia

Search for other papers by Helen Cleugh in
Current site
Google Scholar
PubMed
Close
, and
Kuo-lin Hsu University of California, Irvine, Irvine, California

Search for other papers by Kuo-lin Hsu in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Data assimilation in the field of predictive land surface modeling is generally limited to using observational data to estimate optimal model states or restrict model parameter ranges. To date, very little work has attempted to systematically define and quantify error resulting from a model's inherent inability to simulate the natural system. This paper introduces a data assimilation technique that moves toward this goal by accounting for those deficiencies in the model itself that lead to systematic errors in model output. This is done using a supervised artificial neural network to “learn” and simulate systematic trends in the model output error. These simulations in turn are used to correct the model's output each time step. The technique is applied in two case studies, using fluxes of latent heat flux at one site and net ecosystem exchange (NEE) of carbon dioxide at another. Root-mean-square error (rmse) in latent heat flux per time step was reduced from 27.5 to 18.6 W m−2 (32%) and monthly from 9.91 to 3.08 W m−2 (68%). For NEE, rmse per time step was reduced from 3.71 to 2.70 μmol m−2 s−1 (27%) and annually from 2.24 to 0.11 μmol m−2 s−1 (95%). In both cases the correction provided significantly greater gains than single criteria parameter estimation on the same flux.

Corresponding author address: Gab Abramowitz, Department of Physical Geography, Macquarie University, NSW 2109, Australia. Email: gabramow@els.mq.edu.au

Abstract

Data assimilation in the field of predictive land surface modeling is generally limited to using observational data to estimate optimal model states or restrict model parameter ranges. To date, very little work has attempted to systematically define and quantify error resulting from a model's inherent inability to simulate the natural system. This paper introduces a data assimilation technique that moves toward this goal by accounting for those deficiencies in the model itself that lead to systematic errors in model output. This is done using a supervised artificial neural network to “learn” and simulate systematic trends in the model output error. These simulations in turn are used to correct the model's output each time step. The technique is applied in two case studies, using fluxes of latent heat flux at one site and net ecosystem exchange (NEE) of carbon dioxide at another. Root-mean-square error (rmse) in latent heat flux per time step was reduced from 27.5 to 18.6 W m−2 (32%) and monthly from 9.91 to 3.08 W m−2 (68%). For NEE, rmse per time step was reduced from 3.71 to 2.70 μmol m−2 s−1 (27%) and annually from 2.24 to 0.11 μmol m−2 s−1 (95%). In both cases the correction provided significantly greater gains than single criteria parameter estimation on the same flux.

Corresponding author address: Gab Abramowitz, Department of Physical Geography, Macquarie University, NSW 2109, Australia. Email: gabramow@els.mq.edu.au

Save
  • Barford, C. C., and Coauthors, 2001: Factors controlling long- and short-term sequestration of atmospheric CO2 in a mid-latitude forest. Science, 294 , 16881691.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Beljaars, A. C. M., and Bosveld F. C. , 1997: Cabauw data for the validation of land surface parameterization schemes. J. Climate, 10 , 11721193.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chen, T. H., and Coauthors, 1997: Cabauw experimental results from the Project for Intercomparison of Land-Surface Parameterization Schemes. J. Climate, 10 , 11941215.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Franks, S. W., Beven K. J. , Quinn P. F. , and Wright I. R. , 1997: On the sensitivity of soil–vegetation–atmosphere transfer (SVAT) schemes: Equifinality and the problem of robust calibration. Agric. For. Meteor, 86 , 6375.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gan, T. Y., and Biftu G. F. , 1996: Automatic calibration of conceptual rainfall–runoff models: Optimization algorithms, catchment conditions, and model structure. Water Resour. Res, 32 , 35133524.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gupta, H. V., Bastidas L. A. , Sorooshian S. , Shuttleworth W. J. , and Yang Z. L. , 1999: Parameter estimation of a land surface scheme using multicriteria methods. J. Geophys. Res, 104 , 1949119503.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gupta, H. V., Sorooshian S. , Hogue T. , and Boyle D. , 2002: Advances in automatic calibration of watershed models. Calibration of Watershed Models, Q. Duan et al., Eds., Water Science and Application Series, Vol. 6, Amer. Geophys. Union, 9–28.

    • Search Google Scholar
    • Export Citation
  • Henderson-Sellers, A., Pitman A. J. , Love P. K. , Irannejad P. , and Chen T. H. , 1995: The Project for Intercomparison of Land Surface Parameterization Schemes (PILPS): Phases 2 and 3. Bull. Amer. Meteor. Soc, 76 , 489503.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hsu, K-L., Gupta H. V. , Gao X. , Sorooshian S. , and Imam B. , 2002: Self-Organizing Linear Output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis. Water Resour. Res, 38 .1302, doi:10.1029/2001WR000795.

    • Search Google Scholar
    • Export Citation
  • Kohonen, T., 1989: Self-Organization and Associative Memory. Springer-Verlag, 312 pp.

  • Leuning, R., 1995: A critical appraisal of a combined stomatal-photosynthesis model for c3 plants. Plant Cell Environ, 18 , 339355.

  • Leuning, R., Kelliher F. M. , de Pury D. G. G. , and Schulze E-D. , 1995: Leaf nitrogen, photosynthesis, conductance and transpiration: Scaling from leaves to canopies. Plant Cell Environ, 18 , 11831200.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Leuning, R., Dunin F. X. , and Wang Y. P. , 1998: A two-leaf model for canopy conductance, photosynthesis and partitioning of available energy. ii. Comparison with measurements. Agric. For. Meteor, 91 , 113125.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Maier, H. R., and Dandy G. C. , 2000: Neural networks for the prediction and forecasting of water resources variables: A review of modelling issues and applications. Environ. Modell. Software, 15 , 101124.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Martínez, M. A., and Velázquez M. , 2001: A new method to correct dependence of MSG IR radiances on satellite zenith angle, using a neural network. Proc. 2001 EUMETSAT Meteorological Satellite Data Users' Conf., Antalya, Turkey.

  • Sen, O. L., Bastidas L. , Shuttleworth W. , Yang Z. , and Sorooshian S. , 2001: Impact of field calibrated vegetation parameters on GCM climate simulations. Quart. J. Roy. Meteor. Soc, 127 , 11991224.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Swinbank, W. C., 1963: Longwave radiation from clear skies. Quart. J. Roy. Meteor. Soc, 89 , 339348.

  • Tetko, I. V., 2002: Associative neural network. Neural Process. Lett, 16 , 187199.

  • Vrugt, J., Gupta H. V. , Bastidas L. A. , Bouten W. , and Sorooshian S. , 2003a: Effective and efficient algorithm for multi-objective optimization of hydrologic models. Water Resour. Res, 39 .1214, doi:10.1029/2002WR001746.

    • Search Google Scholar
    • Export Citation
  • Vrugt, J., Gupta H. V. , Bouten W. , and Sorooshian S. , 2003b: A shuffled complex evolution metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour. Res, 39 .1201, doi:10.1029/2002WR001642.

    • Search Google Scholar
    • Export Citation
  • Wang, Y. P., and Leuning R. , 1998: A two-leaf model for canopy conductance, photosynthesis and partitioning of available energy. i. Model description. Agric. For. Meteor, 91 , 89111.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yapo, P. O., Gupta H. V. , Bouten W. , and Sorooshian S. , 1998: Multi-objective global optimization for hydrologic models. J. Hydrol, 204 , 8397.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 307 129 13
PDF Downloads 120 57 8