Statistical Weather-Impact Models: An Application of Neural Networks and Mixed Effects for Corn Production over the United States

Jordane A. Mathieu Laboratoire d’Etudes du Rayonnement et de la Matière en Astrophysique et Atmospheres, and Estellus, Paris, France

Search for other papers by Jordane A. Mathieu in
Current site
Google Scholar
PubMed
Close
and
Filipe Aires Laboratoire d’Etudes du Rayonnement et de la Matière en Astrophysique et Atmospheres, and Estellus, Paris, France

Search for other papers by Filipe Aires in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Statistical meteorological impact models are intended to represent the impact of weather on socioeconomic activities, using a statistical approach. The calibration of such models is difficult because relationships are complex and historical records are limited. Often, such models succeed in reproducing past data but perform poorly on unseen new data (a problem known as overfitting). This difficulty emphasizes the need for regularization techniques and reliable assessment of the model quality. This study illustrates, in a general way, how to extract pertinent information from weather data and exploit it in impact models that are designed to help decision-making. For a given socioeconomic activity, this type of impact model can be used to 1) study its sensitivity to weather anomalies (e.g., corn sensitivity to water stress), 2) perform seasonal forecasting (yield forecasting) for it, and 3) quantify the longer-term (several decades) impact of weather on it. The size of the training database can be increased by pooling data from various locations, but this requires statistical models that are able to use the localization information—for example, mixed-effect (ME) models. Linear, neural-network, and ME models are compared, using a real-world application: corn-yield forecasting over the United States. Many challenges faced in this paper may be encountered in many weather-impact analyses: these results show that much care is required when using space–time data because they are often highly spatially correlated. In addition, the forecast quality is strongly influenced by the training spatial scale. For the application that is described herein, learning at the state scale is a good trade-off: it is specific to local conditions while keeping enough data for the calibration.

Corresponding author address: J. A. Mathieu, Lerma, 77 av. Denfert-Rochereau, 75014 Paris, France. E-mail: jordane.mathieu@obspm.fr

Abstract

Statistical meteorological impact models are intended to represent the impact of weather on socioeconomic activities, using a statistical approach. The calibration of such models is difficult because relationships are complex and historical records are limited. Often, such models succeed in reproducing past data but perform poorly on unseen new data (a problem known as overfitting). This difficulty emphasizes the need for regularization techniques and reliable assessment of the model quality. This study illustrates, in a general way, how to extract pertinent information from weather data and exploit it in impact models that are designed to help decision-making. For a given socioeconomic activity, this type of impact model can be used to 1) study its sensitivity to weather anomalies (e.g., corn sensitivity to water stress), 2) perform seasonal forecasting (yield forecasting) for it, and 3) quantify the longer-term (several decades) impact of weather on it. The size of the training database can be increased by pooling data from various locations, but this requires statistical models that are able to use the localization information—for example, mixed-effect (ME) models. Linear, neural-network, and ME models are compared, using a real-world application: corn-yield forecasting over the United States. Many challenges faced in this paper may be encountered in many weather-impact analyses: these results show that much care is required when using space–time data because they are often highly spatially correlated. In addition, the forecast quality is strongly influenced by the training spatial scale. For the application that is described herein, learning at the state scale is a good trade-off: it is specific to local conditions while keeping enough data for the calibration.

Corresponding author address: J. A. Mathieu, Lerma, 77 av. Denfert-Rochereau, 75014 Paris, France. E-mail: jordane.mathieu@obspm.fr
Save
  • Adams, R. M., B. H. Hurd, S. Lenhart, and N. Leary, 1998: Effects of global climate change on agriculture: An interpretative review. Climate Res., 11, 1930, doi:10.3354/cr011019.

    • Search Google Scholar
    • Export Citation
  • Aires, F., 2012: Using random effects to build impact models when the available historical record is short. J. Appl. Meteor. Climatol., 51, 19942004, doi:10.1175/JAMC-D-11-0125.1.

    • Search Google Scholar
    • Export Citation
  • Araújo, M. B., R. G. Pearson, W. Thuiller, and M. Erhard, 2005: Validation of species-climate impact models under climate change. Global Change Biol., 11, 15041513, doi:10.1111/j.1365-2486.2005.01000.x.

    • Search Google Scholar
    • Export Citation
  • Arlot, S., and A. Celisse, 2010: A survey of cross-validation procedures for model selection. Stat. Surv., 4, 4079, doi:10.1214/09-SS054.

    • Search Google Scholar
    • Export Citation
  • Bishop, C., 1995: Neural Networks for Pattern Recognition. Oxford University Press, 504 pp.

  • Cai, R., D. Yu, and M. Oppenheimer, 2014: Estimating the spatially varying responses of corn yields to weather variations using geographically weighted panel regression. J. Agric. Resour. Econ., 39, 230252. [Available online at http://www.waeaonline.org/UserFiles/file/JAREAug20146Caipp230-252.pdf.]

    • Search Google Scholar
    • Export Citation
  • Caubel, J., I. G. de Cortázar-Atauri, M. Launay, N. de Noblet-Ducoudré, F. Huard, P. Bertuzzi, and A.-I. Graux, 2015: Broadening the scope for ecoclimatic indicators to assess crop climate suitability according to ecophysiological, technical and quality criteria. Agric. For. Meteor., 207, 94106, doi:10.1016/j.agrformet.2015.02.005.

    • Search Google Scholar
    • Export Citation
  • Coles, S., 2001: An Introduction to Statistical Modeling of Extreme Values. Springer Series in Statistics, Springer, 224 pp.

  • Crawley, M. J., 2011: Statistics: An Introduction Using R. John Wiley and Sons, 342 pp.

  • Fahrmeir, L., and G. Tutz, 1994: Multivariate Statistical Modelling Based on Generalized Linear Models. Springer Series in Statistics, Springer-Verlag, 425 pp.

  • Geman, S., E. Bienenstock, and R. Doursat, 1992: Neural networks and the bias/variance dilemma. Neural Comput., 4, 158, doi:10.1162/neco.1992.4.1.1.

    • Search Google Scholar
    • Export Citation
  • Greenough, G., M. McGeehin, S. M. Bernard, J. Trtanj, J. Riad, and D. Engelberg, 2001: The potential impacts of climate variability and change on health impacts of extreme weather events in the United States. Environ. Health Perspect., 109 (Suppl. 2), 191198. [Available online at http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1240666/pdf/ehp109s-000191.pdf.]

    • Search Google Scholar
    • Export Citation
  • Hastie, T., R. Tibshirani, and J. Friedman, 2001: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics, Springer, 539 pp.

  • Hawkins, D. M., 2004: The problem of overfitting. J. Chem. Inf. Comput. Sci., 44, 112, doi:10.1021/ci0342472.

  • Hoogenboom, G., 2000: Contribution of agrometeorology to the simulation of crop production and its applications. Agric. For. Meteor., 103, 137157, doi:10.1016/S0168-1923(00)00108-8.

    • Search Google Scholar
    • Export Citation
  • International Code Council, 2006: 2006 International Energy Conservation Code. International Code Council Doc., 66 pp. [Available online at https://law.resource.org/pub/us/code/ibr/icc.iecc.2006.pdf.]

  • IPCC, 2007: Climate Change 2007: Impacts, Adaptation and Vulnerability. Cambridge University Press, 976 pp.

  • Irwin, S., D. Good, and D. Sanders, 2014: Are USDA corn yield forecasts getting better or worse over time? University of Illinois at Urbana–Champaign farmdoc daily Vol. 4, No. 169. [Available online at http://farmdocdaily.illinois.edu/2014/09/usda-soybean-yield-forecasts-better-or-worse.html.]

  • Jewson, S., and A. Brix, 2005: Weather Derivative Valuation: The Meteorological, Statistical, Financial and Mathematical Foundations. Cambridge University Press, 392 pp.

  • Jones, J. W., and Coauthors, 2003: The DSSAT cropping system model. Eur. J. Agron., 18, 235265, doi:10.1016/S1161-0301(02)00107-7.

  • Kandiannan, K., K. K. Chandaragiri, N. Sankaran, T. B. Balasubramanian, and C. Kailasam, 2002: Crop–weather model for turmeric yield forecasting for Coimbatore district, Tamil Nadu, India. Agric. For. Meteor., 112, 133137, doi:10.1016/S0168-1923(02)00125-9.

    • Search Google Scholar
    • Export Citation
  • Kaylen, M. S., and S. S. Koroma, 1991: Trend, weather variables, and the distribution of U.S. corn yields. Appl. Econ. Perspect. Policy, 13, 249258, doi:10.2307/1349641.

    • Search Google Scholar
    • Export Citation
  • Kenny, J. F., N. L. Barber, S. S. Hutson, K. S. Linsey, J. K. Lovelace, and M. A. Maupin, 2009: Estimated use of water in the United States in 2005. U.S. Geological Survey Circular 1344, 52 pp. [Available online at https://pubs.usgs.gov/circ/1344/pdf/c1344.pdf.]

  • Kotlowski, W., 2007: Qualitative models of climate variations impact on crop yields. IIASA Rep. IR-07-034, 30 pp. [Available online at http://pure.iiasa.ac.at/8423/1/IR-07-034.pdf.]

  • Leckebusch, G., U. Ulbrich, and P. Speth, 2002: Identification of extreme events under climate change conditions over Europe and the northwest-Atlantic region: Spatial patterns and time series characteristics. Geophysical Research Abstracts, Vol. 27, Abstract 1566. [Available online at http://adsabs.harvard.edu/abs/2002EGSGA..27.1566L.]

  • Le Rest, K., 2013: Méthodes statistiques pour la modélisation des facteurs influençant la distribution et l’abondance de populations: Application aux rapaces diurnes nichant en France (Statistical methods for modeling of the factors that influence the distribution and abundance of populations: Application to diurnal raptors breeding in France). These doctorat, Université de Poitiers, 153 pp. [Available online at http://www.cebc.cnrs.fr/Fthese/PUBLI/Le_Rest.pdf.]

  • Lewandrowski, J., and D. Schimmelpfennig, 1999: Economic implications of climate change for U.S. agriculture: Assessing recent evidence. Land Econ., 75, 3957, doi:10.2307/3146992.

    • Search Google Scholar
    • Export Citation
  • Liang, S., 2003: Quantitative Remote Sensing of Land Surfaces. John Wiley and Sons, 560 pp.

  • Lindstrom, M. J., and D. M. Bates, 1988: Newton–Raphson and EM algorithms for linear mixed-effects models for repeated-measures data. J. Amer. Stat. Assoc., 83, 10141022, doi:10.1080/01621459.1988.10478693.

    • Search Google Scholar
    • Export Citation
  • Lobell, D. B., K. N. Cahill, and C. B. Field, 2007: Historical effects of temperature and precipitation on California crop yields. Climatic Change, 81, 187203, doi:10.1007/s10584-006-9141-3.

    • Search Google Scholar
    • Export Citation
  • Marteau, D., J. Carle, S. Fourneaux, R. Holz, and M. Moreno, 2004: La Gestion du Risque Climatique (Management of Climate Risk). Economica, 211 pp.

  • Mathieu, J. A., C. Hatté, J. Balesdent, and E. Parent, 2015: Deep soil carbon dynamics are driven more by soil type than by climate: A worldwide meta-analysis of radiocarbon profiles. Global Change Biol., 21, 42784292, doi:10.1111/gcb.13012.

    • Search Google Scholar
    • Export Citation
  • Maupin, M. A., J. F. Kenny, S. S. Hutson, J. K. Lovelace, N. L. Barber, and K. S. Linsey, 2014: Estimated use of water in the United States in 2010. U.S. Geological Survey Circular 1405, 56 pp. [Available online at http://pubs.usgs.gov/circ/1405/pdf/circ1405.pdf.]

  • Rauber, R. M., J. E. Walsh, and D. J. Charlevoix, 2005: Severe and Hazardous Weather: An Introduction to High Impact Meteorology. Kendall Hunt, 558 pp.

  • Ray, D. K., J. S. Gerber, G. K. MacDonald, and P. C. West, 2015: Climate variation explains a third of global crop yield variability. Nat. Commun., 6, 5989, doi:10.1038/ncomms6989.

    • Search Google Scholar
    • Export Citation
  • Schimmelpfennig, D., 1996: Uncertainty in economic models of climate-change impacts. Climatic Change, 33, 213234, doi:10.1007/BF00140247.

    • Search Google Scholar
    • Export Citation
  • Schlenker, W., and M. J. Roberts, 2009: Nonlinear temperature effects indicate severe damages to U.S. crop yields under climate change. Proc. Natl. Acad. Sci. USA, 106, 15 59415 598, doi:10.1073/pnas.0906865106.

    • Search Google Scholar
    • Export Citation
  • Statistical Methods Branch, 2006: The yield forecasting program of NASS. USDA NASS Statistical Methods Branch Staff Rep. SMB 06-01, 109 pp. [Available online at https://www.nass.usda.gov/Education_and_Outreach/Understanding_Statistics/yldfrcst2006.pdf.]

  • Tannura, M. A., S. H. Irwin, and D. L. Good, 2008: Weather, technology, and corn and soybean yields in the U.S. Corn Belt. University of Illinois at Urbana–Champaign Dept. of Agricultural and Consumer Economics Marketing and Outlook Res. Rep. 200801, 123 pp. [Available online at http://www.farmdoc.illinois.edu/marketing/morr/morr_08-01/morr_08-01.pdf.]

  • Thompson, L. M., 1988: Effects of changes in climate and weather variability on the yields of corn and soybeans. J. Prod. Agric., 1, 2027, doi:10.2134/jpa1988.0020.

    • Search Google Scholar
    • Export Citation
  • Uppala, S. M., and Coauthors, 2005: The ERA-40 Re-Analysis. Quart. J. Roy. Meteor. Soc., 131, 29613012, doi:10.1256/qj.04.176.

  • USDA, 2010: Field crops: Usual planting and harvesting dates—October 2010. USDA NASS Agricultural Handbook 628, 50 pp. [Available at http://usda.mannlib.cornell.edu/usda/nass/planting//2010s/2010/planting-10-29-2010.pdf.]

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 506 157 42
PDF Downloads 458 90 42