Forecast Verification of the Polar Ice Prediction System (PIPS) Sea Ice Concentration Fields

Michael L. Van Woert NOAA/NESDIS/Office of Research and Applications, Camp Springs, Maryland

Search for other papers by Michael L. Van Woert in
Current site
Google Scholar
PubMed
Close
,
Cheng-Zhi Zou NOAA/NESDIS/Office of Research and Applications, Camp Springs, Maryland

Search for other papers by Cheng-Zhi Zou in
Current site
Google Scholar
PubMed
Close
,
Walter N. Meier United States Naval Academy, Annapolis, Maryland

Search for other papers by Walter N. Meier in
Current site
Google Scholar
PubMed
Close
,
Philip D. Hovey NOAA/NESDIS/Office of Research and Applications, Camp Springs, Maryland

Search for other papers by Philip D. Hovey in
Current site
Google Scholar
PubMed
Close
,
Ruth H. Preller Naval Research Laboratory, Stennis Space Center, Mississippi

Search for other papers by Ruth H. Preller in
Current site
Google Scholar
PubMed
Close
, and
Pamela G. Posey Naval Research Laboratory, Stennis Space Center, Mississippi

Search for other papers by Pamela G. Posey in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

The National Ice Center relies upon a coupled ice–ocean model called the Polar Ice Prediction System (PIPS) to provide guidance for its 24–120-h sea ice forecasts. Here forecast skill assessments of the sea ice concentration (C) fields from PIPS for the period 1 May 2000–31 May 2002 are presented. Methods of measuring the sea ice forecast skill are adapted from the meteorological literature and applied to locations where the forecast or analysis sea ice fields changed by at least ±5%. The forecast skill referenced to climatology was high (>0.85, relative to a maximum score of 1.0) for all months examined. This is because interannual variability in the climatology, which is used as a reference field, is much greater than the day-to-day variability in the forecast field. The PIPS forecasts were also evaluated against persistence and combined climatological–persistence forecasts. Compared to persistence, the 24-h forecast was found to be skillful (>0.2) for all months studied except during the freeze-up months of December 2000 and January 2001. Relative to the combined reference field, the 24-h forecast was also positive for the non-freeze-up months; however, the skill scores were lower (∼0.1). During the poorly performing freeze-up months, a linear combination of persistence (∼95% weight) and climatology (∼5% weight) appears to provide the best available sea ice forecast.

To examine the less restrictive question of whether PIPS can forecast sea ice concentration changes, independent of the magnitude of the changes, “threat indexes” patterned after methods developed for tornado forecasting were established. Two specific questions were addressed with this technique. The first question is: What is the skill of forecasting locations at which a decrease in sea ice concentration has occurred? The second question is: Does PIPS correctly forecast melt-out regions? Using the more relaxed criterion of a threat index for defining correct forecasts, it was found that PIPS correctly made 24-h forecasts of decreasing sea ice concentration ∼10%–15% of the time (it also correctly forecast increasing sea ice concentration an additional ∼10%–15% of the time). However, PIPS correctly forecast melt-out conditions <5% of the time, suggesting that there may be deficiencies in the PIPS parameterization of marginal ice zone processes and/or uncertainties in the atmospheric–oceanic fields that force PIPS.

Additional affiliation: National Ice Center, Suitland, Maryland

Current affiliation: National Snow and Ice Data Center, Boulder, Colorado

Corresponding author address: Dr. Michael Van Woert, NOAA/ NESDIS/OSDPD/National Ice Center, E/SP, Federal Office Bldg. #4, Rm. 1069, 5200 Auth Rd., Camp Springs, MD 20746-4304. Email: mvanwoert@natice.noaa.gov

Abstract

The National Ice Center relies upon a coupled ice–ocean model called the Polar Ice Prediction System (PIPS) to provide guidance for its 24–120-h sea ice forecasts. Here forecast skill assessments of the sea ice concentration (C) fields from PIPS for the period 1 May 2000–31 May 2002 are presented. Methods of measuring the sea ice forecast skill are adapted from the meteorological literature and applied to locations where the forecast or analysis sea ice fields changed by at least ±5%. The forecast skill referenced to climatology was high (>0.85, relative to a maximum score of 1.0) for all months examined. This is because interannual variability in the climatology, which is used as a reference field, is much greater than the day-to-day variability in the forecast field. The PIPS forecasts were also evaluated against persistence and combined climatological–persistence forecasts. Compared to persistence, the 24-h forecast was found to be skillful (>0.2) for all months studied except during the freeze-up months of December 2000 and January 2001. Relative to the combined reference field, the 24-h forecast was also positive for the non-freeze-up months; however, the skill scores were lower (∼0.1). During the poorly performing freeze-up months, a linear combination of persistence (∼95% weight) and climatology (∼5% weight) appears to provide the best available sea ice forecast.

To examine the less restrictive question of whether PIPS can forecast sea ice concentration changes, independent of the magnitude of the changes, “threat indexes” patterned after methods developed for tornado forecasting were established. Two specific questions were addressed with this technique. The first question is: What is the skill of forecasting locations at which a decrease in sea ice concentration has occurred? The second question is: Does PIPS correctly forecast melt-out regions? Using the more relaxed criterion of a threat index for defining correct forecasts, it was found that PIPS correctly made 24-h forecasts of decreasing sea ice concentration ∼10%–15% of the time (it also correctly forecast increasing sea ice concentration an additional ∼10%–15% of the time). However, PIPS correctly forecast melt-out conditions <5% of the time, suggesting that there may be deficiencies in the PIPS parameterization of marginal ice zone processes and/or uncertainties in the atmospheric–oceanic fields that force PIPS.

Additional affiliation: National Ice Center, Suitland, Maryland

Current affiliation: National Snow and Ice Data Center, Boulder, Colorado

Corresponding author address: Dr. Michael Van Woert, NOAA/ NESDIS/OSDPD/National Ice Center, E/SP, Federal Office Bldg. #4, Rm. 1069, 5200 Auth Rd., Camp Springs, MD 20746-4304. Email: mvanwoert@natice.noaa.gov

Save
  • Arpe, K., Hollingsworth A. , Traction M. S. , Lorenc A. C. , Uppala S. , and Kallberg P. , 1985: The response of numerical weather prediction systems to FGGE level IIb data. Part II: Forecast verifications and implications for predictability. Quart. J. Roy. Meteor. Soc, 111 , 67101.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Atlas, R., Ghil M. , and Halem M. , 1981: Reply. Mon. Wea. Rev, 109 , 201204.

  • Beesley, J. A., Bretherton C. S. , Jakob C. , Andreas E. L. , Intieri J. M. , and Uttal T. A. , 2001: A comparison of cloud and boundary layer variables in the ECMWF forecast model with observations at the Sheba Ice Camp. J. Geophys. Res, 105 , 1233712349.

    • Search Google Scholar
    • Export Citation
  • Brier, G. W., and Allen R. A. , 1951: Verification of weather forecasts. Compendium of Meteorology, T. Malone, Ed., Amer. Meteor. Soc., 841–848.

    • Search Google Scholar
    • Export Citation
  • Cheng, A., and Preller R. H. , 1996: The development of an ice–ocean coupled model for the Northern Hemisphere. NRL Rep. NRL/ FR/7322—95-9627, Naval Research Laboratory, Stennis Space Center, MS, 65 pp.

    • Search Google Scholar
    • Export Citation
  • Cox, M., 1984: A primitive equation, 3-dimensional model of the ocean. GFDL Ocean Group Tech. Rep. 1, Geophysical Fluid Dynamics Laboratory, Princeton, NJ, 161 pp.

    • Search Google Scholar
    • Export Citation
  • Efron, B., 1979a: Bootstrap methods: Another look at the jackknife. Ann. Stat, 7 , 126.

  • Efron, B., 1979b: Computers and the theory of statistics: Thinking the unthinkable. SIAM Rev, 21 , 460480.

  • Flato, G. M., and Hibler W. D. III, 1992: Modeling pack ice as a cavitating fluid,. J. Phys. Oceanogr, 22 , 626651.

  • Ghil, M., 1979: Time-continuous assimilation of remote sensing data and its effect on weather forecasting. Mon. Wea. Rev, 107 , 140171.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Grumbine, R. W., 1998: Virtual floe ice drift forecast model intercomparison. Wea. Forecasting, 13 , 886890.

  • Heirtzler, J. R., Ed.,. 1985: Relief of the surface of the Earth. Rep. MGG-2, National Geophysical Data Center, Boulder, CO.

  • Hibler W. D. III, , 1979: A dynamic–thermodynamic sea ice model. J. Phys. Oceanogr, 9 , 815846.

  • Hibler W. D. III, , 1980: Modeling a variable thickness sea ice cover. Mon. Wea. Rev, 108 , 19431973.

  • Hogan, T. F., and Rosmond T. E. , 1991: The description of the Navy Operational Global Atmospheric Prediction System's spectral forecast model. Mon. Wea. Rev, 119 , 17861815.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hollinger, J. P., 1991: DMSP special sensor microwave/imager calibration/validation—Final report. Vol. 2, Naval Research Laboratory, Washington, DC, 310 pp.

    • Search Google Scholar
    • Export Citation
  • Hollingsworth, A., Arpe K. , Tiedtke M. , Capaldo M. , and Savijarvi H. , 1980: The performance of a medium-range forecast model in winter—Impact of physical parameterizations. Mon. Wea. Rev, 108 , 17361773.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Koblinsky, C. J., and Smith N. R. , Eds.,. 2001: Observing the oceans in the 21st century. Proceedings of the First International Conference on Ocean Observations for Climate (OCEANOBS99), GODAE Project Office, Melbourne, Australia.

    • Search Google Scholar
    • Export Citation
  • Levitus, S., 1982: Climatological atlas of the world ocean. NOAA Prof. Paper 13, 173 pp. and 17 microfiche.

  • Mace, G. G., Jakob C. , and Moran K. P. , 1998: Validation of hydrometeor occurence predicted by the ECMWF model using millimeter wave radar data. Geophys. Res. Lett, 25 , 16451652.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Meier, W. N., Van Woert M. L. , and Bertoia C. , 2001: Evaluation of operational SSM/I concentration algorithms. Ann. Glaciol, 33 , 102108.

  • Murphy, A. H., 1988: Skill scores based on the mean square error and their relationships to the correlation coefficient. Mon. Wea. Rev, 116 , 24172424.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Murphy, A. H., 1992: Climatology, persistence, and their linear combination as standards of reference in skill scores. Wea. Forecasting, 7 , 692698.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Murphy, A. H., and Daan H. , 1985: Forecast evaluation. Probability, Statistics and Decision Making in the Atmospheric Sciences, A. H. Murphy and R. W. Katz, Eds., Westview Press, 379–437.

    • Search Google Scholar
    • Export Citation
  • Murphy, A. H., and Epstein E. S. , 1989: Skill scores and correlation coefficients in model verification. Mon. Wea. Rev, 117 , 572581.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Partington, K. C., 2000: A data fusion algorithm for mapping sea-ice concentrations from Special Sensor Microwave/Imager data. IEEE Trans. Geosci. Remote Sens, 38 , 19471958.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pinardi, N., and Woods J. , Eds.,. 2002: Ocean Forecasting: Conceptual Basis and Applications. Springer, 472 pp.

  • Posey, P. G., and Preller R. H. , 1994: Operational use of SSM/I ice concentration in the initialization of a coupled ice–ocean model. Proc. IGARSS '94, Pasadena, CA, California Institute of Technology, 1231–1233.

    • Search Google Scholar
    • Export Citation
  • Preller, R. H., 1992: Sea ice prediction: The development of a suite of sea-ice forecasting systems for the Northern Hemisphere. Oceanography, 5 , 6468.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Preller, R. H., 1999: Prediction in ice-covered shallow seas. Coastal Ocean Prediction, Vol. 56, Coastal and Estuarine Studies, Amer. Geophys. Union, 405–441.

    • Search Google Scholar
    • Export Citation
  • Preller, R. H., and Posey P. G. , 1989: The Polar Ice Prediction System—A sea ice forecasting system. NORDA Rep. 212, Naval Research Laboratory, Stennis Space Center, MS, 42 pp.

    • Search Google Scholar
    • Export Citation
  • Preller, R. H., and Posey P. G. , 1996: Validation test report for a Navy sea ice forecasting system: The Polar Ice Predication System 2.0. NRL Rep. NRL/FR/7322—95-9634, Naval Research Laboratory, Stennis Space Center, MS, 31 pp.

    • Search Google Scholar
    • Export Citation
  • Preller, R. H., Walsh J. E. , and Maslanik J. A. , 1992: The use of satellite observations in ice covered simulations. Microwave Remote Sensing of Sea Ice, Geophys. Monogr., No. 68, Amer. Geophys. Union, 385–403.

    • Search Google Scholar
    • Export Citation
  • Press, W. H., Teukolsky S. A. , Vetterling W. T. , and Flannery B. P. , 1992: Numerical Recipes in FORTRAN 77. 2d ed. Cambridge University Press, 933 pp.

    • Search Google Scholar
    • Export Citation
  • Pritchard, R., Mueller S. , Hanzlick A. C. , and Yang Y-S. , 1990: Forecasting Bering Sea ice edge behavior. J. Geophys. Res, 95 , 775788.

  • Steffen, K., Key J. , Cavalieri D. , Comiso J. , Gloersen P. , St. Germain K. , and Rubinstein I. , 1992: The estimation of geophysical parameters using passive microwave algorithms. Microwave Remote Sensing of Sea Ice, Geophys. Monogr., No. 68, Amer. Geophys. Union, 201–231.

    • Search Google Scholar
    • Export Citation
  • Stephenson, D. B., 2000: Use of the “odds ratio” for diagnosing forecast skill. Wea. Forecasting, 15 , 221232.

  • Van Woert, M. L., Meier W. N. , Zou C-Z. , Beesley J. A. , and Hovey P. D. , 2001: Satellite validation of the May 2000 sea ice concentration fields from the Polar Ice Prediction System. Can. J. Remote Sens, 27 , 443456.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Walsh, J. E., Hibler W. D. , and Ross D. , 1985: Numerical simulation of Northern Hemisphere sea ice variability, 1951–1980. J. Geophys. Res, 90 , 48474865.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weaver, R., Morris C. , and Barry R. G. , 1987: Passive microwave data for snow and ice research: Planned products from the DMSP SSM/I system. Eos, Trans. Amer. Geophys. Union, 68 , 769, 776777.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 653 275 83
PDF Downloads 224 41 6